report.html

Report generated on 27-Jul-2021 at 10:55:13 by pytest-html v3.1.1

Environment

CI true
CI_COMMIT_REF_NAME master
CI_COMMIT_REF_SLUG master
CI_COMMIT_SHA 1634c669b9e5c8c8013cdbbafb91338cce413a2e
CI_JOB_ID 390900
CI_JOB_NAME tests
CI_JOB_STAGE test
CI_PIPELINE_ID 74389
CI_PROJECT_DIR /builds/esde/machine-learning/mlair
CI_PROJECT_ID 2411
CI_PROJECT_NAME mlair
CI_PROJECT_NAMESPACE esde/machine-learning
CI_PROJECT_PATH esde/machine-learning/mlair
CI_PROJECT_URL https://gitlab.jsc.fz-juelich.de/esde/machine-learning/mlair
CI_REGISTRY registry.jsc.fz-juelich.de
CI_REGISTRY_IMAGE registry.jsc.fz-juelich.de/esde/machine-learning/mlair
CI_REGISTRY_USER gitlab-ci-token
CI_RUNNER_DESCRIPTION gitlab-runner on zam347 with already installed requirements of MLAir using opensuse/leap
CI_RUNNER_ID 657
CI_RUNNER_TAGS machinelearningtools, mlair, zam347, opensuse, leap
CI_SERVER yes
CI_SERVER_NAME GitLab
CI_SERVER_REVISION 25fc1060aff
CI_SERVER_VERSION 14.0.5
GITLAB_CI true
GITLAB_USER_EMAIL l.leufen@fz-juelich.de
GITLAB_USER_ID 659
Packages {"pluggy": "0.13.1", "py": "1.10.0", "pytest": "6.2.2"}
Platform Linux-4.15.0-136-generic-x86_64-with-glibc2.3.4
Plugins {"cov": "2.11.1", "html": "3.1.1", "lazy-fixture": "0.6.3", "metadata": "1.11.0", "sugar": "0.9.4"}
Python 3.6.12

Summary

492 tests ran in 351.06 seconds.

492 passed, 0 skipped, 0 failed, 0 errors, 0 expected failures, 0 unexpected passes

Results

Result Test Duration Links
Passed test/test_configuration/test_defaults.py::TestGetDefaults::test_get_defaults 0.00
No log output captured.
Passed test/test_configuration/test_defaults.py::TestAllDefaults::test_training_parameters 0.00
No log output captured.
Passed test/test_configuration/test_defaults.py::TestAllDefaults::test_data_handler_parameters 0.00
No log output captured.
Passed test/test_configuration/test_defaults.py::TestAllDefaults::test_subset_parameters 0.00
No log output captured.
Passed test/test_configuration/test_defaults.py::TestAllDefaults::test_hpc_parameters 0.00
No log output captured.
Passed test/test_configuration/test_defaults.py::TestAllDefaults::test_postprocessing_parameters 0.00
No log output captured.
Passed test/test_configuration/test_join_settings.py::TestJoinSettings::test_no_args 0.00
No log output captured.
Passed test/test_configuration/test_join_settings.py::TestJoinSettings::test_daily 0.00
No log output captured.
Passed test/test_configuration/test_join_settings.py::TestJoinSettings::test_hourly 0.00
No log output captured.
Passed test/test_configuration/test_join_settings.py::TestJoinSettings::test_unknown_sampling 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestPrepareHost::test_prepare_host 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestPrepareHost::test_prepare_host_unknown 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestPrepareHost::test_prepare_host_given_path 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestPrepareHost::test_error_handling 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestPrepareHost::test_os_path_exists 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetExperimentName::test_set_experiment_name 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetExperimentName::test_set_experiment_name_sampling 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetExperimentName::test_set_experiment_name_tuple_sampling 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetExperimentName::test_set_experiment_path 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetExperimentName::test_set_experiment_path_given_path 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetBootstrapPath::test_bootstrap_path_is_none 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetBootstrapPath::test_bootstap_path_is_given 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestCheckPath::test_check_path_and_create 0.00
-------------------------------Captured log call--------------------------------
DEBUG root:path_config.py:123 Created path: data/test DEBUG root:path_config.py:125 Path already exists: data/test
Passed test/test_data_handler/test_data_handler.py::TestDefaultDataHandler::test_required_attributes 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler.py::TestDefaultDataHandler::test_init 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler.py::TestDefaultDataHandler::test_build 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler.py::TestDefaultDataHandler::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler.py::TestDefaultDataHandler::test_own_args 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler.py::TestDefaultDataHandler::test_transformation 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler.py::TestDefaultDataHandler::test_get_X 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler.py::TestDefaultDataHandler::test_get_Y 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler.py::TestDefaultDataHandler::test_get_data 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler.py::TestDefaultDataHandler::test_get_coordinates 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSampling::test_data_handler 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSampling::test_data_handler_transformation 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSampling::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_init 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_update_kwargs_single_to_tuple 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_update_kwargs_tuple 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_update_kwargs_default 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_update_kwargs_assert_failure 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_setup_samples 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_load_and_interpolate 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_set_inputs_and_targets 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_setup_data_path 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingWithKzFilter::test_data_handler 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingWithKzFilter::test_data_handler_transformation 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingWithKzFilter::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerSeparationOfScales::test_data_handler 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerSeparationOfScales::test_data_handler_transformation 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerSeparationOfScales::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestStandardIterator::test_blank 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestStandardIterator::test_init 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestStandardIterator::test_next 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_init 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_iter 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_add 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_name 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_set_mapping 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_getitem 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_keys 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_init 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_cleanup_path 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_get_number_of_mini_batches 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_len 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_concatenate 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_get_batch 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_save_to_pickle 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_prepare_batches 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_prepare_batches_upsampling 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_prepare_batches_no_remaining 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_data_generation 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_getitem 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_on_epoch_end 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_get_model_rank_no_model 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_get_model_rank_single_output_branch 0.12
------------------------------Captured stdout call------------------------------
_________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_1 (InputLayer) (None, 14, 1, 2) 0 _________________________________________________________________ flatten_1 (Flatten) (None, 28) 0 _________________________________________________________________ dense_1 (Dense) (None, 64) 1856 _________________________________________________________________ prelu_1 (PReLU) (None, 64) 64 _________________________________________________________________ dense_2 (Dense) (None, 32) 2080 _________________________________________________________________ prelu_2 (PReLU) (None, 32) 32 _________________________________________________________________ dense_3 (Dense) (None, 16) 528 _________________________________________________________________ prelu_3 (PReLU) (None, 16) 16 _________________________________________________________________ dense_4 (Dense) (None, 3) 51 _________________________________________________________________ linear_output (Activation) (None, 3) 0 ================================================================= Total params: 4,627 Trainable params: 4,627 Non-trainable params: 0 _________________________________________________________________ None
-------------------------------Captured log call--------------------------------
WARNING tensorflow:deprecation.py:323 From /usr/lib/python3.6/site-packages/tensorflow/python/framework/op_def_library.py:263: colocate_with (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version. Instructions for updating: Colocations handled automatically by placer.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_get_model_rank_multiple_output_branch 0.31
-------------------------------Captured log call--------------------------------
WARNING tensorflow:deprecation.py:506 From /usr/lib/python3.6/site-packages/keras/backend/tensorflow_backend.py:3445: calling dropout (from tensorflow.python.ops.nn_ops) with keep_prob is deprecated and will be removed in a future version. Instructions for updating: Please use `rate` instead of `keep_prob`. Rate should be set to `rate = 1 - keep_prob`.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_get_model_rank_error 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_permute 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestAbstractDataStore::test_init 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestAbstractDataStore::test_clear_data_store 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_put 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_get 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_get_with_sub_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_get_with_not_existing_sub_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_raise_not_in_data_store 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_get_default 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_raise_not_in_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_list_all_scopes 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search_empty_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_list_all_names 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search_scope_and_all_superiors 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search_scope_return_all 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search_scope_and_all_superiors_return_all 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_create_args_dict_default_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_create_args_dict_given_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_create_args_dict_missing_entry 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_set_args_from_dict 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_no_scope_given 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_put_with_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_get 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_get_with_sub_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_get_with_not_existing_sub_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_raise_not_in_data_store 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_get_default 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_raise_not_in_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_list_all_scopes 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search_empty_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_list_all_names 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search_scope_and_all_superiors 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search_scope_return_all 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search_scope_and_all_superiors_return_all 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_create_args_dict_default_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_create_args_dict_given_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_create_args_dict_missing_entry 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_set_args_from_dict 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_no_scope_given 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestCorrectScope::test_init 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestTracking::test_init 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestTracking::test_track_first_entry 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestTracking::test_track_second_entry 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestTracking::test_decrypt_args 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestDeg2RadAllPoints::test_deg2rad_all_points_scalar_inputs[value0] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestDeg2RadAllPoints::test_deg2rad_all_points_scalar_inputs[value1] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestDeg2RadAllPoints::test_deg2rad_all_points_scalar_inputs[custom_np_arrays] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestDeg2RadAllPoints::test_deg2rad_all_points_xr_arr_inputs 0.03
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[90.0-0.0--90.0-0.0-True-3.141592653589793] 0.01
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[1.5707963267948966-0.0--1.5707963267948966-0.0-False-3.141592653589793] 0.01
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[0.0-0.0-0.0-180.0-True-3.141592653589793] 0.01
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[0.0-0.0-0.0-3.141592653589793-False-3.141592653589793] 0.01
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[0.0-0.0--45.0-0-True-0.7853981633974483] 0.01
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[0.0-0.0--0.7853981633974483-0-False-0.7853981633974483] 0.01
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_fields_and_scalars[lat10-lon10--90.0-0.0-True-expected_dist0] 0.01
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_fields_and_scalars[lat11-lon11-lat21-lon21-True-expected_dist1] 0.01
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_missmatch_dimensions[lat10-0.0-0.0-0.0-True] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_missmatch_dimensions[0.0-lon11-0.0-0.0-True] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_missmatch_dimensions[0.0-0.0-lat22-0.0-True] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_missmatch_dimensions[0.0-0.0-0.0-lon23-True] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestToList::test_to_list 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_init 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test__start 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test__end 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test__duration 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_repr 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_run 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_stop 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_duration 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_enter_exit 0.00
-------------------------------Captured log call--------------------------------
INFO root:time_tracking.py:132 undefined job finished after 0:00:01 (hh:mm:ss)
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_name_enter_exit 0.00
-------------------------------Captured log call--------------------------------
INFO root:time_tracking.py:132 my job finished after 0:00:01 (hh:mm:ss)
Passed test/test_helpers/test_helpers.py::TestPytestRegex::test_pytest_regex_init 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestPytestRegex::test_pytest_regex_eq 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestPytestRegex::test_pytest_regex_repr 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestDictToXarray::test_dict_to_xarray 0.01
No log output captured.
Passed test/test_helpers/test_helpers.py::TestDictToXarray::test_dict_to_xarray_single_entry 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestFloatRound::test_float_round_ceil 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestFloatRound::test_float_round_decimals 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestFloatRound::test_float_round_type 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestFloatRound::test_float_round_negative 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSelectFromDict::test_select 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSelectFromDict::test_select_no_dict_given 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSelectFromDict::test_select_remove_none 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_dict_remove_single 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_dict_remove_multiple 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_list_remove_single 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_list_remove_multiple 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_remove_missing_argument 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_remove_not_supported_type 0.03
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_init_default 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_setup_logging_path_none 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_setup_logging_path_given 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_logger_console_level0 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_logger_console_level1 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_logger_console_level_wrong_type 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestExtractValue::test_extract 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestExtractValue::test_extract_multiple_elements 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestIsXarray::test_is_xarray_xr_input 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestIsXarray::test_is_xarray_other_input 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_xrdata_in 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_npdata_in_nokwargs 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_npdata_in_nokwargs_default_true 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_npdata_in_kwargs[False] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_npdata_in_kwargs[True] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_int_float_in_nokwargs_default_true[1] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_int_float_in_nokwargs_default_true[2.0] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_wrong_type_in_default_true_nokwargs[wrong_input0] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_wrong_type_in_default_true_nokwargs[wrong_input1] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_wrong_type_in_default_true_nokwargs[abc] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_dask_in_default_true_nokwargs 0.00
No log output captured.
Passed test/test_helpers/test_join.py::TestDownloadJoin::test_download_single_var 1.49
No log output captured.
Passed test/test_helpers/test_join.py::TestDownloadJoin::test_download_empty 0.09
No log output captured.
Passed test/test_helpers/test_join.py::TestDownloadJoin::test_download_incomplete 0.18
No log output captured.
Passed test/test_helpers/test_join.py::TestCorrectDataFormat::test_correct_data_format 0.00
No log output captured.
Passed test/test_helpers/test_join.py::TestGetData::test 0.06
No log output captured.
Passed test/test_helpers/test_join.py::TestLoadSeriesInformation::test_standard_query 0.08
No log output captured.
Passed test/test_helpers/test_join.py::TestLoadSeriesInformation::test_empty_result 0.08
No log output captured.
Passed test/test_helpers/test_join.py::TestSelectDistinctSeries::test_no_origin_given 0.00
No log output captured.
Passed test/test_helpers/test_join.py::TestSelectDistinctSeries::test_different_origins 0.00
No log output captured.
Passed test/test_helpers/test_join.py::TestSaveToPandas::test_empty_df 0.01
No log output captured.
Passed test/test_helpers/test_join.py::TestSaveToPandas::test_not_empty_df 0.01
No log output captured.
Passed test/test_helpers/test_join.py::TestSaveToPandas::test_alternative_date_format 0.00
No log output captured.
Passed test/test_helpers/test_join.py::TestCorrectStatName::test_nothing_to_do 0.00
No log output captured.
Passed test/test_helpers/test_join.py::TestCorrectStatName::test_correct_string 0.00
No log output captured.
Passed test/test_helpers/test_join.py::TestLowerList::test_string_lowering 0.00
No log output captured.
Passed test/test_helpers/test_join.py::TestCreateUrl::test_minimal_args_given 0.00
No log output captured.
Passed test/test_helpers/test_join.py::TestCreateUrl::test_given_kwargs 0.00
No log output captured.
Passed test/test_helpers/test_join.py::TestCreateUrl::test_single_kwargs 0.00
No log output captured.
Passed test/test_helpers/test_join.py::TestCreateUrl::test_none_kwargs 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_apply_standardise_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_apply_standardise_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise_apply[pandas-pd_mean-pd_std-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise_apply[xarray-xr_mean-xr_std-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_apply_centre_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_apply_centre_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre_apply[pandas-pd_mean-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre_apply[xarray-xr_mean-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_apply_min_max_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_apply_min_max_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max_apply[pandas-pd_min-pd_max-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max_apply[xarray-xr_min-xr_max-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise[pandas_gamma-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise[xarray_gamma-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise_inverse[pandas_gamma-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise_inverse[xarray_gamma-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_apply_standardise_inverse[pandas_gamma-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_apply_standardise_inverse[xarray_gamma-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise_apply[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise_apply[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_tables.py::TestTables::test_create_column_format_for_tex 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestRegex::test_init 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestRegex::test_eq 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestRegex::test_repr 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestAllEqual::test_numpy 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestAllEqual::test_xarray 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestAllEqual::test_other 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestAllEqual::test_encapsulated 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_model_property 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_all_empty 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_dict 0.01
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_attr 0.01
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_mix_attr_dict_no_duplicates 0.01
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_mix_attr_dict_valid_duplicates_optimizer 0.20
------------------------------Captured stderr call------------------------------
2021-07-27 10:49:32.309555: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 AVX512F FMA 2021-07-27 10:49:32.339576: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2100000000 Hz 2021-07-27 10:49:32.343398: I tensorflow/compiler/xla/service/service.cc:150] XLA service 0x560324ae55a0 executing computations on platform Host. Devices: 2021-07-27 10:49:32.343473: I tensorflow/compiler/xla/service/service.cc:158] StreamExecutor device (0): <undefined>, <undefined>
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_mix_attr_dict_valid_duplicates_none_optimizer 0.01
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_property_type_error 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_mix_attr_dict_invalid_duplicates_other_optimizer 0.03
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_mix_attr_dict_invalid_duplicates_same_optimizer_other_args 0.18
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_dict_invalid_keys 0.01
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compare_keras_optimizers_equal 0.20
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compare_keras_optimizers_no_optimizer 0.01
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compare_keras_optimizers_other_parameters_run_sess 0.21
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compare_keras_optimizers_other_parameters_none_sess 0.24
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_getattr 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_get_settings 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_custom_objects 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_set_custom_objects 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_get_padding_for_same_negative_kernel_size 0.00
------------------------------Captured stdout call------------------------------
In test_get_padding_for_same_negative_kernel_size
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_get_padding_for_same_strides_greater_one 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_get_padding_for_same_non_int_kernel 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_get_padding_for_same_stride_3d 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_get_padding_for_same_even_pad 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_negative_pads 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_len_of_pad_tuple 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_tuple_of_none_integer 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_tuple_of_tuple_none_integer_first 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_tuple_of_tuple_none_integer_second 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_valid_mix_of_int_and_tuple 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_invalid_mixed_tuple_and_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_invalid_mixed_int_and_tuple 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_valid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_negative_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_invalid_format_float 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_invalid_format_string 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_tuple_of_valid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_tuple_of_invalid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_tuple_of_invalid_format 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_call 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_valid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_negative_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_invalid_format_float 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_invalid_format_string 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_tuple_of_valid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_tuple_of_invalid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_tuple_of_invalid_format 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_call 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_check_and_get_padding_zero_padding 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_check_and_get_padding_sym_padding 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_check_and_get_padding_ref_padding 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_check_and_get_padding_raises 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[SymPad2D] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[SymmetricPadding2D0] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[SymmetricPadding2D1] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[RefPad2D] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[ReflectionPadding2D0] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[ReflectionPadding2D1] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[ZeroPad2D] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[ZeroPadding2D0] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[ZeroPadding2D1] 0.00
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestGetActivation::test_string_act 0.00
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestGetActivation::test_sting_act_unknown 0.00
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestGetActivation::test_layer_act 0.00
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestGetActivation::test_layer_act_invalid 0.00
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestFlattenTail::test_flatten_tail_no_bound_no_regul_no_drop 0.04
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestFlattenTail::test_flatten_tail_all_settings 0.13
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_block_part_name 0.00
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_conv_tower_3x3 0.05
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_conv_tower_3x3_batch_norm 0.65
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_conv_tower_3x3_activation 0.08
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_conv_tower_1x1 0.02
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_conv_towers 0.08
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_pool_tower 0.03
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_inception_block 0.24
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_inception_block_invalid_batchnorm 0.09
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_batch_normalisation 0.10
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestHistoryAdvanced::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestHistoryAdvanced::test_on_train_begin 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestLearningRateDecay::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestLearningRateDecay::test_check_param 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestLearningRateDecay::test_on_epoch_begin 0.66
------------------------------Captured stdout call------------------------------
Epoch 1/5 4/4 [==============================] - 0s 107ms/step - loss: 1.9313 Epoch 2/5 4/4 [==============================] - 0s 565us/step - loss: 1.8578 Epoch 3/5 4/4 [==============================] - 0s 461us/step - loss: 1.7877 Epoch 4/5 4/4 [==============================] - 0s 573us/step - loss: 1.7243 Epoch 5/5 4/4 [==============================] - 0s 1ms/step - loss: 1.6639
------------------------------Captured stderr call------------------------------
2021-07-27 10:49:35,268 - WARNING: From /usr/lib/python3.6/site-packages/tensorflow/python/ops/math_ops.py:3066: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use tf.cast instead. [deprecation.py:new_func:323] 2021-07-27 10:49:35,268 - WARNING: From /usr/lib/python3.6/site-packages/tensorflow/python/ops/math_ops.py:3066: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use tf.cast instead. [deprecation.py:new_func:323] 2021-07-27 10:49:35,268 - WARNING: From /usr/lib/python3.6/site-packages/tensorflow/python/ops/math_ops.py:3066: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use tf.cast instead. [deprecation.py:new_func:323] 2021-07-27 10:49:35,268 - WARNING: From /usr/lib/python3.6/site-packages/tensorflow/python/ops/math_ops.py:3066: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use tf.cast instead. [deprecation.py:new_func:323]
-------------------------------Captured log call--------------------------------
WARNING tensorflow:deprecation.py:323 From /usr/lib/python3.6/site-packages/tensorflow/python/ops/math_ops.py:3066: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use tf.cast instead.
Passed test/test_model_modules/test_keras_extensions.py::TestModelCheckpointAdvanced::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestModelCheckpointAdvanced::test_update_best 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestModelCheckpointAdvanced::test_update_callbacks 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestModelCheckpointAdvanced::test_on_epoch_end 0.00
------------------------------Captured stdout call------------------------------
Epoch 00001: val_loss did not improve from 6.00000 Epoch 00010: val_loss did not improve from 6.00000 Epoch 00011: val_loss improved from 6.00000 to 4.00000, saving model to ckpt.test Epoch 00011: save to /builds/esde/machine-learning/mlair/test/test_model_modules/callback_lr Epoch 00011: save to /builds/esde/machine-learning/mlair/test/test_model_modules/callback_hist Epoch 00011: saving model to ckpt.test Epoch 00011: save to /builds/esde/machine-learning/mlair/test/test_model_modules/callback_lr Epoch 00011: save to /builds/esde/machine-learning/mlair/test/test_model_modules/callback_hist
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_callbacks_set 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_callbacks_get 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_update_callback 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_add_callback 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_add_callback_raise 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_get_callbacks_as_dict 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_get_callbacks_no_dict 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_get_callback_by_name 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test__get_callbacks 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_get_checkpoint 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_create_model_checkpoint 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_load_callbacks 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_update_checkpoint 0.00
No log output captured.
Passed test/test_model_modules/test_linear_model.py::TestOrdinaryLeastSquareModel::test_constant_input_variable 0.00
No log output captured.
Passed test/test_model_modules/test_loss.py::TestLPLoss::test_l_p_loss 0.66
------------------------------Captured stdout call------------------------------
Epoch 1/1 4/4 [==============================] - 0s 52ms/step - loss: 1.2500 Epoch 1/1 4/4 [==============================] - 0s 44ms/step - loss: 2.2500
Passed test/test_model_modules/test_loss.py::TestVarLoss::test_var_loss 0.24
------------------------------Captured stdout call------------------------------
Epoch 1/1 4/4 [==============================] - 0s 46ms/step - loss: 0.1406
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_no_weights 0.27
------------------------------Captured stdout call------------------------------
Epoch 1/1 4/4 [==============================] - 0s 51ms/step - loss: 0.6953
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_with_weights[weights0] 0.27
------------------------------Captured stdout call------------------------------
Epoch 1/1 4/4 [==============================] - 0s 53ms/step - loss: 0.4734
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_with_weights[weights1] 0.29
------------------------------Captured stdout call------------------------------
Epoch 1/1 4/4 [==============================] - 0s 55ms/step - loss: 0.6953
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_with_weights[weights2] 0.29
------------------------------Captured stdout call------------------------------
Epoch 1/1 4/4 [==============================] - 0s 54ms/step - loss: 0.6953
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_with_weights[weights3] 0.28
------------------------------Captured stdout call------------------------------
Epoch 1/1 4/4 [==============================] - 0s 54ms/step - loss: 1.0281
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_invalid_weights 0.00
No log output captured.
Passed test/test_model_modules/test_model_class.py::TestIntelliO3_ts_architecture::test_init 1.31
No log output captured.
Passed test/test_model_modules/test_model_class.py::TestIntelliO3_ts_architecture::test_set_model 1.36
No log output captured.
Passed test/test_model_modules/test_model_class.py::TestIntelliO3_ts_architecture::test_set_compile_options 1.17
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_init 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_repr 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_x_property 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_y_property 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_add_precursor 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_add_successor 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_init 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_get_all_scopes 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_get_unique_scopes 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_get_unique_scopes_no_general 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_get_all_dims 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_create_track_chain 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_control_dict 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test__create_track_chain 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_precursor 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_track_object_same_stage 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_track_object_different_stage 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_update_control 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_set_object 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_set_object_no_control_obj 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_get_object_no_new_track_obj 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_get_object_no_control_obj 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_get_object_skip_update 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_recursive_decent_avail_in_1_up 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_recursive_decent_avail_in_2_up 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_recursive_decent_avail_from_chain 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_recursive_decent_avail_from_chain_get 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_recursive_decent_avail_from_chain_multiple_get 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_clean_control 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_init 0.35
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_plot 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_line 0.02
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_step 0.02
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_rect 0.02
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_set_ypos_anchor 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_plot_track_chain 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_add_variable_names 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_add_stages 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_create_track_chain_plot_run_env 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_set_lims 0.02
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_get_plot_metric 0.00
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_get_plot_metric_short_metric 0.00
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_get_plot_metric_main_branch 0.00
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_filter_columns 0.00
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_plot_from_hist_obj 0.60
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_plot_from_hist_dict 0.36
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_plot_additional_loss 0.70
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelLearningRate::test_plot_from_lr_obj 0.19
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelLearningRate::test_plot_from_lr_dict 0.20
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceDataHandler::test_init 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceDataHandler::test_make_reference_available_locally 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceDataHandler::test_is_reference_available_locally 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceb2share::test_inheritance 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceb2share::test_init 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceb2share::test_b2share_url 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceb2share::test_bar_custom 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceb2share::test_download_from_b2share 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_init_none_path 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_init_extra_path 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_inheritance 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_untar_forecasts 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_file_list 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_read_and_drop 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_make_reference_available_locally 0.00
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_set_param_by_value 0.00
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 set: 23tester(general)=23 DEBUG root:experiment_setup.py:392 set experiment attribute: 23tester(general)=23 DEBUG root:datastore.py:118 get: 23tester(general)=23
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_set_param_by_value_and_scope 0.00
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 set: 109tester(general)=109 DEBUG root:experiment_setup.py:392 set experiment attribute: 109tester(general)=109 DEBUG root:datastore.py:118 get: 109tester(general.tester)=109
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_set_param_with_default 0.00
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 set: NoneTester(general.testing)=notNone DEBUG root:experiment_setup.py:392 set experiment attribute: NoneTester(general.testing)=notNone DEBUG root:datastore.py:118 get: NoneTester(general.testing)=notNone DEBUG root:datastore.py:118 set: AnotherNoneTester(general)=None DEBUG root:experiment_setup.py:392 set experiment attribute: AnotherNoneTester(general)=None DEBUG root:datastore.py:118 get: AnotherNoneTester(general)=None
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_set_param_with_apply 0.00
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 set: NoneTester(general)=notNone DEBUG root:experiment_setup.py:392 set experiment attribute: NoneTester(general)=notNone DEBUG root:datastore.py:118 get: NoneTester(general)=notNone DEBUG root:datastore.py:118 set: NoneTester(general)=['notNone'] DEBUG root:experiment_setup.py:392 set experiment attribute: NoneTester(general)=['notNone'] DEBUG root:datastore.py:118 get: NoneTester(general)=['notNone'] DEBUG root:datastore.py:118 set: NoneTester(general)=[None] DEBUG root:experiment_setup.py:392 set experiment attribute: NoneTester(general)=[None] DEBUG root:datastore.py:118 get: NoneTester(general)=[None] DEBUG root:datastore.py:118 set: NoneTester(general)=2 DEBUG root:experiment_setup.py:392 set experiment attribute: NoneTester(general)=2 DEBUG root:datastore.py:118 get: NoneTester(general)=2
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_init_default 0.01
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_init_no_default 0.01
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_init_train_model_behaviour 0.02
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_compare_variables_and_statistics 0.01
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_multiprocessing_no_debug 0.01
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_multiprocessing_debug 0.01
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_set_callbacks 0.76
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_set_callbacks_no_lr_decay 1.51
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_get_model_settings 3.21
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_build_model 5.07
------------------------------Captured stdout call------------------------------
_________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_32 (InputLayer) (None, 14, 1, 5) 0 _________________________________________________________________ flatten_2 (Flatten) (None, 70) 0 _________________________________________________________________ dense_6 (Dense) (None, 64) 4544 _________________________________________________________________ prelu_1 (PReLU) (None, 64) 64 _________________________________________________________________ dense_7 (Dense) (None, 32) 2080 _________________________________________________________________ prelu_2 (PReLU) (None, 32) 32 _________________________________________________________________ dense_8 (Dense) (None, 16) 528 _________________________________________________________________ prelu_3 (PReLU) (None, 16) 16 _________________________________________________________________ dense_9 (Dense) (None, 5) 85 _________________________________________________________________ linear_output (Activation) (None, 5) 0 ================================================================= Total params: 7,349 Trainable params: 7,349 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_set_shapes 4.66
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_load_weights 0.00
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_compile_model 0.00
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_run 0.00
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_init 0.00
No log output captured.
Passed test/test_run_modules/test_partition_check.py::TestPartitionCheck::test_init 2.24
------------------------------Captured stderr call------------------------------
2021-07-27 10:50:00,111 - INFO: PartitionCheck started [run_environment.py:__init__:103] 2021-07-27 10:50:00,111 - INFO: PartitionCheck started [run_environment.py:__init__:103] 2021-07-27 10:50:00,111 - INFO: PartitionCheck started [run_environment.py:__init__:103] 2021-07-27 10:50:00,111 - INFO: PartitionCheck started [run_environment.py:__init__:103] 2021-07-27 10:50:00,111 - INFO: PartitionCheck started [run_environment.py:__init__:103] 2021-07-27 10:50:00,112 - INFO: PartitionCheck finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:00,112 - INFO: PartitionCheck finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:00,112 - INFO: PartitionCheck finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:00,112 - INFO: PartitionCheck finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:00,112 - INFO: PartitionCheck finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:00,112 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:50:00,112 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:50:00,112 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:50:00,112 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:50:00,112 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:50:00,113 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:00,113 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:00,113 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:00,113 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:00,113 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:02,328 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:155] 2021-07-27 10:50:02,328 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:155] 2021-07-27 10:50:02,328 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:155] 2021-07-27 10:50:02,328 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:155] 2021-07-27 10:50:02,328 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:155] 2021-07-27 10:50:02,352 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:50:02,352 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:50:02,352 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:50:02,352 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:50:02,352 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 PartitionCheck started INFO root:run_environment.py:118 PartitionCheck finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:118 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:155 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json INFO root:run_environment.py:143 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_partition_check.py::TestPartitionCheck::test_run_login 2.44
No log output captured.
Passed test/test_run_modules/test_partition_check.py::TestPartitionCheck::test_run_compute 2.38
No log output captured.
Passed test/test_run_modules/test_post_processing.py::TestPostProcessing::test_init 0.00
No log output captured.
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_init 46.13
------------------------------Captured stderr call------------------------------
2021-07-27 10:50:07,202 - INFO: PreProcessing started [run_environment.py:__init__:103] 2021-07-27 10:50:07,202 - INFO: PreProcessing started [run_environment.py:__init__:103] 2021-07-27 10:50:07,202 - INFO: PreProcessing started [run_environment.py:__init__:103] 2021-07-27 10:50:07,202 - INFO: PreProcessing started [run_environment.py:__init__:103] 2021-07-27 10:50:07,202 - INFO: PreProcessing started [run_environment.py:__init__:103] 2021-07-27 10:50:07,202 - INFO: check valid stations started (preprocessing) [pre_processing.py:validate_station:235] 2021-07-27 10:50:07,202 - INFO: check valid stations started (preprocessing) [pre_processing.py:validate_station:235] 2021-07-27 10:50:07,202 - INFO: check valid stations started (preprocessing) [pre_processing.py:validate_station:235] 2021-07-27 10:50:07,202 - INFO: check valid stations started (preprocessing) [pre_processing.py:validate_station:235] 2021-07-27 10:50:07,202 - INFO: check valid stations started (preprocessing) [pre_processing.py:validate_station:235] 2021-07-27 10:50:07,208 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:07,208 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:07,208 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:07,208 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:07,208 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:09,270 - INFO: load data for DEBW107 from JOIN [join.py:download_join:67] 2021-07-27 10:50:09,270 - INFO: load data for DEBW107 from JOIN [join.py:download_join:67] 2021-07-27 10:50:09,270 - INFO: load data for DEBW107 from JOIN [join.py:download_join:67] 2021-07-27 10:50:09,270 - INFO: load data for DEBW107 from JOIN [join.py:download_join:67] 2021-07-27 10:50:09,270 - INFO: load data for DEBW107 from JOIN [join.py:download_join:67] 2021-07-27 10:50:12,925 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:12,925 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:12,925 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:12,925 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:12,925 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:13,261 - INFO: PartitionCheck finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:13,261 - INFO: PartitionCheck finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:13,261 - INFO: PartitionCheck finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:13,261 - INFO: PartitionCheck finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:13,261 - INFO: PartitionCheck finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:13,354 - INFO: load data for DEBY081 from JOIN [join.py:download_join:67] 2021-07-27 10:50:13,354 - INFO: load data for DEBY081 from JOIN [join.py:download_join:67] 2021-07-27 10:50:13,354 - INFO: load data for DEBY081 from JOIN [join.py:download_join:67] 2021-07-27 10:50:13,354 - INFO: load data for DEBY081 from JOIN [join.py:download_join:67] 2021-07-27 10:50:13,354 - INFO: load data for DEBY081 from JOIN [join.py:download_join:67] 2021-07-27 10:50:17,850 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:17,850 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:17,850 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:17,850 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:17,850 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:18,252 - INFO: load data for DEBW013 from JOIN [join.py:download_join:67] 2021-07-27 10:50:18,252 - INFO: load data for DEBW013 from JOIN [join.py:download_join:67] 2021-07-27 10:50:18,252 - INFO: load data for DEBW013 from JOIN [join.py:download_join:67] 2021-07-27 10:50:18,252 - INFO: load data for DEBW013 from JOIN [join.py:download_join:67] 2021-07-27 10:50:18,252 - INFO: load data for DEBW013 from JOIN [join.py:download_join:67] 2021-07-27 10:50:23,296 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:23,296 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:23,296 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:23,296 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:23,296 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:23,717 - INFO: load data for DEBW076 from JOIN [join.py:download_join:67] 2021-07-27 10:50:23,717 - INFO: load data for DEBW076 from JOIN [join.py:download_join:67] 2021-07-27 10:50:23,717 - INFO: load data for DEBW076 from JOIN [join.py:download_join:67] 2021-07-27 10:50:23,717 - INFO: load data for DEBW076 from JOIN [join.py:download_join:67] 2021-07-27 10:50:23,717 - INFO: load data for DEBW076 from JOIN [join.py:download_join:67] 2021-07-27 10:50:28,374 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:28,374 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:28,374 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:28,374 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:28,374 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:28,756 - INFO: load data for DEBW087 from JOIN [join.py:download_join:67] 2021-07-27 10:50:28,756 - INFO: load data for DEBW087 from JOIN [join.py:download_join:67] 2021-07-27 10:50:28,756 - INFO: load data for DEBW087 from JOIN [join.py:download_join:67] 2021-07-27 10:50:28,756 - INFO: load data for DEBW087 from JOIN [join.py:download_join:67] 2021-07-27 10:50:28,756 - INFO: load data for DEBW087 from JOIN [join.py:download_join:67] 2021-07-27 10:50:33,433 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:33,433 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:33,433 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:33,433 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:33,433 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:33,779 - INFO: run for 0:00:27 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:33,779 - INFO: run for 0:00:27 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:33,779 - INFO: run for 0:00:27 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:33,779 - INFO: run for 0:00:27 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:33,779 - INFO: run for 0:00:27 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:33,780 - INFO: check valid stations started (train) [pre_processing.py:validate_station:235] 2021-07-27 10:50:33,780 - INFO: check valid stations started (train) [pre_processing.py:validate_station:235] 2021-07-27 10:50:33,780 - INFO: check valid stations started (train) [pre_processing.py:validate_station:235] 2021-07-27 10:50:33,780 - INFO: check valid stations started (train) [pre_processing.py:validate_station:235] 2021-07-27 10:50:33,780 - INFO: check valid stations started (train) [pre_processing.py:validate_station:235] 2021-07-27 10:50:33,780 - INFO: setup transformation using train data exclusively [pre_processing.py:validate_station:238] 2021-07-27 10:50:33,780 - INFO: setup transformation using train data exclusively [pre_processing.py:validate_station:238] 2021-07-27 10:50:33,780 - INFO: setup transformation using train data exclusively [pre_processing.py:validate_station:238] 2021-07-27 10:50:33,780 - INFO: setup transformation using train data exclusively [pre_processing.py:validate_station:238] 2021-07-27 10:50:33,780 - INFO: setup transformation using train data exclusively [pre_processing.py:validate_station:238] 2021-07-27 10:50:33,785 - INFO: use serial transformation approach [default_data_handler.py:transformation:321] 2021-07-27 10:50:33,785 - INFO: use serial transformation approach [default_data_handler.py:transformation:321] 2021-07-27 10:50:33,785 - INFO: use serial transformation approach [default_data_handler.py:transformation:321] 2021-07-27 10:50:33,785 - INFO: use serial transformation approach [default_data_handler.py:transformation:321] 2021-07-27 10:50:33,785 - INFO: use serial transformation approach [default_data_handler.py:transformation:321] 2021-07-27 10:50:33,890 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:33,890 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:33,890 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:33,890 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:33,890 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:33,979 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:33,979 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:33,979 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:33,979 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:33,979 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,082 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,082 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,082 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,082 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,082 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,188 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,188 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,188 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,188 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,188 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,297 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,297 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,297 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,297 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,297 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,324 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:34,324 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:34,324 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:34,324 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:34,324 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:34,417 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,417 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,417 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,417 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,417 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,800 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,800 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,800 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,800 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:34,800 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:35,159 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:35,159 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:35,159 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:35,159 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:35,159 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:35,533 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:35,533 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:35,533 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:35,533 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:35,533 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:35,885 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:35,885 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:35,885 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:35,885 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:35,885 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:36,137 - INFO: run for 0:00:03 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:36,137 - INFO: run for 0:00:03 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:36,137 - INFO: run for 0:00:03 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:36,137 - INFO: run for 0:00:03 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:36,137 - INFO: run for 0:00:03 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:36,138 - INFO: check valid stations started (val) [pre_processing.py:validate_station:235] 2021-07-27 10:50:36,138 - INFO: check valid stations started (val) [pre_processing.py:validate_station:235] 2021-07-27 10:50:36,138 - INFO: check valid stations started (val) [pre_processing.py:validate_station:235] 2021-07-27 10:50:36,138 - INFO: check valid stations started (val) [pre_processing.py:validate_station:235] 2021-07-27 10:50:36,138 - INFO: check valid stations started (val) [pre_processing.py:validate_station:235] 2021-07-27 10:50:36,147 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:36,147 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:36,147 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:36,147 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:36,147 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:36,237 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:36,237 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:36,237 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:36,237 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:36,237 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:36,656 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:36,656 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:36,656 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:36,656 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:36,656 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:37,011 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:37,011 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:37,011 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:37,011 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:37,011 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:37,346 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:37,346 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:37,346 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:37,346 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:37,346 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:37,697 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:37,697 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:37,697 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:37,697 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:37,697 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:37,947 - INFO: run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:37,947 - INFO: run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:37,947 - INFO: run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:37,947 - INFO: run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:37,947 - INFO: run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:37,948 - INFO: check valid stations started (test) [pre_processing.py:validate_station:235] 2021-07-27 10:50:37,948 - INFO: check valid stations started (test) [pre_processing.py:validate_station:235] 2021-07-27 10:50:37,948 - INFO: check valid stations started (test) [pre_processing.py:validate_station:235] 2021-07-27 10:50:37,948 - INFO: check valid stations started (test) [pre_processing.py:validate_station:235] 2021-07-27 10:50:37,948 - INFO: check valid stations started (test) [pre_processing.py:validate_station:235] 2021-07-27 10:50:37,957 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:37,957 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:37,957 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:37,957 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:37,957 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:38,042 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:38,042 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:38,042 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:38,042 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:38,042 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:38,381 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:38,381 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:38,381 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:38,381 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:38,381 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:38,762 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:38,762 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:38,762 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:38,762 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:38,762 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:39,097 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:39,097 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:39,097 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:39,097 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:39,097 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:39,429 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:39,429 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:39,429 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:39,429 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:39,429 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:39,680 - INFO: run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:39,680 - INFO: run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:39,680 - INFO: run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:39,680 - INFO: run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:39,680 - INFO: run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:39,681 - INFO: check valid stations started (train_val) [pre_processing.py:validate_station:235] 2021-07-27 10:50:39,681 - INFO: check valid stations started (train_val) [pre_processing.py:validate_station:235] 2021-07-27 10:50:39,681 - INFO: check valid stations started (train_val) [pre_processing.py:validate_station:235] 2021-07-27 10:50:39,681 - INFO: check valid stations started (train_val) [pre_processing.py:validate_station:235] 2021-07-27 10:50:39,681 - INFO: check valid stations started (train_val) [pre_processing.py:validate_station:235] 2021-07-27 10:50:39,692 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:39,692 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:39,692 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:39,692 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:39,692 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:50:39,784 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:39,784 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:39,784 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:39,784 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:39,784 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:40,167 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:40,167 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:40,167 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:40,167 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:40,167 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:40,517 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:40,517 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:40,517 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:40,517 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:40,517 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:40,872 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:40,872 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:40,872 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:40,872 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:40,872 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:41,234 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:41,234 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:41,234 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:41,234 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:41,234 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:50:41,502 - INFO: run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:41,502 - INFO: run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:41,502 - INFO: run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:41,502 - INFO: run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:41,502 - INFO: run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:50:45,282 - INFO: Searching for competitors to be prepared for use. [pre_processing.py:prepare_competitors:302] 2021-07-27 10:50:45,282 - INFO: Searching for competitors to be prepared for use. [pre_processing.py:prepare_competitors:302] 2021-07-27 10:50:45,282 - INFO: Searching for competitors to be prepared for use. [pre_processing.py:prepare_competitors:302] 2021-07-27 10:50:45,282 - INFO: Searching for competitors to be prepared for use. [pre_processing.py:prepare_competitors:302] 2021-07-27 10:50:45,282 - INFO: Searching for competitors to be prepared for use. [pre_processing.py:prepare_competitors:302] 2021-07-27 10:50:45,283 - INFO: No preparation required because no competitor was provided to the workflow. [pre_processing.py:prepare_competitors:312] 2021-07-27 10:50:45,283 - INFO: No preparation required because no competitor was provided to the workflow. [pre_processing.py:prepare_competitors:312] 2021-07-27 10:50:45,283 - INFO: No preparation required because no competitor was provided to the workflow. [pre_processing.py:prepare_competitors:312] 2021-07-27 10:50:45,283 - INFO: No preparation required because no competitor was provided to the workflow. [pre_processing.py:prepare_competitors:312] 2021-07-27 10:50:45,283 - INFO: No preparation required because no competitor was provided to the workflow. [pre_processing.py:prepare_competitors:312] 2021-07-27 10:50:45,284 - INFO: PreProcessing finished after 0:00:39 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:45,284 - INFO: PreProcessing finished after 0:00:39 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:45,284 - INFO: PreProcessing finished after 0:00:39 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:45,284 - INFO: PreProcessing finished after 0:00:39 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:45,284 - INFO: PreProcessing finished after 0:00:39 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:45,284 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:50:45,284 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:50:45,284 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:50:45,284 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:50:45,284 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:50:45,284 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:45,284 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:45,284 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:45,284 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:45,284 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:50:53,292 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:155] 2021-07-27 10:50:53,292 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:155] 2021-07-27 10:50:53,292 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:155] 2021-07-27 10:50:53,292 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:155] 2021-07-27 10:50:53,292 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:155] 2021-07-27 10:50:53,325 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:50:53,325 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:50:53,325 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:50:53,325 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:50:53,325 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 PreProcessing started INFO root:pre_processing.py:235 check valid stations started (preprocessing) INFO root:pre_processing.py:263 use serial validate station approach INFO root:join.py:67 load data for DEBW107 from JOIN INFO root:time_tracking.py:132 setup_samples finished after 0:00:06 (hh:mm:ss) INFO root:run_environment.py:118 PartitionCheck finished after 0:00:09 (hh:mm:ss) INFO root:join.py:67 load data for DEBY081 from JOIN INFO root:time_tracking.py:132 setup_samples finished after 0:00:05 (hh:mm:ss) INFO root:join.py:67 load data for DEBW013 from JOIN INFO root:time_tracking.py:132 setup_samples finished after 0:00:06 (hh:mm:ss) INFO root:join.py:67 load data for DEBW076 from JOIN INFO root:time_tracking.py:132 setup_samples finished after 0:00:05 (hh:mm:ss) INFO root:join.py:67 load data for DEBW087 from JOIN INFO root:time_tracking.py:132 setup_samples finished after 0:00:05 (hh:mm:ss) INFO root:pre_processing.py:270 run for 0:00:27 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. INFO root:pre_processing.py:235 check valid stations started (train) INFO root:pre_processing.py:238 setup transformation using train data exclusively INFO root:default_data_handler.py:321 use serial transformation approach INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:263 use serial validate station approach INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:270 run for 0:00:03 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. INFO root:pre_processing.py:235 check valid stations started (val) INFO root:pre_processing.py:263 use serial validate station approach INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:270 run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. INFO root:pre_processing.py:235 check valid stations started (test) INFO root:pre_processing.py:263 use serial validate station approach INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:270 run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. INFO root:pre_processing.py:235 check valid stations started (train_val) INFO root:pre_processing.py:263 use serial validate station approach INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:270 run for 0:00:02 (hh:mm:ss) to check 5 station(s). Found 5/5 valid stations. INFO root:pre_processing.py:302 Searching for competitors to be prepared for use. INFO root:pre_processing.py:312 No preparation required because no competitor was provided to the workflow. INFO root:run_environment.py:118 PreProcessing finished after 0:00:39 (hh:mm:ss) INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:118 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:155 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json INFO root:run_environment.py:143 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_run 22.57
No log output captured.
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_split_train_val_test 17.33
No log output captured.
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_create_set_split_not_all_stations 6.75
------------------------------Captured stderr call------------------------------
2021-07-27 10:51:33,259 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:235] 2021-07-27 10:51:33,259 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:235] 2021-07-27 10:51:33,259 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:235] 2021-07-27 10:51:33,259 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:235] 2021-07-27 10:51:33,259 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:235] 2021-07-27 10:51:33,267 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:33,267 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:33,267 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:33,267 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:33,267 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:33,366 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:33,366 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:33,366 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:33,366 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:33,366 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:33,931 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:33,931 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:33,931 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:33,931 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:33,931 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:34,327 - INFO: run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:51:34,327 - INFO: run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:51:34,327 - INFO: run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:51:34,327 - INFO: run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:51:34,327 - INFO: run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations. [pre_processing.py:validate_station:270]
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 set: use_all_stations_on_all_data_sets(general)=False DEBUG root:datastore.py:118 get: stations(general.awesome)=['DEBW107', 'DEBY081', 'DEBW013', 'DEBW076', 'DEBW087', 'DEBW001'] DEBUG root:datastore.py:118 get: use_all_stations_on_all_data_sets(general)=False DEBUG root:pre_processing.py:217 Awesome stations (len=2): ['DEBW107', 'DEBY081'] DEBUG root:datastore.py:118 get: data_handler(general)=<class 'mlair.data_handler.default_data_handler.DefaultDataHandler'> INFO root:pre_processing.py:235 check valid stations started (awesome) DEBUG root:datastore.py:118 get: transformation(general.awesome)={} DEBUG root:datastore.py:120 get: extreme_values(general.awesome)=None DEBUG root:datastore.py:118 get: max_number_multiprocessing(general.awesome)=16 DEBUG root:datastore.py:120 get: min_length(general.awesome)=None DEBUG root:datastore.py:118 get: data_origin(general.awesome)={'cloudcover': 'REA', 'humidity': 'REA', 'pblheight': 'REA', 'press': 'REA', 'relhum': 'REA', 'temp': 'REA', 'totprecip': 'REA', 'u': 'REA', 'v': 'REA', 'no': '', 'no2': '', 'o3': '', 'pm10': '', 'so2': ''} DEBUG root:datastore.py:118 get: variables(general.awesome)=['o3', 'temp'] DEBUG root:datastore.py:118 get: interpolation_limit(general.awesome)=1 DEBUG root:datastore.py:120 get: overwrite_local_data(general.awesome)=None DEBUG root:datastore.py:120 get: lazy_preprocessing(general.awesome)=None DEBUG root:datastore.py:118 get: interpolation_method(general.awesome)=linear DEBUG root:datastore.py:118 get: window_history_size(general.awesome)=13 DEBUG root:datastore.py:118 get: statistics_per_var(general.awesome)={'o3': 'dma8eu', 'temp': 'maximum'} DEBUG root:datastore.py:120 get: window_history_offset(general.awesome)=None DEBUG root:datastore.py:118 get: station_type(general.awesome)=background DEBUG root:datastore.py:118 get: window_dim(general.awesome)=window DEBUG root:datastore.py:118 get: target_var(general.awesome)=o3 DEBUG root:datastore.py:118 get: sampling(general.awesome)=daily DEBUG root:datastore.py:118 get: iter_dim(general.awesome)=Stations DEBUG root:datastore.py:118 get: time_dim(general.awesome)=datetime DEBUG root:datastore.py:118 get: window_lead_time(general.awesome)=3 DEBUG root:datastore.py:120 get: store_data_locally(general.awesome)=None DEBUG root:datastore.py:118 get: target_dim(general.awesome)=variables DEBUG root:datastore.py:118 get: use_multiprocessing(general.awesome)=True DEBUG root:datastore.py:120 get: extremes_on_right_tail_only(general.awesome)=None DEBUG root:datastore.py:118 get: start(general.awesome)=1997-01-01 DEBUG root:datastore.py:118 get: end(general.awesome)=2017-12-31 DEBUG root:datastore.py:118 get: data_path(general.awesome)=/home/root/mlair/data/ DEBUG root:datastore.py:120 get: store_processed_data(general.awesome)=None DEBUG root:datastore.py:118 get: experiment_path(general.awesome)=/builds/esde/machine-learning/mlair/TestExperiment_daily DEBUG root:datastore.py:120 get: network(general.awesome)=None DEBUG root:datastore.py:120 get: name_affix(general.awesome)=None DEBUG root:datastore.py:118 get: use_multiprocessing(general)=True DEBUG root:datastore.py:118 get: max_number_multiprocessing(general)=16 INFO root:pre_processing.py:263 use serial validate station approach DEBUG root:path_config.py:125 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:323 try to load local data from: /home/root/mlair/data/daily/DEBW107_o3_temp.nc DEBUG root:data_handler_single_station.py:327 loading finished INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:206 No extreme values given, skip multiply extremes DEBUG root:default_data_handler.py:96 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBW107_awesome.pickle DEBUG root:path_config.py:125 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:323 try to load local data from: /home/root/mlair/data/daily/DEBY081_o3_temp.nc DEBUG root:data_handler_single_station.py:327 loading finished INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:206 No extreme values given, skip multiply extremes DEBUG root:default_data_handler.py:96 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBY081_awesome.pickle INFO root:pre_processing.py:270 run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations. DEBUG root:datastore.py:118 set: stations(general.awesome)=['DEBW107', 'DEBY081'] DEBUG root:datastore.py:118 set: data_collection(general.awesome)=<mlair.data_handler.iterator.DataCollection object at 0x7fc838554a58> DEBUG root:datastore.py:118 get: data_collection(general.awesome)=<mlair.data_handler.iterator.DataCollection object at 0x7fc838554a58> DEBUG root:datastore.py:120 get: data_collection(general)=None DEBUG root:datastore.py:118 get: stations(general.awesome)=['DEBW107', 'DEBY081']
----------------------------Captured stderr teardown----------------------------
2021-07-27 10:51:34,329 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:34,329 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:34,329 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:34,329 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:34,329 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:34,329 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:34,329 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:34,329 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:34,329 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:34,329 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:39,962 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json [run_environment.py:__save_tracking:155] 2021-07-27 10:51:39,962 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json [run_environment.py:__save_tracking:155] 2021-07-27 10:51:39,962 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json [run_environment.py:__save_tracking:155] 2021-07-27 10:51:39,962 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json [run_environment.py:__save_tracking:155] 2021-07-27 10:51:39,962 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json [run_environment.py:__save_tracking:155] 2021-07-27 10:51:40,002 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:51:40,002 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:51:40,002 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:51:40,002 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:51:40,002 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143]
-----------------------------Captured log teardown------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:118 RunEnvironment finished after 0:00:01 (hh:mm:ss) DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging INFO root:run_environment.py:155 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging INFO root:run_environment.py:143 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_create_set_split_all_stations 8.36
------------------------------Captured stderr call------------------------------
2021-07-27 10:51:40,015 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:235] 2021-07-27 10:51:40,015 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:235] 2021-07-27 10:51:40,015 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:235] 2021-07-27 10:51:40,015 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:235] 2021-07-27 10:51:40,015 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:235] 2021-07-27 10:51:40,023 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:40,023 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:40,023 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:40,023 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:40,023 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:40,118 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:40,118 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:40,118 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:40,118 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:40,118 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:40,635 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:40,635 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:40,635 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:40,635 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:40,635 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:41,105 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:41,105 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:41,105 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:41,105 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:41,105 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:41,579 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:41,579 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:41,579 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:41,579 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:41,579 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:42,062 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:42,062 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:42,062 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:42,062 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:42,062 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:42,527 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:42,527 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:42,527 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:42,527 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:42,527 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:42,530 - INFO: remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") [pre_processing.py:f_proc:326] 2021-07-27 10:51:42,530 - INFO: remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") [pre_processing.py:f_proc:326] 2021-07-27 10:51:42,530 - INFO: remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") [pre_processing.py:f_proc:326] 2021-07-27 10:51:42,530 - INFO: remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") [pre_processing.py:f_proc:326] 2021-07-27 10:51:42,530 - INFO: remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") [pre_processing.py:f_proc:326] 2021-07-27 10:51:42,532 - INFO: run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:51:42,532 - INFO: run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:51:42,532 - INFO: run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:51:42,532 - INFO: run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:51:42,532 - INFO: run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270]
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 get: stations(general.awesome)=['DEBW107', 'DEBY081', 'DEBW013', 'DEBW076', 'DEBW087', 'DEBW001'] DEBUG root:datastore.py:118 get: use_all_stations_on_all_data_sets(general)=True DEBUG root:pre_processing.py:217 Awesome stations (len=6): ['DEBW107', 'DEBY081', 'DEBW013', 'DEBW076', 'DEBW087', 'DEBW001'] DEBUG root:datastore.py:118 get: data_handler(general)=<class 'mlair.data_handler.default_data_handler.DefaultDataHandler'> INFO root:pre_processing.py:235 check valid stations started (awesome) DEBUG root:datastore.py:118 get: transformation(general.awesome)={} DEBUG root:datastore.py:120 get: extreme_values(general.awesome)=None DEBUG root:datastore.py:118 get: max_number_multiprocessing(general.awesome)=16 DEBUG root:datastore.py:120 get: min_length(general.awesome)=None DEBUG root:datastore.py:118 get: data_origin(general.awesome)={'cloudcover': 'REA', 'humidity': 'REA', 'pblheight': 'REA', 'press': 'REA', 'relhum': 'REA', 'temp': 'REA', 'totprecip': 'REA', 'u': 'REA', 'v': 'REA', 'no': '', 'no2': '', 'o3': '', 'pm10': '', 'so2': ''} DEBUG root:datastore.py:118 get: variables(general.awesome)=['o3', 'temp'] DEBUG root:datastore.py:118 get: interpolation_limit(general.awesome)=1 DEBUG root:datastore.py:120 get: overwrite_local_data(general.awesome)=None DEBUG root:datastore.py:120 get: lazy_preprocessing(general.awesome)=None DEBUG root:datastore.py:118 get: interpolation_method(general.awesome)=linear DEBUG root:datastore.py:118 get: window_history_size(general.awesome)=13 DEBUG root:datastore.py:118 get: statistics_per_var(general.awesome)={'o3': 'dma8eu', 'temp': 'maximum'} DEBUG root:datastore.py:120 get: window_history_offset(general.awesome)=None DEBUG root:datastore.py:118 get: station_type(general.awesome)=background DEBUG root:datastore.py:118 get: window_dim(general.awesome)=window DEBUG root:datastore.py:118 get: target_var(general.awesome)=o3 DEBUG root:datastore.py:118 get: sampling(general.awesome)=daily DEBUG root:datastore.py:118 get: iter_dim(general.awesome)=Stations DEBUG root:datastore.py:118 get: time_dim(general.awesome)=datetime DEBUG root:datastore.py:118 get: window_lead_time(general.awesome)=3 DEBUG root:datastore.py:120 get: store_data_locally(general.awesome)=None DEBUG root:datastore.py:118 get: target_dim(general.awesome)=variables DEBUG root:datastore.py:118 get: use_multiprocessing(general.awesome)=True DEBUG root:datastore.py:120 get: extremes_on_right_tail_only(general.awesome)=None DEBUG root:datastore.py:118 get: start(general.awesome)=1997-01-01 DEBUG root:datastore.py:118 get: end(general.awesome)=2017-12-31 DEBUG root:datastore.py:118 get: data_path(general.awesome)=/home/root/mlair/data/ DEBUG root:datastore.py:120 get: store_processed_data(general.awesome)=None DEBUG root:datastore.py:118 get: experiment_path(general.awesome)=/builds/esde/machine-learning/mlair/TestExperiment_daily DEBUG root:datastore.py:120 get: network(general.awesome)=None DEBUG root:datastore.py:120 get: name_affix(general.awesome)=None DEBUG root:datastore.py:118 get: use_multiprocessing(general)=True DEBUG root:datastore.py:118 get: max_number_multiprocessing(general)=16 INFO root:pre_processing.py:263 use serial validate station approach DEBUG root:path_config.py:125 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:323 try to load local data from: /home/root/mlair/data/daily/DEBW107_o3_temp.nc DEBUG root:data_handler_single_station.py:327 loading finished INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:206 No extreme values given, skip multiply extremes DEBUG root:default_data_handler.py:96 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBW107_awesome.pickle DEBUG root:path_config.py:125 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:323 try to load local data from: /home/root/mlair/data/daily/DEBY081_o3_temp.nc DEBUG root:data_handler_single_station.py:327 loading finished INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:206 No extreme values given, skip multiply extremes DEBUG root:default_data_handler.py:96 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBY081_awesome.pickle DEBUG root:path_config.py:125 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:323 try to load local data from: /home/root/mlair/data/daily/DEBW013_o3_temp.nc DEBUG root:data_handler_single_station.py:327 loading finished INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:206 No extreme values given, skip multiply extremes DEBUG root:default_data_handler.py:96 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBW013_awesome.pickle DEBUG root:path_config.py:125 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:323 try to load local data from: /home/root/mlair/data/daily/DEBW076_o3_temp.nc DEBUG root:data_handler_single_station.py:327 loading finished INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:206 No extreme values given, skip multiply extremes DEBUG root:default_data_handler.py:96 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBW076_awesome.pickle DEBUG root:path_config.py:125 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:323 try to load local data from: /home/root/mlair/data/daily/DEBW087_o3_temp.nc DEBUG root:data_handler_single_station.py:327 loading finished INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:206 No extreme values given, skip multiply extremes DEBUG root:default_data_handler.py:96 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBW087_awesome.pickle DEBUG root:path_config.py:125 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:323 try to load local data from: /home/root/mlair/data/daily/DEBW001_o3_temp.nc DEBUG root:data_handler_single_station.py:329 [Errno 2] No such file or directory: b'/home/root/mlair/data/daily/DEBW001_o3_temp.nc' DEBUG root:data_handler_single_station.py:330 load new data DEBUG urllib3.connectionpool:connectionpool.py:975 Starting new HTTPS connection (1): join.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:461 https://join.fz-juelich.de:443 "GET /services/rest/surfacedata/search/?station_id=DEBW001&station_type=background&network_name=AIRBASE&as_dict=true&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute HTTP/1.1" 200 None DEBUG root:join.py:172 ['DEBW001']: [] INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:326 remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") DEBUG root:pre_processing.py:327 detailed information for removal of station DEBW001: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/xarray/backends/file_manager.py", line 199, in _acquire_with_cache_info file = self._cache[self._key] File "/usr/lib/python3.6/site-packages/xarray/backends/lru_cache.py", line 53, in __getitem__ value = self._cache[key] KeyError: [<class 'netCDF4._netCDF4.Dataset'>, ('/home/root/mlair/data/daily/DEBW001_o3_temp.nc',), 'r', (('clobber', True), ('diskless', False), ('format', 'NETCDF4'), ('persist', False))] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 324, in load_data data = xr.open_dataarray(file_name) File "/usr/lib/python3.6/site-packages/xarray/backends/api.py", line 717, in open_dataarray decode_timedelta=decode_timedelta, File "/usr/lib/python3.6/site-packages/xarray/backends/api.py", line 572, in open_dataset store = opener(filename_or_obj, **extra_kwargs, **backend_kwargs) File "/usr/lib/python3.6/site-packages/xarray/backends/netCDF4_.py", line 364, in open return cls(manager, group=group, mode=mode, lock=lock, autoclose=autoclose) File "/usr/lib/python3.6/site-packages/xarray/backends/netCDF4_.py", line 314, in __init__ self.format = self.ds.data_model File "/usr/lib/python3.6/site-packages/xarray/backends/netCDF4_.py", line 373, in ds return self._acquire() File "/usr/lib/python3.6/site-packages/xarray/backends/netCDF4_.py", line 367, in _acquire with self._manager.acquire_context(needs_lock) as root: File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/usr/lib/python3.6/site-packages/xarray/backends/file_manager.py", line 187, in acquire_context file, cached = self._acquire_with_cache_info(needs_lock) File "/usr/lib/python3.6/site-packages/xarray/backends/file_manager.py", line 205, in _acquire_with_cache_info file = self._opener(*self._args, **kwargs) File "netCDF4/_netCDF4.pyx", line 2357, in netCDF4._netCDF4.Dataset.__init__ File "netCDF4/_netCDF4.pyx", line 1925, in netCDF4._netCDF4._ensure_nc_success FileNotFoundError: [Errno 2] No such file or directory: b'/home/root/mlair/data/daily/DEBW001_o3_temp.nc' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/builds/esde/machine-learning/mlair/mlair/run_modules/pre_processing.py", line 322, in f_proc res = data_handler.build(station, name_affix=name_affix, store_processed_data=store, **kwargs) File "/builds/esde/machine-learning/mlair/mlair/data_handler/default_data_handler.py", line 67, in build sp = cls.data_handler(station, **sp_keys) File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 109, in __init__ self.setup_samples() File "/builds/esde/machine-learning/mlair/mlair/helpers/time_tracking.py", line 40, in __call__ return self.__wrapped__(*args, **kwargs) File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 244, in setup_samples self.make_input_target() File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 281, in make_input_target self.start, self.end) File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 333, in load_data store_data_locally=store_data_locally, data_origin=data_origin) File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 371, in download_data iter_dim=self.iter_dim) File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 358, in download_data_from_join network_name=network, sampling=sampling, data_origin=data_origin) File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") mlair.helpers.join.EmptyQueryResult: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. INFO root:pre_processing.py:270 run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. DEBUG root:datastore.py:118 set: stations(general.awesome)=['DEBW107', 'DEBY081', 'DEBW013', 'DEBW076', 'DEBW087'] DEBUG root:datastore.py:118 set: data_collection(general.awesome)=<mlair.data_handler.iterator.DataCollection object at 0x7fc810734828> DEBUG root:datastore.py:118 get: data_collection(general.awesome)=<mlair.data_handler.iterator.DataCollection object at 0x7fc810734828> DEBUG root:datastore.py:120 get: data_collection(general)=None DEBUG root:datastore.py:118 get: stations(general.awesome)=['DEBW107', 'DEBY081', 'DEBW013', 'DEBW076', 'DEBW087']
----------------------------Captured stderr teardown----------------------------
2021-07-27 10:51:42,535 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:42,535 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:42,535 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:42,535 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:42,535 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:42,535 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:42,535 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:42,535 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:42,535 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:42,535 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:48,322 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json [run_environment.py:__save_tracking:155] 2021-07-27 10:51:48,322 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json [run_environment.py:__save_tracking:155] 2021-07-27 10:51:48,322 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json [run_environment.py:__save_tracking:155] 2021-07-27 10:51:48,322 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json [run_environment.py:__save_tracking:155] 2021-07-27 10:51:48,322 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json [run_environment.py:__save_tracking:155] 2021-07-27 10:51:48,365 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:51:48,365 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:51:48,365 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:51:48,365 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:51:48,365 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143]
-----------------------------Captured log teardown------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:118 RunEnvironment finished after 0:00:01 (hh:mm:ss) DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging INFO root:run_environment.py:155 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging INFO root:run_environment.py:143 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_validate_station_serial[None] 8.34
------------------------------Captured stderr call------------------------------
2021-07-27 10:51:48,380 - INFO: check valid stations started (all) [pre_processing.py:validate_station:235] 2021-07-27 10:51:48,380 - INFO: check valid stations started (all) [pre_processing.py:validate_station:235] 2021-07-27 10:51:48,380 - INFO: check valid stations started (all) [pre_processing.py:validate_station:235] 2021-07-27 10:51:48,380 - INFO: check valid stations started (all) [pre_processing.py:validate_station:235] 2021-07-27 10:51:48,380 - INFO: check valid stations started (all) [pre_processing.py:validate_station:235] 2021-07-27 10:51:48,385 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:48,385 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:48,385 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:48,385 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:48,385 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:48,483 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:48,483 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:48,483 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:48,483 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:48,483 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:49,062 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:49,062 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:49,062 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:49,062 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:49,062 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:49,550 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:49,550 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:49,550 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:49,550 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:49,550 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:50,084 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:50,084 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:50,084 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:50,084 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:50,084 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:50,591 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:50,591 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:50,591 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:50,591 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:50,591 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:51,109 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:51,109 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:51,109 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:51,109 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:51,109 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:51,110 - INFO: remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") [pre_processing.py:f_proc:326] 2021-07-27 10:51:51,110 - INFO: remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") [pre_processing.py:f_proc:326] 2021-07-27 10:51:51,110 - INFO: remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") [pre_processing.py:f_proc:326] 2021-07-27 10:51:51,110 - INFO: remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") [pre_processing.py:f_proc:326] 2021-07-27 10:51:51,110 - INFO: remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") [pre_processing.py:f_proc:326] 2021-07-27 10:51:51,112 - INFO: run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:51:51,112 - INFO: run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:51:51,112 - INFO: run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:51:51,112 - INFO: run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:51:51,112 - INFO: run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270]
-------------------------------Captured log call--------------------------------
INFO root:pre_processing.py:235 check valid stations started (all) INFO root:pre_processing.py:263 use serial validate station approach INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:326 remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") INFO root:pre_processing.py:270 run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations.
----------------------------Captured stderr teardown----------------------------
2021-07-27 10:51:51,115 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:51,115 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:51,115 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:51,115 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:51,115 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:51,116 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:51,116 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:51,116 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:51,116 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:51,116 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:56,667 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json [run_environment.py:__save_tracking:155] 2021-07-27 10:51:56,667 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json [run_environment.py:__save_tracking:155] 2021-07-27 10:51:56,667 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json [run_environment.py:__save_tracking:155] 2021-07-27 10:51:56,667 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json [run_environment.py:__save_tracking:155] 2021-07-27 10:51:56,667 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json [run_environment.py:__save_tracking:155] 2021-07-27 10:51:56,713 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:51:56,713 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:51:56,713 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:51:56,713 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:51:56,713 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143]
-----------------------------Captured log teardown------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:118 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:155 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json INFO root:run_environment.py:143 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_validate_station_serial[tester] 9.35
------------------------------Captured stderr call------------------------------
2021-07-27 10:51:56,725 - INFO: check valid stations started (tester) [pre_processing.py:validate_station:235] 2021-07-27 10:51:56,725 - INFO: check valid stations started (tester) [pre_processing.py:validate_station:235] 2021-07-27 10:51:56,725 - INFO: check valid stations started (tester) [pre_processing.py:validate_station:235] 2021-07-27 10:51:56,725 - INFO: check valid stations started (tester) [pre_processing.py:validate_station:235] 2021-07-27 10:51:56,725 - INFO: check valid stations started (tester) [pre_processing.py:validate_station:235] 2021-07-27 10:51:56,731 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:56,731 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:56,731 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:56,731 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:56,731 - INFO: use serial validate station approach [pre_processing.py:validate_station:263] 2021-07-27 10:51:56,831 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:56,831 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:56,831 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:56,831 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:56,831 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:57,437 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:57,437 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:57,437 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:57,437 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:57,437 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:57,963 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:57,963 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:57,963 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:57,963 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:57,963 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:58,489 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:58,489 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:58,489 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:58,489 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:58,489 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:59,080 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:59,080 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:59,080 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:59,080 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:59,080 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:59,607 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:59,607 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:59,607 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:59,607 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:59,607 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:132] 2021-07-27 10:51:59,609 - INFO: remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") [pre_processing.py:f_proc:326] 2021-07-27 10:51:59,609 - INFO: remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") [pre_processing.py:f_proc:326] 2021-07-27 10:51:59,609 - INFO: remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") [pre_processing.py:f_proc:326] 2021-07-27 10:51:59,609 - INFO: remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") [pre_processing.py:f_proc:326] 2021-07-27 10:51:59,609 - INFO: remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") [pre_processing.py:f_proc:326] 2021-07-27 10:51:59,611 - INFO: run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:51:59,611 - INFO: run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:51:59,611 - INFO: run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:51:59,611 - INFO: run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:51:59,611 - INFO: run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270]
-------------------------------Captured log call--------------------------------
INFO root:pre_processing.py:235 check valid stations started (tester) INFO root:pre_processing.py:263 use serial validate station approach INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:132 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:326 remove station DEBW001 because it raised an error: No data found for variables {'o3', 'temp'} and options station=['DEBW001'], type=background, network=AIRBASE, origin={'temp': 'REA', 'o3': ''} in JOIN. -> network_name=network, sampling=sampling, data_origin=data_origin) | File "/builds/esde/machine-learning/mlair/mlair/helpers/join.py", line 58, in download_join | raise EmptyQueryResult(f"No data found for variables {missing_variables} and options {options} in JOIN.") INFO root:pre_processing.py:270 run for 0:00:03 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations.
----------------------------Captured stderr teardown----------------------------
2021-07-27 10:51:59,615 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:59,615 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:59,615 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:59,615 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:59,615 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:51:59,616 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:59,616 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:59,616 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:59,616 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:51:59,616 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:06,017 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:06,017 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:06,017 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:06,017 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:06,017 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:06,074 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:06,074 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:06,074 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:06,074 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:06,074 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143]
-----------------------------Captured log teardown------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:118 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:155 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json INFO root:run_environment.py:143 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_validate_station_parallel 6.39
------------------------------Captured stderr call------------------------------
2021-07-27 10:52:06,088 - INFO: check valid stations started (all) [pre_processing.py:validate_station:235] 2021-07-27 10:52:06,088 - INFO: check valid stations started (all) [pre_processing.py:validate_station:235] 2021-07-27 10:52:06,088 - INFO: check valid stations started (all) [pre_processing.py:validate_station:235] 2021-07-27 10:52:06,088 - INFO: check valid stations started (all) [pre_processing.py:validate_station:235] 2021-07-27 10:52:06,088 - INFO: check valid stations started (all) [pre_processing.py:validate_station:235] 2021-07-27 10:52:06,093 - INFO: use parallel validate station approach [pre_processing.py:validate_station:249] 2021-07-27 10:52:06,093 - INFO: use parallel validate station approach [pre_processing.py:validate_station:249] 2021-07-27 10:52:06,093 - INFO: use parallel validate station approach [pre_processing.py:validate_station:249] 2021-07-27 10:52:06,093 - INFO: use parallel validate station approach [pre_processing.py:validate_station:249] 2021-07-27 10:52:06,093 - INFO: use parallel validate station approach [pre_processing.py:validate_station:249] 2021-07-27 10:52:06,093 - INFO: running 3 processes in parallel [pre_processing.py:validate_station:251] 2021-07-27 10:52:06,093 - INFO: running 3 processes in parallel [pre_processing.py:validate_station:251] 2021-07-27 10:52:06,093 - INFO: running 3 processes in parallel [pre_processing.py:validate_station:251] 2021-07-27 10:52:06,093 - INFO: running 3 processes in parallel [pre_processing.py:validate_station:251] 2021-07-27 10:52:06,093 - INFO: running 3 processes in parallel [pre_processing.py:validate_station:251] 2021-07-27 10:52:06,502 - INFO: ...finished: DEBW107 (16%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,502 - INFO: ...finished: DEBW107 (16%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,502 - INFO: ...finished: DEBW107 (16%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,502 - INFO: ...finished: DEBW107 (16%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,502 - INFO: ...finished: DEBW107 (16%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,512 - INFO: ...finished: DEBY081 (33%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,512 - INFO: ...finished: DEBY081 (33%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,512 - INFO: ...finished: DEBY081 (33%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,512 - INFO: ...finished: DEBY081 (33%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,512 - INFO: ...finished: DEBY081 (33%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,524 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,524 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,524 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,524 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,524 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,732 - INFO: ...finished: DEBW076 (66%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,732 - INFO: ...finished: DEBW076 (66%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,732 - INFO: ...finished: DEBW076 (66%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,732 - INFO: ...finished: DEBW076 (66%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,732 - INFO: ...finished: DEBW076 (66%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,742 - INFO: ...finished: DEBW087 (83%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,742 - INFO: ...finished: DEBW087 (83%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,742 - INFO: ...finished: DEBW087 (83%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,742 - INFO: ...finished: DEBW087 (83%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,742 - INFO: ...finished: DEBW087 (83%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,743 - INFO: ...finished: DEBW001 (100%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,743 - INFO: ...finished: DEBW001 (100%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,743 - INFO: ...finished: DEBW001 (100%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,743 - INFO: ...finished: DEBW001 (100%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,743 - INFO: ...finished: DEBW001 (100%) [pre_processing.py:validate_station:257] 2021-07-27 10:52:06,743 - INFO: run for 0:00:01 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:52:06,743 - INFO: run for 0:00:01 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:52:06,743 - INFO: run for 0:00:01 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:52:06,743 - INFO: run for 0:00:01 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270] 2021-07-27 10:52:06,743 - INFO: run for 0:00:01 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations. [pre_processing.py:validate_station:270]
-------------------------------Captured log call--------------------------------
INFO root:pre_processing.py:235 check valid stations started (all) INFO root:pre_processing.py:249 use parallel validate station approach INFO root:pre_processing.py:251 running 3 processes in parallel INFO root:pre_processing.py:257 ...finished: DEBW107 (16%) INFO root:pre_processing.py:257 ...finished: DEBY081 (33%) INFO root:pre_processing.py:257 ...finished: DEBW013 (50%) INFO root:pre_processing.py:257 ...finished: DEBW076 (66%) INFO root:pre_processing.py:257 ...finished: DEBW087 (83%) INFO root:pre_processing.py:257 ...finished: DEBW001 (100%) INFO root:pre_processing.py:270 run for 0:00:01 (hh:mm:ss) to check 6 station(s). Found 5/6 valid stations.
----------------------------Captured stderr teardown----------------------------
2021-07-27 10:52:06,745 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:06,745 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:06,745 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:06,745 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:06,745 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:06,746 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:06,746 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:06,746 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:06,746 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:06,746 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:12,405 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:12,405 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:12,405 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:12,405 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:12,405 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:12,472 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:12,472 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:12,472 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:12,472 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:12,472 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:143]
-----------------------------Captured log teardown------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:118 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:155 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json INFO root:run_environment.py:143 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_split_set_indices 6.40
No log output captured.
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_transformation 0.01
------------------------------Captured stderr call------------------------------
Exception ignored in: <bound method RunEnvironment.__del__ of <mlair.run_modules.pre_processing.PreProcessing object at 0x7fc7bc781978>> Traceback (most recent call last): File "/builds/esde/machine-learning/mlair/mlair/run_modules/run_environment.py", line 117, in __del__ self.time.stop() AttributeError: 'PreProcessing' object has no attribute 'time'
Passed test/test_run_modules/test_run_environment.py::TestRunEnvironment::test_enter 5.89
------------------------------Captured stderr call------------------------------
2021-07-27 10:52:18,897 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:18,897 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:18,897 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:18,897 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:18,897 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:18,897 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:18,897 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:18,897 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:18,897 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:18,897 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:24,735 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:24,735 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:24,735 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:24,735 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:24,735 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:24,794 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:24,794 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:24,794 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:24,794 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:24,794 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:118 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:155 Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json INFO root:run_environment.py:143 Move log file to /builds/esde/machine-learning/mlair/logging_000.log
Passed test/test_run_modules/test_run_environment.py::TestRunEnvironment::test_exit 6.19
------------------------------Captured stderr call------------------------------
2021-07-27 10:52:24,799 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:24,799 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:24,799 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:24,799 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:24,799 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:24,899 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:24,899 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:24,899 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:24,899 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:24,899 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:30,921 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:30,921 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:30,921 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:30,921 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:30,921 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:30,987 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:30,987 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:30,987 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:30,987 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:30,987 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:118 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:155 Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json INFO root:run_environment.py:143 Move log file to /builds/esde/machine-learning/mlair/logging_000.log
Passed test/test_run_modules/test_run_environment.py::TestRunEnvironment::test_init 6.11
------------------------------Captured stderr call------------------------------
2021-07-27 10:52:30,992 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:30,992 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:30,992 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:30,992 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:30,992 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:30,992 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:30,992 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:30,992 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:30,992 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:30,992 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:37,063 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:37,063 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:37,063 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:37,063 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:37,063 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:37,106 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:37,106 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:37,106 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:37,106 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:37,106 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:118 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:155 Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json INFO root:run_environment.py:143 Move log file to /builds/esde/machine-learning/mlair/logging_000.log
Passed test/test_run_modules/test_run_environment.py::TestRunEnvironment::test_del 6.68
------------------------------Captured stderr call------------------------------
2021-07-27 10:52:37,109 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:37,109 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:37,109 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:37,109 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:37,109 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2021-07-27 10:52:37,310 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:37,310 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:37,310 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:37,310 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:37,310 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:52:43,744 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:43,744 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:43,744 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:43,744 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:43,744 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json [run_environment.py:__save_tracking:155] 2021-07-27 10:52:43,793 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:43,793 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:43,793 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:43,793 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:52:43,793 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:118 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:155 Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json INFO root:run_environment.py:143 Move log file to /builds/esde/machine-learning/mlair/logging_000.log
Passed test/test_run_modules/test_training.py::TestTraining::test_init 14.68
------------------------------Captured stdout call------------------------------
Epoch 1/2 - 3s - loss: 24.4944 - val_loss: 28.1781 Epoch 2/2 - 0s - loss: 18.7645 - val_loss: 38.7293
Passed test/test_run_modules/test_training.py::TestTraining::test_no_training 13.33
------------------------------Captured stderr call------------------------------
2021-07-27 10:53:10,150 - INFO: Training started [run_environment.py:__init__:103] 2021-07-27 10:53:10,150 - INFO: Training started [run_environment.py:__init__:103] 2021-07-27 10:53:10,150 - INFO: Training started [run_environment.py:__init__:103] 2021-07-27 10:53:10,150 - INFO: Training started [run_environment.py:__init__:103] 2021-07-27 10:53:10,150 - INFO: Training started [run_environment.py:__init__:103] 2021-07-27 10:53:11,816 - INFO: No training has started, because train_model parameter was false. [training.py:_run:91] 2021-07-27 10:53:11,816 - INFO: No training has started, because train_model parameter was false. [training.py:_run:91] 2021-07-27 10:53:11,816 - INFO: No training has started, because train_model parameter was false. [training.py:_run:91] 2021-07-27 10:53:11,816 - INFO: No training has started, because train_model parameter was false. [training.py:_run:91] 2021-07-27 10:53:11,816 - INFO: No training has started, because train_model parameter was false. [training.py:_run:91] 2021-07-27 10:53:11,817 - INFO: Training finished after 0:00:02 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:53:11,817 - INFO: Training finished after 0:00:02 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:53:11,817 - INFO: Training finished after 0:00:02 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:53:11,817 - INFO: Training finished after 0:00:02 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:53:11,817 - INFO: Training finished after 0:00:02 (hh:mm:ss) [run_environment.py:__del__:118]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 Training started INFO root:training.py:91 No training has started, because train_model parameter was false. INFO root:run_environment.py:118 Training finished after 0:00:02 (hh:mm:ss)
Passed test/test_run_modules/test_training.py::TestTraining::test_run 19.99
------------------------------Captured stdout call------------------------------
Epoch 1/2 - 2s - loss: 36.7985 - val_loss: 33.6051 Epoch 2/2 - 0s - loss: 32.8384 - val_loss: 33.6290
Passed test/test_run_modules/test_training.py::TestTraining::test_make_predict_function 6.27
No log output captured.
Passed test/test_run_modules/test_training.py::TestTraining::test_set_gen 6.62
No log output captured.
Passed test/test_run_modules/test_training.py::TestTraining::test_set_generators 6.16
No log output captured.
Passed test/test_run_modules/test_training.py::TestTraining::test_train 20.35
------------------------------Captured stdout call------------------------------
Epoch 1/2 - 3s - loss: 29.9472 - val_loss: 10.0217 Epoch 2/2 - 0s - loss: 20.7795 - val_loss: 23.0789
Passed test/test_run_modules/test_training.py::TestTraining::test_save_model 10.00
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 get: model_name(general.model)=/builds/esde/machine-learning/mlair/test/test_run_modules/TestExperiment/model/test_model.h5 DEBUG root:training.py:180 save best model to /builds/esde/machine-learning/mlair/test/test_run_modules/TestExperiment/model/test_model.h5 DEBUG root:datastore.py:118 set: best_model(general)=<keras.engine.training.Model object at 0x7fc7bc1f04e0>
Passed test/test_run_modules/test_training.py::TestTraining::test_load_best_model_no_weights 6.27
------------------------------Captured stderr call------------------------------
2021-07-27 10:54:27,830 - INFO: no weights to reload... [training.py:load_best_model:195] 2021-07-27 10:54:27,830 - INFO: no weights to reload... [training.py:load_best_model:195] 2021-07-27 10:54:27,830 - INFO: no weights to reload... [training.py:load_best_model:195] 2021-07-27 10:54:27,830 - INFO: no weights to reload... [training.py:load_best_model:195] 2021-07-27 10:54:27,830 - INFO: no weights to reload... [training.py:load_best_model:195]
-------------------------------Captured log call--------------------------------
DEBUG root:training.py:190 load best model: notExisting INFO root:training.py:195 no weights to reload...
Passed test/test_run_modules/test_training.py::TestTraining::test_save_callbacks_history_created 6.90
No log output captured.
Passed test/test_run_modules/test_training.py::TestTraining::test_save_callbacks_lr_created 6.19
No log output captured.
Passed test/test_run_modules/test_training.py::TestTraining::test_save_callbacks_inspect_history 6.35
No log output captured.
Passed test/test_run_modules/test_training.py::TestTraining::test_save_callbacks_inspect_lr 6.24
No log output captured.
Passed test/test_run_modules/test_training.py::TestTraining::test_create_monitoring_plots 7.61
No log output captured.
Passed test/test_workflows/test_abstract_workflow.py::TestWorkflow::test_init 0.00
No log output captured.
Passed test/test_workflows/test_abstract_workflow.py::TestWorkflow::test_add 0.00
No log output captured.
Passed test/test_workflows/test_abstract_workflow.py::TestWorkflow::test_run 6.28
------------------------------Captured stderr call------------------------------
2021-07-27 10:55:07,150 - INFO: Workflow started [run_environment.py:__init__:103] 2021-07-27 10:55:07,150 - INFO: Workflow started [run_environment.py:__init__:103] 2021-07-27 10:55:07,150 - INFO: Workflow started [run_environment.py:__init__:103] 2021-07-27 10:55:07,150 - INFO: Workflow started [run_environment.py:__init__:103] 2021-07-27 10:55:07,150 - INFO: Workflow started [run_environment.py:__init__:103] 2021-07-27 10:55:07,150 - INFO: 6 [test_abstract_workflow.py:__init__:37] 2021-07-27 10:55:07,150 - INFO: 6 [test_abstract_workflow.py:__init__:37] 2021-07-27 10:55:07,150 - INFO: 6 [test_abstract_workflow.py:__init__:37] 2021-07-27 10:55:07,150 - INFO: 6 [test_abstract_workflow.py:__init__:37] 2021-07-27 10:55:07,150 - INFO: 6 [test_abstract_workflow.py:__init__:37] 2021-07-27 10:55:07,150 - INFO: 2 [test_abstract_workflow.py:__init__:42] 2021-07-27 10:55:07,150 - INFO: 2 [test_abstract_workflow.py:__init__:42] 2021-07-27 10:55:07,150 - INFO: 2 [test_abstract_workflow.py:__init__:42] 2021-07-27 10:55:07,150 - INFO: 2 [test_abstract_workflow.py:__init__:42] 2021-07-27 10:55:07,150 - INFO: 2 [test_abstract_workflow.py:__init__:42] 2021-07-27 10:55:07,151 - INFO: 3 [test_abstract_workflow.py:__init__:37] 2021-07-27 10:55:07,151 - INFO: 3 [test_abstract_workflow.py:__init__:37] 2021-07-27 10:55:07,151 - INFO: 3 [test_abstract_workflow.py:__init__:37] 2021-07-27 10:55:07,151 - INFO: 3 [test_abstract_workflow.py:__init__:37] 2021-07-27 10:55:07,151 - INFO: 3 [test_abstract_workflow.py:__init__:37] 2021-07-27 10:55:07,151 - INFO: Workflow finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:55:07,151 - INFO: Workflow finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:55:07,151 - INFO: Workflow finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:55:07,151 - INFO: Workflow finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:55:07,151 - INFO: Workflow finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:118] 2021-07-27 10:55:13,383 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:155] 2021-07-27 10:55:13,383 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:155] 2021-07-27 10:55:13,383 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:155] 2021-07-27 10:55:13,383 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:155] 2021-07-27 10:55:13,383 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:155] 2021-07-27 10:55:13,437 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:55:13,437 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:55:13,437 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:55:13,437 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143] 2021-07-27 10:55:13,437 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:143]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 Workflow started INFO root:test_abstract_workflow.py:37 6 INFO root:test_abstract_workflow.py:42 2 INFO root:test_abstract_workflow.py:37 3 INFO root:run_environment.py:118 Workflow finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:155 Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json INFO root:run_environment.py:143 Move log file to /builds/esde/machine-learning/mlair/logging_000.log
Passed test/test_workflows/test_default_workflow.py::TestDefaultWorkflow::test_init_no_args 0.00
No log output captured.
Passed test/test_workflows/test_default_workflow.py::TestDefaultWorkflow::test_init_with_args 0.00
No log output captured.
Passed test/test_workflows/test_default_workflow.py::TestDefaultWorkflow::test_init_with_kwargs 0.00
No log output captured.
Passed test/test_workflows/test_default_workflow.py::TestDefaultWorkflow::test_setup 0.00
No log output captured.
Passed test/test_workflows/test_default_workflow.py::TestDefaultWorkflowHPC::test_setup 0.01
No log output captured.