report.html

Report generated on 30-Jun-2023 at 10:39:46 by pytest-html v3.1.1

Environment

CI true
CI_COMMIT_REF_NAME develop
CI_COMMIT_REF_SLUG develop
CI_COMMIT_SHA 08d740954f4d329cca002a82ef1b77761383f373
CI_JOB_ID 854047
CI_JOB_NAME tests
CI_JOB_STAGE test
CI_PIPELINE_ID 144647
CI_PROJECT_DIR /builds/esde/machine-learning/mlair
CI_PROJECT_ID 2411
CI_PROJECT_NAME mlair
CI_PROJECT_NAMESPACE esde/machine-learning
CI_PROJECT_PATH esde/machine-learning/mlair
CI_PROJECT_URL https://gitlab.jsc.fz-juelich.de/esde/machine-learning/mlair
CI_REGISTRY registry.jsc.fz-juelich.de
CI_REGISTRY_IMAGE registry.jsc.fz-juelich.de/esde/machine-learning/mlair
CI_REGISTRY_USER gitlab-ci-token
CI_RUNNER_DESCRIPTION gitlab-runner on zam347 with already installed requirements of MLAir using opensuse/leap
CI_RUNNER_ID 657
CI_RUNNER_TAGS ["leap", "opensuse", "zam347", "mlair", "machinelearningtools"]
CI_SERVER yes
CI_SERVER_NAME GitLab
CI_SERVER_REVISION 9ce736bb2cd
CI_SERVER_VERSION 16.1.1
GITLAB_CI true
GITLAB_USER_EMAIL l.leufen@fz-juelich.de
GITLAB_USER_ID 659
Packages {"pluggy": "0.13.1", "py": "1.11.0", "pytest": "6.2.2"}
Platform Linux-5.15.0-73-generic-x86_64-with-glibc2.31
Plugins {"cov": "2.11.1", "html": "3.1.1", "lazy-fixture": "0.6.3", "metadata": "2.0.1"}
Python 3.9.13

Summary

578 tests ran in 630.44 seconds.

578 passed, 0 skipped, 0 failed, 0 errors, 0 expected failures, 0 unexpected passes

Results

Result Test Duration Links
Passed test/test_configuration/test_defaults.py::TestGetDefaults::test_get_defaults 0.00
No log output captured.
Passed test/test_configuration/test_defaults.py::TestAllDefaults::test_training_parameters 0.00
No log output captured.
Passed test/test_configuration/test_defaults.py::TestAllDefaults::test_data_handler_parameters 0.00
No log output captured.
Passed test/test_configuration/test_defaults.py::TestAllDefaults::test_subset_parameters 0.00
No log output captured.
Passed test/test_configuration/test_defaults.py::TestAllDefaults::test_hpc_parameters 0.00
No log output captured.
Passed test/test_configuration/test_defaults.py::TestAllDefaults::test_postprocessing_parameters 0.00
No log output captured.
Passed test/test_configuration/test_join_settings.py::TestJoinSettings::test_no_args 0.00
No log output captured.
Passed test/test_configuration/test_join_settings.py::TestJoinSettings::test_daily 0.00
No log output captured.
Passed test/test_configuration/test_join_settings.py::TestJoinSettings::test_hourly 0.00
No log output captured.
Passed test/test_configuration/test_join_settings.py::TestJoinSettings::test_unknown_sampling 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestPrepareHost::test_prepare_host 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestPrepareHost::test_prepare_host_unknown 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestPrepareHost::test_prepare_host_given_path 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestPrepareHost::test_error_handling 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestPrepareHost::test_os_path_exists 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetExperimentName::test_set_experiment_name 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetExperimentName::test_set_experiment_name_sampling 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetExperimentName::test_set_experiment_name_tuple_sampling 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetExperimentName::test_set_experiment_path 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetExperimentName::test_set_experiment_path_given_path 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetBootstrapPath::test_bootstrap_path_is_none 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetBootstrapPath::test_bootstap_path_is_given 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestCheckPath::test_check_path_and_create 0.00
-------------------------------Captured log call--------------------------------
DEBUG root:path_config.py:125 Created path: data/test DEBUG root:path_config.py:132 Path already exists: data/test
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_required_attributes 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_init 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_build 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_own_args 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_skip_args 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_transformation 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_get_X 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_get_Y 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_get_data 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_get_coordinates 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSampling::test_data_handler 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSampling::test_data_handler_transformation 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSampling::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_init 0.18
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_update_kwargs_single_to_tuple 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_update_kwargs_tuple 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_update_kwargs_default 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_update_kwargs_assert_failure 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_setup_samples 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_load_and_interpolate 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_set_inputs_and_targets 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_setup_data_path 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingWithFilterSingleStation::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingWithFirFilter::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingWithFirFilterSingleStation::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingWithClimateFirFilter::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingWithClimateFirFilterSingleStation::test_requirements 0.01
No log output captured.
Passed test/test_data_handler/test_data_handler_with_filter.py::TestDataHandlerFilter::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_with_filter.py::TestDataHandlerFilterSingleStation::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_with_filter.py::TestDataHandlerFirFilter::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_with_filter.py::TestDataHandlerFirFilterSingleStation::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_with_filter.py::TestDataHandlerClimateFirFilter::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_with_filter.py::TestDataHandlerClimateFirFilterSingleStation::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_default_data_handler.py::TestDefaultDataHandler::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_default_data_handler_single_station.py::TestDataHandlerSingleStation::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestStandardIterator::test_blank 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestStandardIterator::test_init 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestStandardIterator::test_next 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_init 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_iter 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_add 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_name 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_set_mapping 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_getitem 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_keys 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_init 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_cleanup_path 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_len 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_concatenate 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_prepare_batches 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_prepare_batches_upsampling 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_prepare_batches_no_remaining 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_data_generation 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_getitem 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_on_epoch_end 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_get_model_rank_no_model 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_get_model_rank_single_output_branch 0.06
------------------------------Captured stdout call------------------------------
Model: "model" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_1 (InputLayer) [(None, 14, 1, 2)] 0 _________________________________________________________________ flatten (Flatten) (None, 28) 0 _________________________________________________________________ dense (Dense) (None, 64) 1856 _________________________________________________________________ prelu_1 (PReLU) (None, 64) 64 _________________________________________________________________ dense_1 (Dense) (None, 32) 2080 _________________________________________________________________ prelu_2 (PReLU) (None, 32) 32 _________________________________________________________________ dense_2 (Dense) (None, 16) 528 _________________________________________________________________ prelu_3 (PReLU) (None, 16) 16 _________________________________________________________________ dense_3 (Dense) (None, 3) 51 _________________________________________________________________ linear_output (Activation) (None, 3) 0 ================================================================= Total params: 4,627 Trainable params: 4,627 Non-trainable params: 0 _________________________________________________________________ None
------------------------------Captured stderr call------------------------------
2023-06-30 10:29:23.691074: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcuda.so.1'; dlerror: libcuda.so.1: cannot open shared object file: No such file or directory 2023-06-30 10:29:23.691127: W tensorflow/stream_executor/cuda/cuda_driver.cc:269] failed call to cuInit: UNKNOWN ERROR (303) 2023-06-30 10:29:23.691164: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:156] kernel driver does not appear to be running on this host (runner-r3wxqhgr-project-2411-concurrent-0): /proc/driver/nvidia/version does not exist 2023-06-30 10:29:23.691423: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_get_model_rank_multiple_output_branch 0.08
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_get_model_rank_error 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestGetNumberOfMiniBatches::test_get_number_of_mini_batches 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestGetBatch::test_get_batch 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestSaveToPickle::test_save_to_pickle 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestPermuteData::test_permute_data 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestFProc::test_f_proc 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestFProc::test_f_proc_no_remaining 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestFProc::test_f_proc_X_Y 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestAbstractDataStore::test_init 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestAbstractDataStore::test_clear_data_store 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_put 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_get 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_get_with_sub_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_get_with_not_existing_sub_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_raise_not_in_data_store 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_get_default 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_raise_not_in_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_list_all_scopes 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search_empty_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_list_all_names 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search_scope_and_all_superiors 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search_scope_return_all 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search_scope_and_all_superiors_return_all 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_create_args_dict_default_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_create_args_dict_given_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_create_args_dict_missing_entry 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_set_args_from_dict 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_no_scope_given 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_put_with_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_get 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_get_with_sub_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_get_with_not_existing_sub_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_raise_not_in_data_store 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_get_default 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_raise_not_in_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_list_all_scopes 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search_empty_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_list_all_names 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search_scope_and_all_superiors 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search_scope_return_all 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search_scope_and_all_superiors_return_all 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_create_args_dict_default_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_create_args_dict_given_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_create_args_dict_missing_entry 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_set_args_from_dict 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_no_scope_given 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestCorrectScope::test_init 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestTracking::test_init 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestTracking::test_track_first_entry 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestTracking::test_track_second_entry 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestTracking::test_decrypt_args 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_combine_observation_and_apriori_no_new_dim 0.03
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_combine_observation_and_apriori_with_new_dim 0.02
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_shift_data 0.01
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_index_array 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_tmp_dimension 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_tmp_dimension_iter_limit 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_next_order 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_next_order_with_kzf 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_calculate_filter_coefficients 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_monthly_mean 0.06
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_monthly_mean_sampling 0.10
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_monthly_mean_sel_opts 0.03
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_compute_hourly_mean_per_month 0.14
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_compute_hourly_mean_per_month_no_anomaly 0.13
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_seasonal_cycle_of_hourly_mean 0.23
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_seasonal_hourly_mean 1.05
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_seasonal_hourly_mean_sel_opts 0.51
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_unity_array 0.02
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_extend_apriori_at_end 0.02
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_extend_apriori_at_start 0.02
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_get_year_interval 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_time_range_extend 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_properties 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_trim_data_to_minimum_length 0.03
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_full_filter_result_array 0.01
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_clim_filter 11.57
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_clim_filter_kwargs 30.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestFirFilterConvolve::test_fir_filter_convolve 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestFirwinKzf::test_firwin_kzf 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestFilterWidthKzf::test_filter_width_kzf 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestOmegaNullKzf::test_omega_null_kzf 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestOmegaNullKzf::test_omega_null_kzf_alpha 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestDeg2RadAllPoints::test_deg2rad_all_points_scalar_inputs[value0] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestDeg2RadAllPoints::test_deg2rad_all_points_scalar_inputs[value1] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestDeg2RadAllPoints::test_deg2rad_all_points_scalar_inputs[custom_np_arrays] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestDeg2RadAllPoints::test_deg2rad_all_points_xr_arr_inputs 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[90.0-0.0--90.0-0.0-True-3.141592653589793] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[1.5707963267948966-0.0--1.5707963267948966-0.0-False-3.141592653589793] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[0.0-0.0-0.0-180.0-True-3.141592653589793] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[0.0-0.0-0.0-3.141592653589793-False-3.141592653589793] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[0.0-0.0--45.0-0-True-0.7853981633974483] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[0.0-0.0--0.7853981633974483-0-False-0.7853981633974483] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_fields_and_scalars[lat10-lon10--90.0-0.0-True-expected_dist0] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_fields_and_scalars[lat11-lon11-lat21-lon21-True-expected_dist1] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_missmatch_dimensions[lat10-0.0-0.0-0.0-True] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_missmatch_dimensions[0.0-lon11-0.0-0.0-True] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_missmatch_dimensions[0.0-0.0-lat22-0.0-True] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_missmatch_dimensions[0.0-0.0-0.0-lon23-True] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestToList::test_to_list 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_init 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test__start 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test__end 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test__duration 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_repr 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_run 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_stop 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_duration 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_enter_exit 0.00
-------------------------------Captured log call--------------------------------
INFO root:time_tracking.py:137 undefined job finished after 0:00:01 (hh:mm:ss)
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_name_enter_exit 0.00
-------------------------------Captured log call--------------------------------
INFO root:time_tracking.py:137 my job finished after 0:00:01 (hh:mm:ss)
Passed test/test_helpers/test_helpers.py::TestPytestRegex::test_pytest_regex_init 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestPytestRegex::test_pytest_regex_eq 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestPytestRegex::test_pytest_regex_repr 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestDictToXarray::test_dict_to_xarray 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestDictToXarray::test_dict_to_xarray_single_entry 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestFloatRound::test_float_round_ceil 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestFloatRound::test_float_round_decimals 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestFloatRound::test_float_round_type 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestFloatRound::test_float_round_negative 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_big_numbers 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_float_numbers 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_small_numbers 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_zero 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_negative_numbers 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_wrong_significance 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_floor 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_floor_neg_numbers 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_ceil 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_ceil_neg_numbers 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_ceil_floor 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestGetOrder::test_get_order 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestGetOrder::test_get_order_neg_orders 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestGetOrder::test_get_order_neg_numbers 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSelectFromDict::test_select 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSelectFromDict::test_select_no_dict_given 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSelectFromDict::test_select_remove_none 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSelectFromDict::test_select_condition 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_dict_remove_single 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_dict_remove_multiple 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_list_remove_single 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_list_remove_multiple 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_remove_missing_argument 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_remove_not_supported_type 0.02
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_init_default 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_setup_logging_path_none 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_setup_logging_path_given 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_logger_console_level0 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_logger_console_level1 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_logger_console_level_wrong_type 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestExtractValue::test_extract 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestExtractValue::test_extract_multiple_elements 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestIsXarray::test_is_xarray_xr_input 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestIsXarray::test_is_xarray_other_input 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_xrdata_in 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_npdata_in_nokwargs 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_npdata_in_nokwargs_default_true 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_npdata_in_kwargs[False] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_npdata_in_kwargs[True] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_int_float_in_nokwargs_default_true[1] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_int_float_in_nokwargs_default_true[2.0] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_wrong_type_in_default_true_nokwargs[wrong_input0] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_wrong_type_in_default_true_nokwargs[wrong_input1] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_wrong_type_in_default_true_nokwargs[abc] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_dask_in_default_true_nokwargs 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSortLike::test_sort_like 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSortLike::test_sort_like_not_unique 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSortLike::test_sort_like_missing_element 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestFilterDictByValue::test_filter_dict_by_value 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestFilterDictByValue::test_filter_dict_by_value_not_avail 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_apply_standardise_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_apply_standardise_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise_apply[pandas-pd_mean-pd_std-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise_apply[xarray-xr_mean-xr_std-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_apply_centre_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_apply_centre_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre_apply[pandas-pd_mean-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre_apply[xarray-xr_mean-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_apply_min_max_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_apply_min_max_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max_apply[pandas-pd_min-pd_max-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max_apply[xarray-xr_min-xr_max-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise[pandas_gamma-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise[xarray_gamma-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise_inverse[pandas_gamma-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise_inverse[xarray_gamma-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_apply_standardise_inverse[pandas_gamma-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_apply_standardise_inverse[xarray_gamma-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise_apply[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise_apply[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCreateBootstrapRealizations::test_create_single_bootstrap_realization 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCreateBootstrapRealizations::test_calculate_average 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCreateBootstrapRealizations::test_create_n_bootstrap_realizations 1.48
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMeanSquaredError::test_mean_squared_error 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMeanSquaredError::test_mean_squared_error_xarray 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMeanAbsoluteError::test_mean_absolute_error 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMeanAbsoluteError::test_mean_absolute_error_xarray 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestIndexOfAgreement::test_index_of_agreement 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestIndexOfAgreement::test_index_of_agreement_xarray 0.01
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMNMB::test_modified_normalized_mean_bias 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMNMB::test_modified_normalized_mean_bias_xarray 0.01
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCalculateErrorMetrics::test_calculate_error_metrics 0.24
No log output captured.
Passed test/test_helpers/test_tables.py::TestTables::test_create_column_format_for_tex 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestRegex::test_init 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestRegex::test_eq 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestRegex::test_repr 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestAllEqual::test_numpy 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestAllEqual::test_xarray 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestAllEqual::test_other 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestAllEqual::test_encapsulated 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestNestedEquality::test_nested_equality_single_entries 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestNestedEquality::test_nested_equality_xarray 0.02
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestNestedEquality::test_nested_equality_numpy 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestNestedEquality::test_nested_equality_list_tuple 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestNestedEquality::test_nested_equality_dict 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestDownloadJoin::test_download_single_var 3.82
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestDownloadJoin::test_download_empty 0.32
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestDownloadJoin::test_download_incomplete 1.23
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestCorrectDataFormat::test_correct_data_format 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestLoadSeriesInformation::test_standard_query 0.32
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestLoadSeriesInformation::test_empty_result 0.18
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctDataOrigin::test_no_origin_given 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctDataOrigin::test_different_origins 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctNetwork::test_no_network_given 0.00
------------------------------Captured stderr call------------------------------
2023-06-30 10:30:16,169 - INFO: Could not find a valid match for variable no2 and networks []! Therefore, use first answer from JOIN: {'id': 16686, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'no2', 'parameter_label': 'NO2', 'parameter_attribute': ''} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,169 - INFO: Could not find a valid match for variable no2 and networks []! Therefore, use first answer from JOIN: {'id': 16686, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'no2', 'parameter_label': 'NO2', 'parameter_attribute': ''} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,169 - INFO: Could not find a valid match for variable no2 and networks []! Therefore, use first answer from JOIN: {'id': 16686, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'no2', 'parameter_label': 'NO2', 'parameter_attribute': ''} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,169 - INFO: Could not find a valid match for variable no2 and networks []! Therefore, use first answer from JOIN: {'id': 16686, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'no2', 'parameter_label': 'NO2', 'parameter_attribute': ''} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,169 - INFO: Could not find a valid match for variable o3 and networks []! Therefore, use first answer from JOIN: {'id': 16687, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'o3', 'parameter_label': 'O3', 'parameter_attribute': ''} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,169 - INFO: Could not find a valid match for variable o3 and networks []! Therefore, use first answer from JOIN: {'id': 16687, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'o3', 'parameter_label': 'O3', 'parameter_attribute': ''} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,169 - INFO: Could not find a valid match for variable o3 and networks []! Therefore, use first answer from JOIN: {'id': 16687, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'o3', 'parameter_label': 'O3', 'parameter_attribute': ''} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,169 - INFO: Could not find a valid match for variable o3 and networks []! Therefore, use first answer from JOIN: {'id': 16687, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'o3', 'parameter_label': 'O3', 'parameter_attribute': ''} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,170 - INFO: Could not find a valid match for variable cloudcover and networks []! Therefore, use first answer from JOIN: {'id': 54036, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'cloudcover', 'parameter_label': 'CLOUDCOVER', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,170 - INFO: Could not find a valid match for variable cloudcover and networks []! Therefore, use first answer from JOIN: {'id': 54036, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'cloudcover', 'parameter_label': 'CLOUDCOVER', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,170 - INFO: Could not find a valid match for variable cloudcover and networks []! Therefore, use first answer from JOIN: {'id': 54036, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'cloudcover', 'parameter_label': 'CLOUDCOVER', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,170 - INFO: Could not find a valid match for variable cloudcover and networks []! Therefore, use first answer from JOIN: {'id': 54036, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'cloudcover', 'parameter_label': 'CLOUDCOVER', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,170 - INFO: Could not find a valid match for variable temp and networks []! Therefore, use first answer from JOIN: {'id': 88491, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'temp', 'parameter_label': 'TEMP-REA-MIUB', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,170 - INFO: Could not find a valid match for variable temp and networks []! Therefore, use first answer from JOIN: {'id': 88491, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'temp', 'parameter_label': 'TEMP-REA-MIUB', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,170 - INFO: Could not find a valid match for variable temp and networks []! Therefore, use first answer from JOIN: {'id': 88491, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'temp', 'parameter_label': 'TEMP-REA-MIUB', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,170 - INFO: Could not find a valid match for variable temp and networks []! Therefore, use first answer from JOIN: {'id': 88491, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'temp', 'parameter_label': 'TEMP-REA-MIUB', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,171 - INFO: Could not find a valid match for variable press and networks []! Therefore, use first answer from JOIN: {'id': 102660, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'press', 'parameter_label': 'PRESS-REA-MIUB', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,171 - INFO: Could not find a valid match for variable press and networks []! Therefore, use first answer from JOIN: {'id': 102660, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'press', 'parameter_label': 'PRESS-REA-MIUB', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,171 - INFO: Could not find a valid match for variable press and networks []! Therefore, use first answer from JOIN: {'id': 102660, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'press', 'parameter_label': 'PRESS-REA-MIUB', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 10:30:16,171 - INFO: Could not find a valid match for variable press and networks []! Therefore, use first answer from JOIN: {'id': 102660, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'press', 'parameter_label': 'PRESS-REA-MIUB', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288]
-------------------------------Captured log call--------------------------------
INFO root:join.py:288 Could not find a valid match for variable no2 and networks []! Therefore, use first answer from JOIN: {'id': 16686, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'no2', 'parameter_label': 'NO2', 'parameter_attribute': ''} INFO root:join.py:288 Could not find a valid match for variable o3 and networks []! Therefore, use first answer from JOIN: {'id': 16687, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'o3', 'parameter_label': 'O3', 'parameter_attribute': ''} INFO root:join.py:288 Could not find a valid match for variable cloudcover and networks []! Therefore, use first answer from JOIN: {'id': 54036, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'cloudcover', 'parameter_label': 'CLOUDCOVER', 'parameter_attribute': 'REA'} INFO root:join.py:288 Could not find a valid match for variable temp and networks []! Therefore, use first answer from JOIN: {'id': 88491, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'temp', 'parameter_label': 'TEMP-REA-MIUB', 'parameter_attribute': 'REA'} INFO root:join.py:288 Could not find a valid match for variable press and networks []! Therefore, use first answer from JOIN: {'id': 102660, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'press', 'parameter_label': 'PRESS-REA-MIUB', 'parameter_attribute': 'REA'}
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctNetwork::test_single_network_given 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctNetwork::test_single_network_given_no_match 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctNetwork::test_multiple_networks_given 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctNetwork::test_multiple_networks_given_by_dict 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctSeries::test_no_origin_given 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctSeries::test_different_origins 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctSeries::test_different_networks 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctSeries::test_network_not_available 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctSeries::test_different_network_and_origin 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSaveToPandas::test_empty_df 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSaveToPandas::test_not_empty_df 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSaveToPandas::test_alternative_date_format 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestLowerList::test_string_lowering 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestGetData::test 0.47
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestCreateUrl::test_minimal_args_given 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestCreateUrl::test_given_kwargs 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestCreateUrl::test_single_kwargs 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestCreateUrl::test_none_kwargs 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestCreateUrl::test_param_id 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestCreateUrl::test_param_id_kwargs 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestCorrectStatName::test_nothing_to_do 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestCorrectStatName::test_correct_string 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_model_property 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_all_empty 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_attr 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_mix_attr_dict_no_duplicates 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_mix_attr_dict_valid_duplicates_none_optimizer 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_property_type_error 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_mix_attr_dict_invalid_duplicates_other_optimizer 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_mix_attr_dict_invalid_duplicates_same_optimizer_other_args 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_dict_invalid_keys 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_getattr 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_get_settings 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_custom_objects 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_set_custom_objects 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_get_padding_for_same_negative_kernel_size 0.00
------------------------------Captured stdout call------------------------------
In test_get_padding_for_same_negative_kernel_size
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_get_padding_for_same_strides_greater_one 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_get_padding_for_same_non_int_kernel 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_get_padding_for_same_stride_3d 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_get_padding_for_same_even_pad 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_negative_pads 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_len_of_pad_tuple 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_tuple_of_none_integer 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_tuple_of_tuple_none_integer_first 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_tuple_of_tuple_none_integer_second 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_valid_mix_of_int_and_tuple 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_invalid_mixed_tuple_and_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_invalid_mixed_int_and_tuple 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_valid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_negative_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_invalid_format_float 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_invalid_format_string 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_tuple_of_valid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_tuple_of_invalid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_tuple_of_invalid_format 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_call 0.37
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_valid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_negative_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_invalid_format_float 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_invalid_format_string 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_tuple_of_valid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_tuple_of_invalid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_tuple_of_invalid_format 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_call 0.05
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_check_and_get_padding_zero_padding 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_check_and_get_padding_sym_padding 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_check_and_get_padding_ref_padding 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_check_and_get_padding_raises 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[SymPad2D] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[SymmetricPadding2D0] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[SymmetricPadding2D1] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[RefPad2D] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[ReflectionPadding2D0] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[ReflectionPadding2D1] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[ZeroPad2D] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[ZeroPadding2D0] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[ZeroPadding2D1] 0.00
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestGetActivation::test_string_act 0.00
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestGetActivation::test_sting_act_unknown 0.00
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestGetActivation::test_layer_act 0.00
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestGetActivation::test_layer_act_invalid 0.00
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestFlattenTail::test_flatten_tail_no_bound_no_regul_no_drop 0.02
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestFlattenTail::test_flatten_tail_all_settings 0.03
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_block_part_name 0.00
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_conv_tower_3x3 0.02
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_conv_tower_3x3_batch_norm 0.03
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_conv_tower_3x3_activation 0.03
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_conv_tower_1x1 0.01
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_conv_towers 0.04
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_pool_tower 0.02
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_inception_block 0.13
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_inception_block_invalid_batchnorm 0.04
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_batch_normalisation 0.01
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestHistoryAdvanced::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestHistoryAdvanced::test_on_train_begin 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestLearningRateDecay::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestLearningRateDecay::test_check_param 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestLearningRateDecay::test_on_epoch_begin 0.42
------------------------------Captured stdout call------------------------------
Epoch 1/5 1/1 [==============================] - ETA: 0s - loss: 0.8273 1/1 [==============================] - 0s 312ms/step - loss: 0.8273 Epoch 2/5 1/1 [==============================] - ETA: 0s - loss: 0.8011 1/1 [==============================] - 0s 2ms/step - loss: 0.8011 Epoch 3/5 1/1 [==============================] - ETA: 0s - loss: 0.7772 1/1 [==============================] - 0s 1ms/step - loss: 0.7772 Epoch 4/5 1/1 [==============================] - ETA: 0s - loss: 0.7549 1/1 [==============================] - 0s 1ms/step - loss: 0.7549 Epoch 5/5 1/1 [==============================] - ETA: 0s - loss: 0.7326 1/1 [==============================] - 0s 1ms/step - loss: 0.7326
------------------------------Captured stderr call------------------------------
2023-06-30 10:30:17.848437: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:185] None of the MLIR Optimization Passes are enabled (registered 2)
Passed test/test_model_modules/test_keras_extensions.py::TestModelCheckpointAdvanced::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestModelCheckpointAdvanced::test_update_best 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestModelCheckpointAdvanced::test_update_callbacks 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestModelCheckpointAdvanced::test_on_epoch_end 0.00
------------------------------Captured stdout call------------------------------
Epoch 00001: val_loss did not improve from 6.00000 Epoch 00010: val_loss did not improve from 6.00000 Epoch 00011: val_loss improved from 6.00000 to 4.00000, saving model to ckpt.test Epoch 00011: save to /builds/esde/machine-learning/mlair/test/test_model_modules/callback_lr Epoch 00011: save to /builds/esde/machine-learning/mlair/test/test_model_modules/callback_hist Epoch 00011: saving model to ckpt.test Epoch 00011: save to /builds/esde/machine-learning/mlair/test/test_model_modules/callback_lr Epoch 00011: save to /builds/esde/machine-learning/mlair/test/test_model_modules/callback_hist
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_callbacks_set 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_callbacks_get 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_update_callback 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_add_callback 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_add_callback_raise 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_get_callbacks_as_dict 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_get_callbacks_no_dict 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_get_callback_by_name 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test__get_callbacks 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_get_checkpoint 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_create_model_checkpoint 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_load_callbacks 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_update_checkpoint 0.00
No log output captured.
Passed test/test_model_modules/test_linear_model.py::TestOrdinaryLeastSquareModel::test_constant_input_variable 0.00
No log output captured.
Passed test/test_model_modules/test_loss.py::TestLPLoss::test_l_p_loss 0.25
------------------------------Captured stdout call------------------------------
1/1 [==============================] - ETA: 0s - loss: 1.2500 1/1 [==============================] - 0s 78ms/step - loss: 1.2500 1/1 [==============================] - ETA: 0s - loss: 2.2500 1/1 [==============================] - 0s 82ms/step - loss: 2.2500
Passed test/test_model_modules/test_loss.py::TestVarLoss::test_var_loss 0.18
------------------------------Captured stdout call------------------------------
1/1 [==============================] - ETA: 0s - loss: 0.1406 1/1 [==============================] - 0s 137ms/step - loss: 0.1406
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_no_weights 0.20
------------------------------Captured stdout call------------------------------
1/1 [==============================] - ETA: 0s - loss: 0.6953 1/1 [==============================] - 0s 150ms/step - loss: 0.6953
------------------------------Captured stderr call------------------------------
2023-06-30 10:30:18,882 - WARNING: 5 out of the last 9 calls to <function Model.make_train_function.<locals>.train_function at 0x7f7eb463b280> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [def_function.py:called_with_tracing:147] 2023-06-30 10:30:18,882 - WARNING: 5 out of the last 9 calls to <function Model.make_train_function.<locals>.train_function at 0x7f7eb463b280> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [def_function.py:called_with_tracing:147] 2023-06-30 10:30:18,882 - WARNING: 5 out of the last 9 calls to <function Model.make_train_function.<locals>.train_function at 0x7f7eb463b280> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [def_function.py:called_with_tracing:147] 2023-06-30 10:30:18,882 - WARNING: 5 out of the last 9 calls to <function Model.make_train_function.<locals>.train_function at 0x7f7eb463b280> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [def_function.py:called_with_tracing:147]
-------------------------------Captured log call--------------------------------
WARNING tensorflow:def_function.py:147 5 out of the last 9 calls to <function Model.make_train_function.<locals>.train_function at 0x7f7eb463b280> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_with_weights[weights0] 0.16
------------------------------Captured stdout call------------------------------
1/1 [==============================] - ETA: 0s - loss: 0.4734 1/1 [==============================] - 0s 113ms/step - loss: 0.4734
------------------------------Captured stderr call------------------------------
2023-06-30 10:30:19,051 - WARNING: 6 out of the last 10 calls to <function Model.make_train_function.<locals>.train_function at 0x7f7eb416f8b0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [def_function.py:called_with_tracing:147] 2023-06-30 10:30:19,051 - WARNING: 6 out of the last 10 calls to <function Model.make_train_function.<locals>.train_function at 0x7f7eb416f8b0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [def_function.py:called_with_tracing:147] 2023-06-30 10:30:19,051 - WARNING: 6 out of the last 10 calls to <function Model.make_train_function.<locals>.train_function at 0x7f7eb416f8b0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [def_function.py:called_with_tracing:147] 2023-06-30 10:30:19,051 - WARNING: 6 out of the last 10 calls to <function Model.make_train_function.<locals>.train_function at 0x7f7eb416f8b0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [def_function.py:called_with_tracing:147]
-------------------------------Captured log call--------------------------------
WARNING tensorflow:def_function.py:147 6 out of the last 10 calls to <function Model.make_train_function.<locals>.train_function at 0x7f7eb416f8b0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_with_weights[weights1] 0.15
------------------------------Captured stdout call------------------------------
1/1 [==============================] - ETA: 0s - loss: 0.6953 1/1 [==============================] - 0s 110ms/step - loss: 0.6953
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_with_weights[weights2] 0.17
------------------------------Captured stdout call------------------------------
1/1 [==============================] - ETA: 0s - loss: 0.6953 1/1 [==============================] - 0s 109ms/step - loss: 0.6953
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_with_weights[weights3] 0.16
------------------------------Captured stdout call------------------------------
1/1 [==============================] - ETA: 0s - loss: 1.0281 1/1 [==============================] - 0s 114ms/step - loss: 1.0281
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_invalid_weights 0.00
No log output captured.
Passed test/test_model_modules/test_model_class.py::TestIntelliO3_ts_architecture::test_init 0.28
No log output captured.
Passed test/test_model_modules/test_model_class.py::TestIntelliO3_ts_architecture::test_set_model 0.28
No log output captured.
Passed test/test_model_modules/test_model_class.py::TestIntelliO3_ts_architecture::test_set_compile_options 0.28
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_init 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_repr 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_x_property 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_y_property 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_add_precursor 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_add_successor 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_init 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_get_all_scopes 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_get_unique_scopes 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_get_unique_scopes_no_general 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_get_all_dims 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_create_track_chain 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_control_dict 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test__create_track_chain 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_precursor 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_track_object_same_stage 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_track_object_different_stage 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_update_control 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_set_object 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_set_object_no_control_obj 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_get_object_no_new_track_obj 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_get_object_no_control_obj 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_get_object_skip_update 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_recursive_decent_avail_in_1_up 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_recursive_decent_avail_in_2_up 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_recursive_decent_avail_from_chain 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_recursive_decent_avail_from_chain_get 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_recursive_decent_avail_from_chain_multiple_get 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_clean_control 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_init 0.31
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_plot 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_line 0.02
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_step 0.02
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_rect 0.01
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_set_ypos_anchor 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_plot_track_chain 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_add_variable_names 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_add_stages 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_create_track_chain_plot_run_env 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_set_lims 0.01
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_get_plot_metric 0.00
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_get_plot_metric_short_metric 0.00
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_get_plot_metric_main_branch 0.00
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_filter_columns 0.00
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_plot_from_hist_obj 0.60
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_plot_from_hist_dict 0.25
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_plot_additional_loss 0.49
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelLearningRate::test_plot_from_lr_obj 0.15
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelLearningRate::test_plot_from_lr_dict 0.15
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceDataHandler::test_init 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceDataHandler::test_make_reference_available_locally 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceDataHandler::test_is_reference_available_locally 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceb2share::test_inheritance 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceb2share::test_init 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceb2share::test_b2share_url 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceb2share::test_bar_custom 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceb2share::test_download_from_b2share 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_init_none_path 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_init_extra_path 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_inheritance 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_untar_forecasts 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_file_list 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_read_and_drop 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_make_reference_available_locally 0.00
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_set_param_by_value 0.00
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 set: 23tester(general)=23 DEBUG root:experiment_setup.py:461 set experiment attribute: 23tester(general)=23 DEBUG root:datastore.py:118 get: 23tester(general)=23
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_set_param_by_value_and_scope 0.00
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 set: 109tester(general)=109 DEBUG root:experiment_setup.py:461 set experiment attribute: 109tester(general)=109 DEBUG root:datastore.py:118 get: 109tester(general.tester)=109
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_set_param_with_default 0.00
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 set: NoneTester(general.testing)=notNone DEBUG root:experiment_setup.py:461 set experiment attribute: NoneTester(general.testing)=notNone DEBUG root:datastore.py:118 get: NoneTester(general.testing)=notNone DEBUG root:datastore.py:118 set: AnotherNoneTester(general)=None DEBUG root:experiment_setup.py:461 set experiment attribute: AnotherNoneTester(general)=None DEBUG root:datastore.py:118 get: AnotherNoneTester(general)=None
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_set_param_with_apply 0.00
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 set: NoneTester(general)=notNone DEBUG root:experiment_setup.py:461 set experiment attribute: NoneTester(general)=notNone DEBUG root:datastore.py:118 get: NoneTester(general)=notNone DEBUG root:datastore.py:118 set: NoneTester(general)=['notNone'] DEBUG root:experiment_setup.py:461 set experiment attribute: NoneTester(general)=['notNone'] DEBUG root:datastore.py:118 get: NoneTester(general)=['notNone'] DEBUG root:datastore.py:118 set: NoneTester(general)=[None] DEBUG root:experiment_setup.py:461 set experiment attribute: NoneTester(general)=[None] DEBUG root:datastore.py:118 get: NoneTester(general)=[None] DEBUG root:datastore.py:118 set: NoneTester(general)=2 DEBUG root:experiment_setup.py:461 set experiment attribute: NoneTester(general)=2 DEBUG root:datastore.py:118 get: NoneTester(general)=2
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_init_default 0.00
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_init_no_default 0.00
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_init_train_model_behaviour 0.02
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_compare_variables_and_statistics 0.01
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_multiprocessing_no_debug 0.01
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_multiprocessing_debug 0.01
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_set_callbacks 0.44
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_set_callbacks_no_lr_decay 1.21
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_get_model_settings 3.09
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_build_model 3.80
------------------------------Captured stdout call------------------------------
Model: "model_7" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_32 (InputLayer) [(None, 14, 1, 5)] 0 _________________________________________________________________ flatten_1 (Flatten) (None, 70) 0 _________________________________________________________________ dense_5 (Dense) (None, 64) 4544 _________________________________________________________________ prelu_1 (PReLU) (None, 64) 64 _________________________________________________________________ dense_6 (Dense) (None, 32) 2080 _________________________________________________________________ prelu_2 (PReLU) (None, 32) 32 _________________________________________________________________ dense_7 (Dense) (None, 16) 528 _________________________________________________________________ prelu_3 (PReLU) (None, 16) 16 _________________________________________________________________ dense_8 (Dense) (None, 5) 85 _________________________________________________________________ linear_output (Activation) (None, 5) 0 ================================================================= Total params: 7,349 Trainable params: 7,349 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_set_shapes 3.83
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_load_weights 0.00
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_compile_model 0.00
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_run 0.00
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_init 0.00
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_clean_name 2.11
No log output captured.
Passed test/test_run_modules/test_partition_check.py::TestPartitionCheck::test_init 1.82
------------------------------Captured stderr call------------------------------
2023-06-30 10:30:37,199 - INFO: PartitionCheck started [run_environment.py:__init__:103] 2023-06-30 10:30:37,199 - INFO: PartitionCheck started [run_environment.py:__init__:103] 2023-06-30 10:30:37,199 - INFO: PartitionCheck started [run_environment.py:__init__:103] 2023-06-30 10:30:37,199 - INFO: PartitionCheck started [run_environment.py:__init__:103] 2023-06-30 10:30:37,199 - INFO: PartitionCheck started [run_environment.py:__init__:103] 2023-06-30 10:30:37,199 - INFO: PartitionCheck finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:30:37,199 - INFO: PartitionCheck finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:30:37,199 - INFO: PartitionCheck finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:30:37,199 - INFO: PartitionCheck finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:30:37,199 - INFO: PartitionCheck finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:30:37,199 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:30:37,199 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:30:37,199 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:30:37,199 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:30:37,199 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:30:37,199 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:30:37,199 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:30:37,199 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:30:37,199 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:30:37,199 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:30:38,999 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:30:38,999 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:30:38,999 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:30:38,999 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:30:38,999 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:30:39,012 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:30:39,012 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:30:39,012 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:30:39,012 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:30:39,012 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 PartitionCheck started INFO root:run_environment.py:120 PartitionCheck finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:120 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_partition_check.py::TestPartitionCheck::test_run_login 1.82
No log output captured.
Passed test/test_run_modules/test_partition_check.py::TestPartitionCheck::test_run_compute 1.97
No log output captured.
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_init 86.89
------------------------------Captured stderr call------------------------------
2023-06-30 10:30:42,821 - INFO: PreProcessing started [run_environment.py:__init__:103] 2023-06-30 10:30:42,821 - INFO: PreProcessing started [run_environment.py:__init__:103] 2023-06-30 10:30:42,821 - INFO: PreProcessing started [run_environment.py:__init__:103] 2023-06-30 10:30:42,821 - INFO: PreProcessing started [run_environment.py:__init__:103] 2023-06-30 10:30:42,821 - INFO: PreProcessing started [run_environment.py:__init__:103] 2023-06-30 10:30:42,822 - INFO: check valid stations started (preprocessing) [pre_processing.py:validate_station:262] 2023-06-30 10:30:42,822 - INFO: check valid stations started (preprocessing) [pre_processing.py:validate_station:262] 2023-06-30 10:30:42,822 - INFO: check valid stations started (preprocessing) [pre_processing.py:validate_station:262] 2023-06-30 10:30:42,822 - INFO: check valid stations started (preprocessing) [pre_processing.py:validate_station:262] 2023-06-30 10:30:42,822 - INFO: check valid stations started (preprocessing) [pre_processing.py:validate_station:262] 2023-06-30 10:30:42,826 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:30:42,826 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:30:42,826 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:30:42,826 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:30:42,826 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:30:43,441 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:30:43,441 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:30:43,441 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:30:43,441 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:30:43,441 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:30:43,476 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:43,476 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:43,476 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:43,476 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:43,476 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:43,559 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:30:43,559 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:30:43,559 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:30:43,559 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:30:43,559 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:30:43,610 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:43,610 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:43,610 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:43,610 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:43,610 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:43,995 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 10:30:43,995 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 10:30:43,995 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 10:30:43,995 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 10:30:43,995 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 10:30:44,073 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:44,073 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:44,073 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:44,073 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:44,073 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:45,037 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 10:30:45,037 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 10:30:45,037 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 10:30:45,037 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 10:30:45,037 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 10:30:45,190 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:45,190 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:45,190 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:45,190 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:45,190 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:46,169 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 10:30:46,169 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 10:30:46,169 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 10:30:46,169 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 10:30:46,169 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 10:30:46,316 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:46,316 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:46,316 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:46,316 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:46,316 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:46,318 - INFO: load data for DEBW107 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 10:30:46,318 - INFO: load data for DEBW107 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 10:30:46,318 - INFO: load data for DEBW107 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 10:30:46,318 - INFO: load data for DEBW107 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 10:30:46,318 - INFO: load data for DEBW107 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 10:30:46,853 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:46,853 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:46,853 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:46,853 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:46,853 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:49,313 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:49,313 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:49,313 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:49,313 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:49,313 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:49,450 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:49,450 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:49,450 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:49,450 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:49,450 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:49,477 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:49,477 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:49,477 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:49,477 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:49,477 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:49,835 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:49,835 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:49,835 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:49,835 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:49,835 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:49,878 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:49,878 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:49,878 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:49,878 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:49,878 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:51,505 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:51,505 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:51,505 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:51,505 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:51,505 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:51,549 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:51,549 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:51,549 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:51,549 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:51,549 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:53,630 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:53,630 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:53,630 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:53,630 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:53,630 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:53,675 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:53,675 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:53,675 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:53,675 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:53,675 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:57,585 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:57,585 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:57,585 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:57,585 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:57,585 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:30:57,630 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:57,630 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:57,630 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:57,630 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:30:57,630 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:02,339 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:31:02,339 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:31:02,339 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:31:02,339 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:31:02,339 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:31:02,397 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:02,397 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:02,397 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:02,397 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:02,397 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:02,400 - INFO: load data for DEBW107 from JOIN [join.py:download_join:63] 2023-06-30 10:31:02,400 - INFO: load data for DEBW107 from JOIN [join.py:download_join:63] 2023-06-30 10:31:02,400 - INFO: load data for DEBW107 from JOIN [join.py:download_join:63] 2023-06-30 10:31:02,400 - INFO: load data for DEBW107 from JOIN [join.py:download_join:63] 2023-06-30 10:31:02,400 - INFO: load data for DEBW107 from JOIN [join.py:download_join:63] 2023-06-30 10:31:02,934 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:02,934 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:02,934 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:02,934 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:02,934 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:04,413 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:04,413 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:04,413 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:04,413 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:04,413 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:05,099 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:05,099 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:05,099 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:05,099 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:05,099 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:05,820 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:05,820 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:05,820 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:05,820 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:05,820 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:06,579 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 10:31:06,579 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 10:31:06,579 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 10:31:06,579 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 10:31:06,579 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 10:31:06,637 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:06,637 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:06,637 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:06,637 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:06,637 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:06,747 - INFO: setup_samples finished after 0:00:24 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:06,747 - INFO: setup_samples finished after 0:00:24 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:06,747 - INFO: setup_samples finished after 0:00:24 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:06,747 - INFO: setup_samples finished after 0:00:24 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:06,747 - INFO: setup_samples finished after 0:00:24 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:06,999 - INFO: PartitionCheck finished after 0:00:27 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:31:06,999 - INFO: PartitionCheck finished after 0:00:27 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:31:06,999 - INFO: PartitionCheck finished after 0:00:27 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:31:06,999 - INFO: PartitionCheck finished after 0:00:27 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:31:06,999 - INFO: PartitionCheck finished after 0:00:27 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:31:07,011 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:07,011 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:07,011 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:07,011 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:07,011 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:07,011 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:07,011 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:07,011 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:07,011 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:07,011 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:07,266 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:07,266 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:07,266 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:07,266 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:07,266 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:08,009 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:31:08,009 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:31:08,009 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:31:08,009 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:31:08,009 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:31:08,041 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:08,041 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:08,041 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:08,041 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:08,041 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:09,039 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:31:09,039 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:31:09,039 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:31:09,039 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:31:09,039 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:31:09,082 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:09,082 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:09,082 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:09,082 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:09,082 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:09,920 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 10:31:09,920 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 10:31:09,920 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 10:31:09,920 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 10:31:09,920 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 10:31:10,003 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:10,003 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:10,003 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:10,003 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:10,003 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:10,079 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 10:31:10,079 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 10:31:10,079 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 10:31:10,079 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 10:31:10,079 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 10:31:10,226 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:10,226 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:10,226 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:10,226 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:10,226 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:10,297 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 10:31:10,297 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 10:31:10,297 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 10:31:10,297 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 10:31:10,297 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 10:31:10,450 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:10,450 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:10,450 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:10,450 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:10,450 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:10,453 - INFO: load data for DEBW013 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 10:31:10,453 - INFO: load data for DEBW013 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 10:31:10,453 - INFO: load data for DEBW013 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 10:31:10,453 - INFO: load data for DEBW013 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 10:31:10,453 - INFO: load data for DEBW013 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 10:31:11,177 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:11,177 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:11,177 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:11,177 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:11,177 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:13,760 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:13,760 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:13,760 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:13,760 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:13,760 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:14,151 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:14,151 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:14,151 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:14,151 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:14,151 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:14,177 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:14,177 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:14,177 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:14,177 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:14,177 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:14,374 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:14,374 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:14,374 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:14,374 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:14,374 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:14,420 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:14,420 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:14,420 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:14,420 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:14,420 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:15,920 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:15,920 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:15,920 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:15,920 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:15,920 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:15,965 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:15,965 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:15,965 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:15,965 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:15,965 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:18,695 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:18,695 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:18,695 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:18,695 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:18,695 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:18,739 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:18,739 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:18,739 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:18,739 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:18,739 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:22,049 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:22,049 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:22,049 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:22,049 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:22,049 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:22,093 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:22,093 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:22,093 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:22,093 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:22,093 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:26,668 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:31:26,668 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:31:26,668 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:31:26,668 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:31:26,668 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:31:26,717 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:26,717 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:26,717 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:26,717 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:26,717 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:26,720 - INFO: load data for DEBW013 from JOIN [join.py:download_join:63] 2023-06-30 10:31:26,720 - INFO: load data for DEBW013 from JOIN [join.py:download_join:63] 2023-06-30 10:31:26,720 - INFO: load data for DEBW013 from JOIN [join.py:download_join:63] 2023-06-30 10:31:26,720 - INFO: load data for DEBW013 from JOIN [join.py:download_join:63] 2023-06-30 10:31:26,720 - INFO: load data for DEBW013 from JOIN [join.py:download_join:63] 2023-06-30 10:31:27,176 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:27,176 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:27,176 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:27,176 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:27,176 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:29,366 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:29,366 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:29,366 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:29,366 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:29,366 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:29,903 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:29,903 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:29,903 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:29,903 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:29,903 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:30,967 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:30,967 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:30,967 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:30,967 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:30,967 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:31,826 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 10:31:31,826 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 10:31:31,826 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 10:31:31,826 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 10:31:31,826 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 10:31:31,886 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:31,886 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:31,886 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:31,886 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:31,886 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:31,998 - INFO: setup_samples finished after 0:00:25 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:31,998 - INFO: setup_samples finished after 0:00:25 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:31,998 - INFO: setup_samples finished after 0:00:25 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:31,998 - INFO: setup_samples finished after 0:00:25 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:31,998 - INFO: setup_samples finished after 0:00:25 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:32,257 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:32,257 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:32,257 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:32,257 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:32,257 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:32,257 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:32,257 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:32,257 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:32,257 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:32,257 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:32,514 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:32,514 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:32,514 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:32,514 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:32,514 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:33,022 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:31:33,022 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:31:33,022 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:31:33,022 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:31:33,022 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:31:33,052 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:33,052 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:33,052 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:33,052 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:33,052 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:33,365 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:31:33,365 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:31:33,365 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:31:33,365 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:31:33,365 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:31:33,412 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:33,412 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:33,412 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:33,412 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:33,412 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:34,133 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 10:31:34,133 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 10:31:34,133 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 10:31:34,133 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 10:31:34,133 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 10:31:34,216 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:34,216 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:34,216 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:34,216 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:34,216 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:34,236 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 10:31:34,236 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 10:31:34,236 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 10:31:34,236 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 10:31:34,236 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 10:31:34,385 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:34,385 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:34,385 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:34,385 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:34,385 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:34,524 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 10:31:34,524 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 10:31:34,524 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 10:31:34,524 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 10:31:34,524 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 10:31:34,677 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:34,677 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:34,677 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:34,677 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:34,677 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:34,680 - INFO: load data for DEBW087 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 10:31:34,680 - INFO: load data for DEBW087 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 10:31:34,680 - INFO: load data for DEBW087 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 10:31:34,680 - INFO: load data for DEBW087 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 10:31:34,680 - INFO: load data for DEBW087 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 10:31:35,283 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:35,283 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:35,283 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:35,283 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:35,283 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:37,728 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:37,728 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:37,728 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:37,728 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:37,728 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:38,103 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:38,103 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:38,103 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:38,103 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:38,103 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:38,131 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:38,131 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:38,131 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:38,131 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:38,131 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:39,043 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:39,043 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:39,043 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:39,043 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:39,043 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:39,087 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:39,087 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:39,087 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:39,087 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:39,087 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:40,276 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:40,276 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:40,276 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:40,276 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:40,276 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:40,320 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:40,320 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:40,320 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:40,320 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:40,320 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:43,299 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:43,299 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:43,299 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:43,299 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:43,299 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:43,343 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:43,343 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:43,343 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:43,343 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:43,343 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:46,366 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:46,366 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:46,366 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:46,366 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:46,366 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 10:31:46,424 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:46,424 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:46,424 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:46,424 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:46,424 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:50,538 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:31:50,538 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:31:50,538 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:31:50,538 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:31:50,538 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:31:50,598 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:50,598 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:50,598 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:50,598 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:50,598 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:50,601 - INFO: load data for DEBW087 from JOIN [join.py:download_join:63] 2023-06-30 10:31:50,601 - INFO: load data for DEBW087 from JOIN [join.py:download_join:63] 2023-06-30 10:31:50,601 - INFO: load data for DEBW087 from JOIN [join.py:download_join:63] 2023-06-30 10:31:50,601 - INFO: load data for DEBW087 from JOIN [join.py:download_join:63] 2023-06-30 10:31:50,601 - INFO: load data for DEBW087 from JOIN [join.py:download_join:63] 2023-06-30 10:31:51,399 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:51,399 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:51,399 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:51,399 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:51,399 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:53,422 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:53,422 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:53,422 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:53,422 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:53,422 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:54,528 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:54,528 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:54,528 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:54,528 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:54,528 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 10:31:55,525 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:55,525 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:55,525 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:55,525 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:55,525 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,008 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 10:31:56,008 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 10:31:56,008 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 10:31:56,008 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 10:31:56,008 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 10:31:56,074 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,074 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,074 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,074 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,074 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,184 - INFO: setup_samples finished after 0:00:24 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,184 - INFO: setup_samples finished after 0:00:24 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,184 - INFO: setup_samples finished after 0:00:24 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,184 - INFO: setup_samples finished after 0:00:24 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,184 - INFO: setup_samples finished after 0:00:24 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,446 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,446 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,446 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,446 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,446 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,446 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,446 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,446 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,446 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,446 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,700 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:56,700 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:56,700 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:56,700 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:56,700 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:56,700 - INFO: run for 0:01:14 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (preprocessing). [pre_processing.py:validate_station:305] 2023-06-30 10:31:56,700 - INFO: run for 0:01:14 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (preprocessing). [pre_processing.py:validate_station:305] 2023-06-30 10:31:56,700 - INFO: run for 0:01:14 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (preprocessing). [pre_processing.py:validate_station:305] 2023-06-30 10:31:56,700 - INFO: run for 0:01:14 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (preprocessing). [pre_processing.py:validate_station:305] 2023-06-30 10:31:56,700 - INFO: run for 0:01:14 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (preprocessing). [pre_processing.py:validate_station:305] 2023-06-30 10:31:56,701 - INFO: check valid stations started (train) [pre_processing.py:validate_station:262] 2023-06-30 10:31:56,701 - INFO: check valid stations started (train) [pre_processing.py:validate_station:262] 2023-06-30 10:31:56,701 - INFO: check valid stations started (train) [pre_processing.py:validate_station:262] 2023-06-30 10:31:56,701 - INFO: check valid stations started (train) [pre_processing.py:validate_station:262] 2023-06-30 10:31:56,701 - INFO: check valid stations started (train) [pre_processing.py:validate_station:262] 2023-06-30 10:31:56,701 - INFO: setup transformation using train data exclusively [pre_processing.py:validate_station:265] 2023-06-30 10:31:56,701 - INFO: setup transformation using train data exclusively [pre_processing.py:validate_station:265] 2023-06-30 10:31:56,701 - INFO: setup transformation using train data exclusively [pre_processing.py:validate_station:265] 2023-06-30 10:31:56,701 - INFO: setup transformation using train data exclusively [pre_processing.py:validate_station:265] 2023-06-30 10:31:56,701 - INFO: setup transformation using train data exclusively [pre_processing.py:validate_station:265] 2023-06-30 10:31:56,702 - INFO: start to calculate transformation parameters. [pre_processing.py:transformation:353] 2023-06-30 10:31:56,702 - INFO: start to calculate transformation parameters. [pre_processing.py:transformation:353] 2023-06-30 10:31:56,702 - INFO: start to calculate transformation parameters. [pre_processing.py:transformation:353] 2023-06-30 10:31:56,702 - INFO: start to calculate transformation parameters. [pre_processing.py:transformation:353] 2023-06-30 10:31:56,702 - INFO: start to calculate transformation parameters. [pre_processing.py:transformation:353] 2023-06-30 10:31:56,706 - INFO: use serial transformation approach [default_data_handler.py:transformation:322] 2023-06-30 10:31:56,706 - INFO: use serial transformation approach [default_data_handler.py:transformation:322] 2023-06-30 10:31:56,706 - INFO: use serial transformation approach [default_data_handler.py:transformation:322] 2023-06-30 10:31:56,706 - INFO: use serial transformation approach [default_data_handler.py:transformation:322] 2023-06-30 10:31:56,706 - INFO: use serial transformation approach [default_data_handler.py:transformation:322] 2023-06-30 10:31:56,768 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,768 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,768 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,768 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:56,768 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,063 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,063 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,063 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,063 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,063 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,367 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,367 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,367 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,367 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,367 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,616 - INFO: Store transformation options locally for later use at: /builds/esde/machine-learning/mlair/TestExperiment_daily/data/transformation/transformation.pickle [pre_processing.py:_store_transformation:386] 2023-06-30 10:31:57,616 - INFO: Store transformation options locally for later use at: /builds/esde/machine-learning/mlair/TestExperiment_daily/data/transformation/transformation.pickle [pre_processing.py:_store_transformation:386] 2023-06-30 10:31:57,616 - INFO: Store transformation options locally for later use at: /builds/esde/machine-learning/mlair/TestExperiment_daily/data/transformation/transformation.pickle [pre_processing.py:_store_transformation:386] 2023-06-30 10:31:57,616 - INFO: Store transformation options locally for later use at: /builds/esde/machine-learning/mlair/TestExperiment_daily/data/transformation/transformation.pickle [pre_processing.py:_store_transformation:386] 2023-06-30 10:31:57,616 - INFO: Store transformation options locally for later use at: /builds/esde/machine-learning/mlair/TestExperiment_daily/data/transformation/transformation.pickle [pre_processing.py:_store_transformation:386] 2023-06-30 10:31:57,622 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:31:57,622 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:31:57,622 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:31:57,622 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:31:57,622 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:31:57,681 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,681 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,681 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,681 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,681 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,913 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,913 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,913 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,913 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,913 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,913 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,913 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,913 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,913 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:57,913 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,146 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:58,146 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:58,146 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:58,146 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:58,146 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:58,210 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,210 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,210 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,210 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,210 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,444 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,444 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,444 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,444 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,444 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,444 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,444 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,444 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,444 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,444 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,678 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:58,678 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:58,678 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:58,678 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:58,678 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:58,741 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,741 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,741 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,741 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,741 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,975 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,975 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,975 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,975 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,975 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,975 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,975 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,975 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,975 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:58,975 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,217 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,217 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,217 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,217 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,217 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,217 - INFO: run for 0:00:03 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train). [pre_processing.py:validate_station:305] 2023-06-30 10:31:59,217 - INFO: run for 0:00:03 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train). [pre_processing.py:validate_station:305] 2023-06-30 10:31:59,217 - INFO: run for 0:00:03 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train). [pre_processing.py:validate_station:305] 2023-06-30 10:31:59,217 - INFO: run for 0:00:03 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train). [pre_processing.py:validate_station:305] 2023-06-30 10:31:59,217 - INFO: run for 0:00:03 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train). [pre_processing.py:validate_station:305] 2023-06-30 10:31:59,218 - INFO: check valid stations started (val) [pre_processing.py:validate_station:262] 2023-06-30 10:31:59,218 - INFO: check valid stations started (val) [pre_processing.py:validate_station:262] 2023-06-30 10:31:59,218 - INFO: check valid stations started (val) [pre_processing.py:validate_station:262] 2023-06-30 10:31:59,218 - INFO: check valid stations started (val) [pre_processing.py:validate_station:262] 2023-06-30 10:31:59,218 - INFO: check valid stations started (val) [pre_processing.py:validate_station:262] 2023-06-30 10:31:59,224 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:31:59,224 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:31:59,224 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:31:59,224 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:31:59,224 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:31:59,281 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,281 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,281 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,281 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,281 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,282 - INFO: remove station DEBW107 because it raised an error: self.history consist of NaNs only - station ['DEBW107'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 10:31:59,282 - INFO: remove station DEBW107 because it raised an error: self.history consist of NaNs only - station ['DEBW107'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 10:31:59,282 - INFO: remove station DEBW107 because it raised an error: self.history consist of NaNs only - station ['DEBW107'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 10:31:59,282 - INFO: remove station DEBW107 because it raised an error: self.history consist of NaNs only - station ['DEBW107'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 10:31:59,282 - INFO: remove station DEBW107 because it raised an error: self.history consist of NaNs only - station ['DEBW107'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 10:31:59,282 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,282 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,282 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,282 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,282 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,336 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,336 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,336 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,336 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,336 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,336 - INFO: remove station DEBW013 because it raised an error: self.history consist of NaNs only - station ['DEBW013'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 10:31:59,336 - INFO: remove station DEBW013 because it raised an error: self.history consist of NaNs only - station ['DEBW013'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 10:31:59,336 - INFO: remove station DEBW013 because it raised an error: self.history consist of NaNs only - station ['DEBW013'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 10:31:59,336 - INFO: remove station DEBW013 because it raised an error: self.history consist of NaNs only - station ['DEBW013'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 10:31:59,336 - INFO: remove station DEBW013 because it raised an error: self.history consist of NaNs only - station ['DEBW013'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 10:31:59,337 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,337 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,337 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,337 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,337 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,390 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,390 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,390 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,390 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,390 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,390 - INFO: remove station DEBW087 because it raised an error: self.history consist of NaNs only - station ['DEBW087'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 10:31:59,390 - INFO: remove station DEBW087 because it raised an error: self.history consist of NaNs only - station ['DEBW087'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 10:31:59,390 - INFO: remove station DEBW087 because it raised an error: self.history consist of NaNs only - station ['DEBW087'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 10:31:59,390 - INFO: remove station DEBW087 because it raised an error: self.history consist of NaNs only - station ['DEBW087'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 10:31:59,390 - INFO: remove station DEBW087 because it raised an error: self.history consist of NaNs only - station ['DEBW087'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 10:31:59,391 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,391 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,391 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,391 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,391 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,391 - INFO: run for 0:00:01 (hh:mm:ss) to check 3 station(s). Found 0/3 valid stations (val). [pre_processing.py:validate_station:305] 2023-06-30 10:31:59,391 - INFO: run for 0:00:01 (hh:mm:ss) to check 3 station(s). Found 0/3 valid stations (val). [pre_processing.py:validate_station:305] 2023-06-30 10:31:59,391 - INFO: run for 0:00:01 (hh:mm:ss) to check 3 station(s). Found 0/3 valid stations (val). [pre_processing.py:validate_station:305] 2023-06-30 10:31:59,391 - INFO: run for 0:00:01 (hh:mm:ss) to check 3 station(s). Found 0/3 valid stations (val). [pre_processing.py:validate_station:305] 2023-06-30 10:31:59,391 - INFO: run for 0:00:01 (hh:mm:ss) to check 3 station(s). Found 0/3 valid stations (val). [pre_processing.py:validate_station:305] 2023-06-30 10:31:59,391 - INFO: check valid stations started (test) [pre_processing.py:validate_station:262] 2023-06-30 10:31:59,391 - INFO: check valid stations started (test) [pre_processing.py:validate_station:262] 2023-06-30 10:31:59,391 - INFO: check valid stations started (test) [pre_processing.py:validate_station:262] 2023-06-30 10:31:59,391 - INFO: check valid stations started (test) [pre_processing.py:validate_station:262] 2023-06-30 10:31:59,391 - INFO: check valid stations started (test) [pre_processing.py:validate_station:262] 2023-06-30 10:31:59,398 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:31:59,398 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:31:59,398 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:31:59,398 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:31:59,398 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:31:59,456 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,456 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,456 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,456 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,456 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,691 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,691 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,691 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,691 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,691 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,692 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,692 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,692 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,692 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,692 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,924 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,924 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,924 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,924 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,924 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:31:59,984 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,984 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,984 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,984 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:31:59,984 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,217 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,217 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,217 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,217 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,217 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,217 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,217 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,217 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,217 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,217 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,457 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:00,457 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:00,457 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:00,457 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:00,457 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:00,519 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,519 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,519 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,519 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,519 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,752 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,752 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,752 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,752 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,752 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,753 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,753 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,753 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,753 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,753 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:00,989 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:00,989 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:00,989 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:00,989 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:00,989 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:00,989 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (test). [pre_processing.py:validate_station:305] 2023-06-30 10:32:00,989 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (test). [pre_processing.py:validate_station:305] 2023-06-30 10:32:00,989 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (test). [pre_processing.py:validate_station:305] 2023-06-30 10:32:00,989 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (test). [pre_processing.py:validate_station:305] 2023-06-30 10:32:00,989 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (test). [pre_processing.py:validate_station:305] 2023-06-30 10:32:00,990 - INFO: check valid stations started (train_val) [pre_processing.py:validate_station:262] 2023-06-30 10:32:00,990 - INFO: check valid stations started (train_val) [pre_processing.py:validate_station:262] 2023-06-30 10:32:00,990 - INFO: check valid stations started (train_val) [pre_processing.py:validate_station:262] 2023-06-30 10:32:00,990 - INFO: check valid stations started (train_val) [pre_processing.py:validate_station:262] 2023-06-30 10:32:00,990 - INFO: check valid stations started (train_val) [pre_processing.py:validate_station:262] 2023-06-30 10:32:00,996 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:32:00,996 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:32:00,996 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:32:00,996 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:32:00,996 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:32:01,056 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,056 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,056 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,056 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,056 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,292 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,292 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,292 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,292 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,292 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,292 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,292 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,292 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,292 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,292 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,528 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:01,528 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:01,528 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:01,528 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:01,528 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:01,591 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,591 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,591 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,591 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,591 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,830 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,830 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,830 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,830 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,830 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,830 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,830 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,830 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,830 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:01,830 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:02,067 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:02,067 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:02,067 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:02,067 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:02,067 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:02,129 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:02,129 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:02,129 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:02,129 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:02,129 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:02,368 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:02,368 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:02,368 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:02,368 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:02,368 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:02,368 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:02,368 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:02,368 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:02,368 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:02,368 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:32:02,605 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:02,605 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:02,605 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:02,605 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:02,605 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:32:02,606 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train_val). [pre_processing.py:validate_station:305] 2023-06-30 10:32:02,606 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train_val). [pre_processing.py:validate_station:305] 2023-06-30 10:32:02,606 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train_val). [pre_processing.py:validate_station:305] 2023-06-30 10:32:02,606 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train_val). [pre_processing.py:validate_station:305] 2023-06-30 10:32:02,606 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train_val). [pre_processing.py:validate_station:305] 2023-06-30 10:32:02,608 - INFO: use serial create_info_df (train) [pre_processing.py:create_info_df:180] 2023-06-30 10:32:02,608 - INFO: use serial create_info_df (train) [pre_processing.py:create_info_df:180] 2023-06-30 10:32:02,608 - INFO: use serial create_info_df (train) [pre_processing.py:create_info_df:180] 2023-06-30 10:32:02,608 - INFO: use serial create_info_df (train) [pre_processing.py:create_info_df:180] 2023-06-30 10:32:02,608 - INFO: use serial create_info_df (train) [pre_processing.py:create_info_df:180] 2023-06-30 10:32:03,336 - INFO: use serial create_info_df (val) [pre_processing.py:create_info_df:180] 2023-06-30 10:32:03,336 - INFO: use serial create_info_df (val) [pre_processing.py:create_info_df:180] 2023-06-30 10:32:03,336 - INFO: use serial create_info_df (val) [pre_processing.py:create_info_df:180] 2023-06-30 10:32:03,336 - INFO: use serial create_info_df (val) [pre_processing.py:create_info_df:180] 2023-06-30 10:32:03,336 - INFO: use serial create_info_df (val) [pre_processing.py:create_info_df:180] 2023-06-30 10:32:03,337 - INFO: use serial create_info_df (test) [pre_processing.py:create_info_df:180] 2023-06-30 10:32:03,337 - INFO: use serial create_info_df (test) [pre_processing.py:create_info_df:180] 2023-06-30 10:32:03,337 - INFO: use serial create_info_df (test) [pre_processing.py:create_info_df:180] 2023-06-30 10:32:03,337 - INFO: use serial create_info_df (test) [pre_processing.py:create_info_df:180] 2023-06-30 10:32:03,337 - INFO: use serial create_info_df (test) [pre_processing.py:create_info_df:180] 2023-06-30 10:32:04,098 - INFO: Searching for competitors to be prepared for use. [pre_processing.py:prepare_competitors:395] 2023-06-30 10:32:04,098 - INFO: Searching for competitors to be prepared for use. [pre_processing.py:prepare_competitors:395] 2023-06-30 10:32:04,098 - INFO: Searching for competitors to be prepared for use. [pre_processing.py:prepare_competitors:395] 2023-06-30 10:32:04,098 - INFO: Searching for competitors to be prepared for use. [pre_processing.py:prepare_competitors:395] 2023-06-30 10:32:04,098 - INFO: Searching for competitors to be prepared for use. [pre_processing.py:prepare_competitors:395] 2023-06-30 10:32:04,099 - INFO: No preparation required for competitor ols as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 10:32:04,099 - INFO: No preparation required for competitor ols as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 10:32:04,099 - INFO: No preparation required for competitor ols as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 10:32:04,099 - INFO: No preparation required for competitor ols as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 10:32:04,099 - INFO: No preparation required for competitor ols as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 10:32:04,099 - INFO: No preparation required for competitor persi as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 10:32:04,099 - INFO: No preparation required for competitor persi as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 10:32:04,099 - INFO: No preparation required for competitor persi as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 10:32:04,099 - INFO: No preparation required for competitor persi as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 10:32:04,099 - INFO: No preparation required for competitor persi as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 10:32:04,101 - INFO: PreProcessing finished after 0:01:22 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:32:04,101 - INFO: PreProcessing finished after 0:01:22 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:32:04,101 - INFO: PreProcessing finished after 0:01:22 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:32:04,101 - INFO: PreProcessing finished after 0:01:22 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:32:04,101 - INFO: PreProcessing finished after 0:01:22 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:32:04,101 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:32:04,101 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:32:04,101 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:32:04,101 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:32:04,101 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:32:04,101 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:32:04,101 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:32:04,101 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:32:04,101 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:32:04,101 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:32:09,695 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:32:09,695 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:32:09,695 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:32:09,695 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:32:09,695 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:32:09,713 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:32:09,713 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:32:09,713 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:32:09,713 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:32:09,713 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 PreProcessing started INFO root:pre_processing.py:262 check valid stations started (preprocessing) INFO root:pre_processing.py:296 use serial validate station approach INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 finished after 0:00:01 (hh:mm:ss) INFO root:toar_data_v2.py:64 load data for DEBW107 from TOAR-DATA INFO root:data_loader.py:115 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) INFO root:join.py:63 load data for DEBW107 from JOIN INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 setup_samples finished after 0:00:24 (hh:mm:ss) INFO root:run_environment.py:120 PartitionCheck finished after 0:00:27 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW107 (33%) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 finished after 0:00:01 (hh:mm:ss) INFO root:toar_data_v2.py:64 load data for DEBW013 from TOAR-DATA INFO root:data_loader.py:115 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) INFO root:join.py:63 load data for DEBW013 from JOIN INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 setup_samples finished after 0:00:25 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW013 (66%) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 finished after 0:00:01 (hh:mm:ss) INFO root:toar_data_v2.py:64 load data for DEBW087 from TOAR-DATA INFO root:data_loader.py:115 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) INFO root:join.py:63 load data for DEBW087 from JOIN INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 setup_samples finished after 0:00:24 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW087 (100%) INFO root:pre_processing.py:305 run for 0:01:14 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (preprocessing). INFO root:pre_processing.py:262 check valid stations started (train) INFO root:pre_processing.py:265 setup transformation using train data exclusively INFO root:pre_processing.py:353 start to calculate transformation parameters. INFO root:default_data_handler.py:322 use serial transformation approach INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:386 Store transformation options locally for later use at: /builds/esde/machine-learning/mlair/TestExperiment_daily/data/transformation/transformation.pickle INFO root:pre_processing.py:296 use serial validate station approach INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW107 (33%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW013 (66%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW087 (100%) INFO root:pre_processing.py:305 run for 0:00:03 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train). INFO root:pre_processing.py:262 check valid stations started (val) INFO root:pre_processing.py:296 use serial validate station approach INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:489 remove station DEBW107 because it raised an error: self.history consist of NaNs only - station ['DEBW107'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') INFO root:pre_processing.py:303 ...finished: DEBW107 (33%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:489 remove station DEBW013 because it raised an error: self.history consist of NaNs only - station ['DEBW013'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') INFO root:pre_processing.py:303 ...finished: DEBW013 (66%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:489 remove station DEBW087 because it raised an error: self.history consist of NaNs only - station ['DEBW087'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') INFO root:pre_processing.py:303 ...finished: DEBW087 (100%) INFO root:pre_processing.py:305 run for 0:00:01 (hh:mm:ss) to check 3 station(s). Found 0/3 valid stations (val). INFO root:pre_processing.py:262 check valid stations started (test) INFO root:pre_processing.py:296 use serial validate station approach INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW107 (33%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW013 (66%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW087 (100%) INFO root:pre_processing.py:305 run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (test). INFO root:pre_processing.py:262 check valid stations started (train_val) INFO root:pre_processing.py:296 use serial validate station approach INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW107 (33%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW013 (66%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW087 (100%) INFO root:pre_processing.py:305 run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train_val). INFO root:pre_processing.py:180 use serial create_info_df (train) INFO root:pre_processing.py:180 use serial create_info_df (val) INFO root:pre_processing.py:180 use serial create_info_df (test) INFO root:pre_processing.py:395 Searching for competitors to be prepared for use. INFO root:pre_processing.py:425 No preparation required for competitor ols as no specific instruction is provided. INFO root:pre_processing.py:425 No preparation required for competitor persi as no specific instruction is provided. INFO root:run_environment.py:120 PreProcessing finished after 0:01:22 (hh:mm:ss) INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:120 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_run 20.76
No log output captured.
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_split_train_val_test 158.16
No log output captured.
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_create_set_split_not_all_stations 5.57
------------------------------Captured stderr call------------------------------
2023-06-30 10:35:08,657 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 10:35:08,657 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 10:35:08,657 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 10:35:08,657 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 10:35:08,657 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 10:35:08,664 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:08,664 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:08,664 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:08,664 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:08,664 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:08,730 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:08,730 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:08,730 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:08,730 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:08,730 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,100 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,100 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,100 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,100 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,100 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,100 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,100 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,100 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,100 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,100 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,446 - INFO: ...finished: DEBW107 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:09,446 - INFO: ...finished: DEBW107 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:09,446 - INFO: ...finished: DEBW107 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:09,446 - INFO: ...finished: DEBW107 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:09,446 - INFO: ...finished: DEBW107 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:09,515 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,515 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,515 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,515 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,515 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,861 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,861 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,861 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,861 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,861 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,862 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,862 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,862 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,862 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:09,862 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:10,209 - INFO: ...finished: DEBW013 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:10,209 - INFO: ...finished: DEBW013 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:10,209 - INFO: ...finished: DEBW013 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:10,209 - INFO: ...finished: DEBW013 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:10,209 - INFO: ...finished: DEBW013 (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:10,209 - INFO: run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations (awesome). [pre_processing.py:validate_station:305] 2023-06-30 10:35:10,209 - INFO: run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations (awesome). [pre_processing.py:validate_station:305] 2023-06-30 10:35:10,209 - INFO: run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations (awesome). [pre_processing.py:validate_station:305] 2023-06-30 10:35:10,209 - INFO: run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations (awesome). [pre_processing.py:validate_station:305] 2023-06-30 10:35:10,209 - INFO: run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations (awesome). [pre_processing.py:validate_station:305]
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 set: use_all_stations_on_all_data_sets(general)=False DEBUG root:datastore.py:118 get: stations(general.awesome)=['DEBW107', 'DEBW013', 'DEBW087', 'DEBW99X'] DEBUG root:datastore.py:118 get: use_all_stations_on_all_data_sets(general)=False DEBUG root:pre_processing.py:244 Awesome stations (len=2): ['DEBW107', 'DEBW013'] DEBUG root:datastore.py:118 get: data_handler(general)=<class 'mlair.data_handler.default_data_handler.DefaultDataHandler'> INFO root:pre_processing.py:262 check valid stations started (awesome) DEBUG root:datastore.py:120 get: ifs_data_path(general.awesome)=None DEBUG root:datastore.py:118 get: data_origin(general.awesome)={'o3': 'UBA', 'temp': 'UBA'} DEBUG root:datastore.py:118 get: data_path(general.awesome)=/home/root/mlair/data/ DEBUG root:datastore.py:120 get: name_affix(general.awesome)=None DEBUG root:datastore.py:118 get: transformation(general.awesome)={} DEBUG root:datastore.py:118 get: interpolation_limit(general.awesome)=1 DEBUG root:datastore.py:120 get: era5_data_path(general.awesome)=None DEBUG root:datastore.py:118 get: experiment_path(general.awesome)=/builds/esde/machine-learning/mlair/TestExperiment_daily DEBUG root:datastore.py:120 get: ifs_file_names(general.awesome)=None DEBUG root:datastore.py:118 get: end(general.awesome)=2017-12-31 DEBUG root:datastore.py:120 get: store_processed_data(general.awesome)=None DEBUG root:datastore.py:120 get: store_data_locally(general.awesome)=None DEBUG root:datastore.py:118 get: max_number_multiprocessing(general.awesome)=16 DEBUG root:datastore.py:118 get: iter_dim(general.awesome)=Stations DEBUG root:datastore.py:118 get: variables(general.awesome)=['o3', 'temp'] DEBUG root:datastore.py:120 get: window_history_offset(general.awesome)=None DEBUG root:datastore.py:118 get: window_history_size(general.awesome)=13 DEBUG root:datastore.py:118 get: target_var(general.awesome)=o3 DEBUG root:datastore.py:120 get: extreme_values(general.awesome)=None DEBUG root:datastore.py:118 get: target_dim(general.awesome)=variables DEBUG root:datastore.py:120 get: overwrite_lazy_data(general.awesome)=None DEBUG root:datastore.py:120 get: window_history_end(general.awesome)=None DEBUG root:datastore.py:118 get: interpolation_method(general.awesome)=linear DEBUG root:datastore.py:120 get: lazy_preprocessing(general.awesome)=None DEBUG root:datastore.py:120 get: extremes_on_right_tail_only(general.awesome)=None DEBUG root:datastore.py:118 get: time_dim(general.awesome)=datetime DEBUG root:datastore.py:118 get: start(general.awesome)=1997-01-01 DEBUG root:datastore.py:118 get: statistics_per_var(general.awesome)={'o3': 'dma8eu', 'temp': 'maximum'} DEBUG root:datastore.py:120 get: overwrite_local_data(general.awesome)=None DEBUG root:datastore.py:120 get: era5_file_names(general.awesome)=None DEBUG root:datastore.py:118 get: window_dim(general.awesome)=window DEBUG root:datastore.py:118 get: window_lead_time(general.awesome)=3 DEBUG root:datastore.py:120 get: min_length(general.awesome)=None DEBUG root:datastore.py:118 get: sampling(general.awesome)=daily DEBUG root:datastore.py:118 get: use_multiprocessing(general.awesome)=True DEBUG root:datastore.py:118 get: use_multiprocessing(general)=True DEBUG root:datastore.py:118 get: tmp_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/tmp DEBUG root:datastore.py:118 get: max_number_multiprocessing(general)=16 INFO root:pre_processing.py:296 use serial validate station approach DEBUG root:path_config.py:132 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:360 DEBW107: try to load local data from: /home/root/mlair/data/daily/DEBW107_o3_temp.nc DEBUG root:data_handler_single_station.py:364 DEBW107: loading finished INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:218 No extreme values given, skip multiply extremes INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:97 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBW107_awesome.pickle INFO root:pre_processing.py:303 ...finished: DEBW107 (50%) DEBUG root:path_config.py:132 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:360 DEBW013: try to load local data from: /home/root/mlair/data/daily/DEBW013_o3_temp.nc DEBUG root:data_handler_single_station.py:364 DEBW013: loading finished INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:218 No extreme values given, skip multiply extremes INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:97 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBW013_awesome.pickle INFO root:pre_processing.py:303 ...finished: DEBW013 (100%) INFO root:pre_processing.py:305 run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations (awesome). DEBUG root:datastore.py:118 set: stations(general.awesome)=['DEBW107', 'DEBW013'] DEBUG root:datastore.py:118 set: data_collection(general.awesome)=<mlair.data_handler.iterator.DataCollection object at 0x7f7d8c313700> DEBUG root:datastore.py:118 get: data_collection(general.awesome)=<mlair.data_handler.iterator.DataCollection object at 0x7f7d8c313700> DEBUG root:datastore.py:120 get: data_collection(general)=None DEBUG root:datastore.py:118 get: stations(general.awesome)=['DEBW107', 'DEBW013']
----------------------------Captured stderr teardown----------------------------
2023-06-30 10:35:10,211 - INFO: RunEnvironment finished after 0:00:02 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:10,211 - INFO: RunEnvironment finished after 0:00:02 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:10,211 - INFO: RunEnvironment finished after 0:00:02 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:10,211 - INFO: RunEnvironment finished after 0:00:02 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:10,211 - INFO: RunEnvironment finished after 0:00:02 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:14,203 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:14,203 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:14,203 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:14,203 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:14,203 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:14,227 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:14,227 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:14,227 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:14,227 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:14,227 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147]
-----------------------------Captured log teardown------------------------------
INFO root:run_environment.py:120 RunEnvironment finished after 0:00:02 (hh:mm:ss) DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_create_set_split_all_stations 9.99
------------------------------Captured stderr call------------------------------
2023-06-30 10:35:14,235 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 10:35:14,235 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 10:35:14,235 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 10:35:14,235 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 10:35:14,235 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 10:35:14,242 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:14,242 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:14,242 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:14,242 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:14,242 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:14,307 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:14,307 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:14,307 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:14,307 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:14,307 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:14,677 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:14,677 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:14,677 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:14,677 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:14,677 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:14,677 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:14,677 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:14,677 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:14,677 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:14,677 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,041 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:15,041 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:15,041 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:15,041 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:15,041 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:15,110 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,110 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,110 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,110 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,110 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,474 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,474 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,474 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,474 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,474 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,474 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,474 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,474 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,474 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,474 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,841 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:15,841 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:15,841 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:15,841 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:15,841 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:15,909 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,909 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,909 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,909 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:15,909 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:16,274 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:16,274 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:16,274 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:16,274 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:16,274 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:16,274 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:16,274 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:16,274 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:16,274 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:16,274 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:16,643 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:16,643 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:16,643 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:16,643 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:16,643 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:16,644 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:35:16,644 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:35:16,644 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:35:16,644 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:35:16,644 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:35:16,666 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:16,666 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:16,666 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:16,666 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:16,666 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:17,152 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:35:17,152 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:35:17,152 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:35:17,152 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:35:17,152 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:35:17,173 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:17,173 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:17,173 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:17,173 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:17,173 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:17,175 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:17,175 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:17,175 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:17,175 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:17,175 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:17,206 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:17,206 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:17,206 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:17,206 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:17,206 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:18,002 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:18,002 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:18,002 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:18,002 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:18,002 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:18,053 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:18,053 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:18,053 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:18,053 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:18,053 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:18,574 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:18,574 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:18,574 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:18,574 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:18,574 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:18,626 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:18,626 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:18,626 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:18,626 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:18,626 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:18,731 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:18,731 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:18,731 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:18,731 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:18,731 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:18,790 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:18,790 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:18,790 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:18,790 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:18,790 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:19,234 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:19,234 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:19,234 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:19,234 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:19,234 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:19,287 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:19,287 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:19,287 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:19,287 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:19,287 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:20,113 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:35:20,113 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:35:20,113 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:35:20,113 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:35:20,113 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:35:20,170 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:20,170 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:20,170 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:20,170 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:20,170 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:20,174 - INFO: setup_samples finished after 0:00:04 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:20,174 - INFO: setup_samples finished after 0:00:04 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:20,174 - INFO: setup_samples finished after 0:00:04 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:20,174 - INFO: setup_samples finished after 0:00:04 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:20,174 - INFO: setup_samples finished after 0:00:04 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:20,177 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 10:35:20,177 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 10:35:20,177 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 10:35:20,177 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 10:35:20,177 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 10:35:20,179 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:20,179 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:20,179 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:20,179 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:20,179 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:20,179 - INFO: run for 0:00:06 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (awesome). [pre_processing.py:validate_station:305] 2023-06-30 10:35:20,179 - INFO: run for 0:00:06 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (awesome). [pre_processing.py:validate_station:305] 2023-06-30 10:35:20,179 - INFO: run for 0:00:06 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (awesome). [pre_processing.py:validate_station:305] 2023-06-30 10:35:20,179 - INFO: run for 0:00:06 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (awesome). [pre_processing.py:validate_station:305] 2023-06-30 10:35:20,179 - INFO: run for 0:00:06 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (awesome). [pre_processing.py:validate_station:305]
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 get: stations(general.awesome)=['DEBW107', 'DEBW013', 'DEBW087', 'DEBW99X'] DEBUG root:datastore.py:118 get: use_all_stations_on_all_data_sets(general)=True DEBUG root:pre_processing.py:244 Awesome stations (len=4): ['DEBW107', 'DEBW013', 'DEBW087', 'DEBW99X'] DEBUG root:datastore.py:118 get: data_handler(general)=<class 'mlair.data_handler.default_data_handler.DefaultDataHandler'> INFO root:pre_processing.py:262 check valid stations started (awesome) DEBUG root:datastore.py:120 get: ifs_data_path(general.awesome)=None DEBUG root:datastore.py:118 get: data_origin(general.awesome)={'o3': 'UBA', 'temp': 'UBA'} DEBUG root:datastore.py:118 get: data_path(general.awesome)=/home/root/mlair/data/ DEBUG root:datastore.py:120 get: name_affix(general.awesome)=None DEBUG root:datastore.py:118 get: transformation(general.awesome)={} DEBUG root:datastore.py:118 get: interpolation_limit(general.awesome)=1 DEBUG root:datastore.py:120 get: era5_data_path(general.awesome)=None DEBUG root:datastore.py:118 get: experiment_path(general.awesome)=/builds/esde/machine-learning/mlair/TestExperiment_daily DEBUG root:datastore.py:120 get: ifs_file_names(general.awesome)=None DEBUG root:datastore.py:118 get: end(general.awesome)=2017-12-31 DEBUG root:datastore.py:120 get: store_processed_data(general.awesome)=None DEBUG root:datastore.py:120 get: store_data_locally(general.awesome)=None DEBUG root:datastore.py:118 get: max_number_multiprocessing(general.awesome)=16 DEBUG root:datastore.py:118 get: iter_dim(general.awesome)=Stations DEBUG root:datastore.py:118 get: variables(general.awesome)=['o3', 'temp'] DEBUG root:datastore.py:120 get: window_history_offset(general.awesome)=None DEBUG root:datastore.py:118 get: window_history_size(general.awesome)=13 DEBUG root:datastore.py:118 get: target_var(general.awesome)=o3 DEBUG root:datastore.py:120 get: extreme_values(general.awesome)=None DEBUG root:datastore.py:118 get: target_dim(general.awesome)=variables DEBUG root:datastore.py:120 get: overwrite_lazy_data(general.awesome)=None DEBUG root:datastore.py:120 get: window_history_end(general.awesome)=None DEBUG root:datastore.py:118 get: interpolation_method(general.awesome)=linear DEBUG root:datastore.py:120 get: lazy_preprocessing(general.awesome)=None DEBUG root:datastore.py:120 get: extremes_on_right_tail_only(general.awesome)=None DEBUG root:datastore.py:118 get: time_dim(general.awesome)=datetime DEBUG root:datastore.py:118 get: start(general.awesome)=1997-01-01 DEBUG root:datastore.py:118 get: statistics_per_var(general.awesome)={'o3': 'dma8eu', 'temp': 'maximum'} DEBUG root:datastore.py:120 get: overwrite_local_data(general.awesome)=None DEBUG root:datastore.py:120 get: era5_file_names(general.awesome)=None DEBUG root:datastore.py:118 get: window_dim(general.awesome)=window DEBUG root:datastore.py:118 get: window_lead_time(general.awesome)=3 DEBUG root:datastore.py:120 get: min_length(general.awesome)=None DEBUG root:datastore.py:118 get: sampling(general.awesome)=daily DEBUG root:datastore.py:118 get: use_multiprocessing(general.awesome)=True DEBUG root:datastore.py:118 get: use_multiprocessing(general)=True DEBUG root:datastore.py:118 get: tmp_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/tmp DEBUG root:datastore.py:118 get: max_number_multiprocessing(general)=16 INFO root:pre_processing.py:296 use serial validate station approach DEBUG root:path_config.py:132 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:360 DEBW107: try to load local data from: /home/root/mlair/data/daily/DEBW107_o3_temp.nc DEBUG root:data_handler_single_station.py:364 DEBW107: loading finished INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:218 No extreme values given, skip multiply extremes INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:97 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBW107_awesome.pickle INFO root:pre_processing.py:303 ...finished: DEBW107 (25%) DEBUG root:path_config.py:132 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:360 DEBW013: try to load local data from: /home/root/mlair/data/daily/DEBW013_o3_temp.nc DEBUG root:data_handler_single_station.py:364 DEBW013: loading finished INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:218 No extreme values given, skip multiply extremes INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:97 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBW013_awesome.pickle INFO root:pre_processing.py:303 ...finished: DEBW013 (50%) DEBUG root:path_config.py:132 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:360 DEBW087: try to load local data from: /home/root/mlair/data/daily/DEBW087_o3_temp.nc DEBUG root:data_handler_single_station.py:364 DEBW087: loading finished INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:218 No extreme values given, skip multiply extremes INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:97 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBW087_awesome.pickle INFO root:pre_processing.py:303 ...finished: DEBW087 (75%) DEBUG root:path_config.py:132 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:360 DEBW99X: try to load local data from: /home/root/mlair/data/daily/DEBW99X_o3_temp.nc DEBUG root:data_handler_single_station.py:366 DEBW99X: [Errno 2] No such file or directory: b'/home/root/mlair/data/daily/DEBW99X_o3_temp.nc' DEBUG root:data_handler_single_station.py:367 DEBW99X: load new data INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 DEBUG urllib3.connectionpool:connectionpool.py:1003 Starting new HTTPS connection (1): toar-data.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:456 https://toar-data.fz-juelich.de:443 "GET /api/v2/variables/o3 HTTP/1.1" 200 156 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp DEBUG urllib3.connectionpool:connectionpool.py:1003 Starting new HTTPS connection (1): toar-data.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:456 https://toar-data.fz-juelich.de:443 "GET /api/v2/variables/temp HTTP/1.1" 200 161 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X DEBUG urllib3.connectionpool:connectionpool.py:1003 Starting new HTTPS connection (1): toar-data.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:456 https://toar-data.fz-juelich.de:443 "GET /api/v2/stationmeta/DEBW99X HTTP/1.1" 404 54 DEBUG root:data_loader.py:159 There was an error (STATUS 404) for request https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X DEBUG urllib3.connectionpool:connectionpool.py:1003 Starting new HTTPS connection (1): toar-data.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:456 https://toar-data.fz-juelich.de:443 "GET /api/v2/stationmeta/DEBW99X HTTP/1.1" 404 54 DEBUG root:data_loader.py:159 There was an error (STATUS 404) for request https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X DEBUG urllib3.connectionpool:connectionpool.py:1003 Starting new HTTPS connection (1): toar-data.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:456 https://toar-data.fz-juelich.de:443 "GET /api/v2/stationmeta/DEBW99X HTTP/1.1" 404 54 DEBUG root:data_loader.py:159 There was an error (STATUS 404) for request https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X DEBUG urllib3.connectionpool:connectionpool.py:1003 Starting new HTTPS connection (1): toar-data.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:456 https://toar-data.fz-juelich.de:443 "GET /api/v2/stationmeta/DEBW99X HTTP/1.1" 404 54 DEBUG root:data_loader.py:159 There was an error (STATUS 404) for request https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X DEBUG urllib3.connectionpool:connectionpool.py:1003 Starting new HTTPS connection (1): toar-data.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:456 https://toar-data.fz-juelich.de:443 "GET /api/v2/stationmeta/DEBW99X HTTP/1.1" 404 54 DEBUG root:data_loader.py:159 There was an error (STATUS 404) for request https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute DEBUG urllib3.connectionpool:connectionpool.py:1003 Starting new HTTPS connection (1): join.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:456 https://join.fz-juelich.de:443 "GET /services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute HTTP/1.1" 200 2 INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) DEBUG root:join.py:218 ['DEBW99X']: [] INFO root:time_tracking.py:137 setup_samples finished after 0:00:04 (hh:mm:ss) INFO root:pre_processing.py:489 remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( DEBUG root:pre_processing.py:491 detailed information for removal of station DEBW99X: Traceback (most recent call last): File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/file_manager.py", line 199, in _acquire_with_cache_info file = self._cache[self._key] File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/lru_cache.py", line 53, in __getitem__ value = self._cache[key] KeyError: [<class 'netCDF4._netCDF4.Dataset'>, ('/home/root/mlair/data/daily/DEBW99X_o3_temp.nc',), 'r', (('clobber', True), ('diskless', False), ('format', 'NETCDF4'), ('persist', False))] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 361, in load_data data = xr.open_dataarray(file_name) File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/api.py", line 701, in open_dataarray dataset = open_dataset( File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/api.py", line 572, in open_dataset store = opener(filename_or_obj, **extra_kwargs, **backend_kwargs) File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/netCDF4_.py", line 364, in open return cls(manager, group=group, mode=mode, lock=lock, autoclose=autoclose) File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/netCDF4_.py", line 314, in __init__ self.format = self.ds.data_model File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/netCDF4_.py", line 373, in ds return self._acquire() File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/netCDF4_.py", line 367, in _acquire with self._manager.acquire_context(needs_lock) as root: File "/usr/lib64/python3.9/contextlib.py", line 119, in __enter__ return next(self.gen) File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/file_manager.py", line 187, in acquire_context file, cached = self._acquire_with_cache_info(needs_lock) File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/file_manager.py", line 205, in _acquire_with_cache_info file = self._opener(*self._args, **kwargs) File "src/netCDF4/_netCDF4.pyx", line 2353, in netCDF4._netCDF4.Dataset.__init__ File "src/netCDF4/_netCDF4.pyx", line 1963, in netCDF4._netCDF4._ensure_nc_success FileNotFoundError: [Errno 2] No such file or directory: b'/home/root/mlair/data/daily/DEBW99X_o3_temp.nc' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/builds/esde/machine-learning/mlair/mlair/run_modules/pre_processing.py", line 486, in f_proc res = data_handler.build(station, name_affix=name_affix, store_processed_data=store, **kwargs) File "/builds/esde/machine-learning/mlair/mlair/data_handler/default_data_handler.py", line 72, in build sp = cls.data_handler(station, **sp_keys) File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 125, in __init__ self.setup_samples() File "/builds/esde/machine-learning/mlair/mlair/helpers/time_tracking.py", line 40, in __call__ return self.__wrapped__(*args, **kwargs) File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 271, in setup_samples self.make_input_target() File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 312, in make_input_target data, self.meta = self.load_data(self.path, self.station, stats_per_var, self.sampling, File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 368, in load_data data, meta = data_sources.download_data(file_name, meta_file, station, statistics_per_var, sampling, File "/builds/esde/machine-learning/mlair/mlair/helpers/data_sources/data_loader.py", line 69, in download_data df_toar, meta_toar = data_sources.toar_data.download_toar(station=station, toar_stats=toar_stats, File "/builds/esde/machine-learning/mlair/mlair/helpers/data_sources/toar_data.py", line 33, in download_toar xarr_merged = xr.DataArray(df_merged, dims=[time_dim, target_dim]) File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 403, in __init__ coords, dims = _infer_coords_and_dims(data.shape, coords, dims) File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims raise ValueError( ValueError: different number of dimensions on data and dims: 0 vs 2 INFO root:pre_processing.py:303 ...finished: DEBW99X (100%) INFO root:pre_processing.py:305 run for 0:00:06 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (awesome). DEBUG root:datastore.py:118 set: stations(general.awesome)=['DEBW107', 'DEBW013', 'DEBW087'] DEBUG root:datastore.py:118 set: data_collection(general.awesome)=<mlair.data_handler.iterator.DataCollection object at 0x7f7d26de3730> DEBUG root:datastore.py:118 get: data_collection(general.awesome)=<mlair.data_handler.iterator.DataCollection object at 0x7f7d26de3730> DEBUG root:datastore.py:120 get: data_collection(general)=None DEBUG root:datastore.py:118 get: stations(general.awesome)=['DEBW107', 'DEBW013', 'DEBW087']
----------------------------Captured stderr teardown----------------------------
2023-06-30 10:35:20,184 - INFO: RunEnvironment finished after 0:00:06 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:20,184 - INFO: RunEnvironment finished after 0:00:06 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:20,184 - INFO: RunEnvironment finished after 0:00:06 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:20,184 - INFO: RunEnvironment finished after 0:00:06 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:20,184 - INFO: RunEnvironment finished after 0:00:06 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:24,198 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:24,198 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:24,198 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:24,198 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:24,198 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:24,223 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:24,223 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:24,223 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:24,223 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:24,223 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147]
-----------------------------Captured log teardown------------------------------
INFO root:run_environment.py:120 RunEnvironment finished after 0:00:06 (hh:mm:ss) DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_validate_station_serial[None] 10.68
------------------------------Captured stderr call------------------------------
2023-06-30 10:35:24,231 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 10:35:24,231 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 10:35:24,231 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 10:35:24,231 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 10:35:24,231 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 10:35:24,235 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:24,235 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:24,235 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:24,235 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:24,235 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:24,301 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:24,301 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:24,301 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:24,301 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:24,301 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:24,691 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:24,691 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:24,691 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:24,691 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:24,691 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:24,691 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:24,691 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:24,691 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:24,691 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:24,691 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,071 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:25,071 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:25,071 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:25,071 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:25,071 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:25,154 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,154 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,154 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,154 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,154 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,536 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,536 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,536 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,536 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,536 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,536 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,536 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,536 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,536 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,536 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,921 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:25,921 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:25,921 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:25,921 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:25,921 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:25,996 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,996 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,996 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,996 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:25,996 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:26,377 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:26,377 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:26,377 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:26,377 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:26,377 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:26,377 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:26,377 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:26,377 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:26,377 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:26,377 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:26,759 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:26,759 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:26,759 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:26,759 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:26,759 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:26,917 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:35:26,917 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:35:26,917 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:35:26,917 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:35:26,917 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:35:26,941 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:26,941 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:26,941 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:26,941 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:26,941 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:27,934 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:35:27,934 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:35:27,934 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:35:27,934 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:35:27,934 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:35:27,971 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:27,971 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:27,971 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:27,971 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:27,971 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:28,169 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:28,169 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:28,169 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:28,169 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:28,169 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:28,219 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:28,219 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:28,219 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:28,219 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:28,219 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:28,311 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:28,311 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:28,311 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:28,311 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:28,311 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:28,361 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:28,361 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:28,361 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:28,361 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:28,361 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:28,827 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:28,827 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:28,827 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:28,827 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:28,827 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:28,878 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:28,878 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:28,878 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:28,878 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:28,878 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:29,628 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:29,628 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:29,628 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:29,628 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:29,628 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:29,684 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:29,684 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:29,684 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:29,684 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:29,684 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:29,871 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:29,871 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:29,871 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:29,871 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:29,871 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:29,925 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:29,925 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:29,925 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:29,925 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:29,925 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:30,772 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:35:30,772 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:35:30,772 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:35:30,772 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:35:30,772 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:35:30,831 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:30,831 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:30,831 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:30,831 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:30,831 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:30,835 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:30,835 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:30,835 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:30,835 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:30,835 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:30,837 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 10:35:30,837 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 10:35:30,837 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 10:35:30,837 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 10:35:30,837 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 10:35:30,839 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:30,839 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:30,839 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:30,839 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:30,839 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:30,840 - INFO: run for 0:00:07 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305] 2023-06-30 10:35:30,840 - INFO: run for 0:00:07 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305] 2023-06-30 10:35:30,840 - INFO: run for 0:00:07 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305] 2023-06-30 10:35:30,840 - INFO: run for 0:00:07 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305] 2023-06-30 10:35:30,840 - INFO: run for 0:00:07 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305]
-------------------------------Captured log call--------------------------------
INFO root:pre_processing.py:262 check valid stations started (all) INFO root:pre_processing.py:296 use serial validate station approach INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW107 (25%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW013 (50%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW087 (75%) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 setup_samples finished after 0:00:05 (hh:mm:ss) INFO root:pre_processing.py:489 remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( INFO root:pre_processing.py:303 ...finished: DEBW99X (100%) INFO root:pre_processing.py:305 run for 0:00:07 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None).
----------------------------Captured stderr teardown----------------------------
2023-06-30 10:35:30,844 - INFO: RunEnvironment finished after 0:00:07 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:30,844 - INFO: RunEnvironment finished after 0:00:07 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:30,844 - INFO: RunEnvironment finished after 0:00:07 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:30,844 - INFO: RunEnvironment finished after 0:00:07 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:30,844 - INFO: RunEnvironment finished after 0:00:07 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:34,887 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:34,887 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:34,887 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:34,887 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:34,887 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:34,913 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:34,913 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:34,913 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:34,913 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:34,913 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147]
-----------------------------Captured log teardown------------------------------
INFO root:run_environment.py:120 RunEnvironment finished after 0:00:07 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_validate_station_serial[tester] 12.71
------------------------------Captured stderr call------------------------------
2023-06-30 10:35:34,922 - INFO: check valid stations started (tester) [pre_processing.py:validate_station:262] 2023-06-30 10:35:34,922 - INFO: check valid stations started (tester) [pre_processing.py:validate_station:262] 2023-06-30 10:35:34,922 - INFO: check valid stations started (tester) [pre_processing.py:validate_station:262] 2023-06-30 10:35:34,922 - INFO: check valid stations started (tester) [pre_processing.py:validate_station:262] 2023-06-30 10:35:34,922 - INFO: check valid stations started (tester) [pre_processing.py:validate_station:262] 2023-06-30 10:35:34,926 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:34,926 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:34,926 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:34,926 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:34,926 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 10:35:34,994 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:34,994 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:34,994 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:34,994 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:34,994 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:35,402 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:35,402 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:35,402 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:35,402 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:35,402 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:35,402 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:35,402 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:35,402 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:35,402 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:35,402 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:35,797 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:35,797 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:35,797 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:35,797 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:35,797 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:35,868 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:35,868 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:35,868 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:35,868 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:35,868 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:36,261 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:36,261 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:36,261 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:36,261 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:36,261 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:36,261 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:36,261 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:36,261 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:36,261 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:36,261 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:36,658 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:36,658 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:36,658 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:36,658 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:36,658 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:36,728 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:36,728 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:36,728 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:36,728 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:36,728 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:37,123 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:37,123 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:37,123 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:37,123 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:37,123 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:37,123 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:37,123 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:37,123 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:37,123 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:37,123 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:37,520 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:37,520 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:37,520 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:37,520 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:37,520 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:37,615 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:35:37,615 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:35:37,615 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:35:37,615 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:35:37,615 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 10:35:37,636 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:37,636 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:37,636 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:37,636 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:37,636 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:38,515 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:35:38,515 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:35:38,515 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:35:38,515 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:35:38,515 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 10:35:38,544 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:38,544 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:38,544 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:38,544 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:38,544 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:39,437 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:39,437 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:39,437 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:39,437 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:39,437 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:39,487 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:39,487 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:39,487 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:39,487 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:39,487 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:40,024 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:40,024 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:40,024 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:40,024 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:40,024 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:40,074 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:40,074 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:40,074 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:40,074 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:40,074 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:40,929 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:40,929 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:40,929 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:40,929 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:40,929 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:40,981 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:40,981 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:40,981 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:40,981 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:40,981 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:41,203 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:41,203 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:41,203 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:41,203 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:41,203 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:41,254 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:41,254 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:41,254 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:41,254 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:41,254 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:41,934 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:41,934 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:41,934 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:41,934 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:41,934 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 10:35:41,994 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:41,994 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:41,994 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:41,994 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:41,994 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:42,984 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:35:42,984 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:35:42,984 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:35:42,984 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:35:42,984 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 10:35:43,043 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:43,043 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:43,043 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:43,043 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:43,043 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:43,046 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:43,046 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:43,046 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:43,046 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:43,046 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 10:35:43,048 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 10:35:43,048 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 10:35:43,048 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 10:35:43,048 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 10:35:43,048 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 10:35:43,050 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:43,050 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:43,050 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:43,050 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:43,050 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 10:35:43,051 - INFO: run for 0:00:09 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (tester). [pre_processing.py:validate_station:305] 2023-06-30 10:35:43,051 - INFO: run for 0:00:09 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (tester). [pre_processing.py:validate_station:305] 2023-06-30 10:35:43,051 - INFO: run for 0:00:09 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (tester). [pre_processing.py:validate_station:305] 2023-06-30 10:35:43,051 - INFO: run for 0:00:09 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (tester). [pre_processing.py:validate_station:305] 2023-06-30 10:35:43,051 - INFO: run for 0:00:09 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (tester). [pre_processing.py:validate_station:305]
-------------------------------Captured log call--------------------------------
INFO root:pre_processing.py:262 check valid stations started (tester) INFO root:pre_processing.py:296 use serial validate station approach INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW107 (25%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW013 (50%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW087 (75%) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 setup_samples finished after 0:00:06 (hh:mm:ss) INFO root:pre_processing.py:489 remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( INFO root:pre_processing.py:303 ...finished: DEBW99X (100%) INFO root:pre_processing.py:305 run for 0:00:09 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (tester).
----------------------------Captured stderr teardown----------------------------
2023-06-30 10:35:43,054 - INFO: RunEnvironment finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:43,054 - INFO: RunEnvironment finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:43,054 - INFO: RunEnvironment finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:43,054 - INFO: RunEnvironment finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:43,054 - INFO: RunEnvironment finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:47,598 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:47,598 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:47,598 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:47,598 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:47,598 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:47,625 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:47,625 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:47,625 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:47,625 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:47,625 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147]
-----------------------------Captured log teardown------------------------------
INFO root:run_environment.py:120 RunEnvironment finished after 0:00:09 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_validate_station_parallel 11.97
------------------------------Captured stderr call------------------------------
2023-06-30 10:35:47,635 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 10:35:47,635 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 10:35:47,635 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 10:35:47,635 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 10:35:47,635 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 10:35:47,638 - INFO: use parallel validate station approach [pre_processing.py:validate_station:277] 2023-06-30 10:35:47,638 - INFO: use parallel validate station approach [pre_processing.py:validate_station:277] 2023-06-30 10:35:47,638 - INFO: use parallel validate station approach [pre_processing.py:validate_station:277] 2023-06-30 10:35:47,638 - INFO: use parallel validate station approach [pre_processing.py:validate_station:277] 2023-06-30 10:35:47,638 - INFO: use parallel validate station approach [pre_processing.py:validate_station:277] 2023-06-30 10:35:47,638 - INFO: running 3 processes in parallel [pre_processing.py:validate_station:279] 2023-06-30 10:35:47,638 - INFO: running 3 processes in parallel [pre_processing.py:validate_station:279] 2023-06-30 10:35:47,638 - INFO: running 3 processes in parallel [pre_processing.py:validate_station:279] 2023-06-30 10:35:47,638 - INFO: running 3 processes in parallel [pre_processing.py:validate_station:279] 2023-06-30 10:35:47,638 - INFO: running 3 processes in parallel [pre_processing.py:validate_station:279] 2023-06-30 10:35:48,212 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:48,212 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:48,212 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:48,212 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:48,212 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:48,216 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:48,216 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:48,216 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:48,216 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:48,216 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:48,220 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:48,220 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:48,220 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:48,220 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:48,220 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:55,133 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:55,133 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:55,133 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:55,133 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:55,133 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:286] 2023-06-30 10:35:55,164 - INFO: run for 0:00:08 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305] 2023-06-30 10:35:55,164 - INFO: run for 0:00:08 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305] 2023-06-30 10:35:55,164 - INFO: run for 0:00:08 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305] 2023-06-30 10:35:55,164 - INFO: run for 0:00:08 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305] 2023-06-30 10:35:55,164 - INFO: run for 0:00:08 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305]
-------------------------------Captured log call--------------------------------
INFO root:pre_processing.py:262 check valid stations started (all) INFO root:pre_processing.py:277 use parallel validate station approach INFO root:pre_processing.py:279 running 3 processes in parallel INFO root:pre_processing.py:286 ...finished: DEBW107 (25%) INFO root:pre_processing.py:286 ...finished: DEBW013 (50%) INFO root:pre_processing.py:286 ...finished: DEBW087 (75%) INFO root:pre_processing.py:286 ...finished: DEBW99X (100%) INFO root:pre_processing.py:305 run for 0:00:08 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None).
----------------------------Captured stderr teardown----------------------------
2023-06-30 10:35:55,166 - INFO: RunEnvironment finished after 0:00:08 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:55,166 - INFO: RunEnvironment finished after 0:00:08 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:55,166 - INFO: RunEnvironment finished after 0:00:08 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:55,166 - INFO: RunEnvironment finished after 0:00:08 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:55,166 - INFO: RunEnvironment finished after 0:00:08 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:35:59,572 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:59,572 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:59,572 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:59,572 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:59,572 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json [run_environment.py:__save_tracking:159] 2023-06-30 10:35:59,601 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:59,601 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:59,601 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:59,601 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:35:59,601 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147]
-----------------------------Captured log teardown------------------------------
INFO root:run_environment.py:120 RunEnvironment finished after 0:00:08 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_split_set_indices 4.20
No log output captured.
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_transformation 0.00
No log output captured.
Passed test/test_run_modules/test_run_environment.py::TestRunEnvironment::test_enter 4.78
------------------------------Captured stderr call------------------------------
2023-06-30 10:36:03,820 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:03,820 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:03,820 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:03,820 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:03,820 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:03,820 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:03,820 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:03,820 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:03,820 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:03,820 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:08,576 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:08,576 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:08,576 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:08,576 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:08,576 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:08,604 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:36:08,604 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:36:08,604 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:36:08,604 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:36:08,604 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:120 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/logging_000.log
Passed test/test_run_modules/test_run_environment.py::TestRunEnvironment::test_exit 4.35
------------------------------Captured stderr call------------------------------
2023-06-30 10:36:08,606 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:08,606 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:08,606 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:08,606 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:08,606 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:08,707 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:08,707 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:08,707 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:08,707 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:08,707 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:12,929 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:12,929 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:12,929 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:12,929 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:12,929 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:12,957 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:36:12,957 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:36:12,957 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:36:12,957 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:36:12,957 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:120 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/logging_000.log
Passed test/test_run_modules/test_run_environment.py::TestRunEnvironment::test_init 4.23
------------------------------Captured stderr call------------------------------
2023-06-30 10:36:12,960 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:12,960 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:12,960 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:12,960 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:12,960 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:12,960 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:12,960 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:12,960 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:12,960 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:12,960 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:17,164 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:17,164 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:17,164 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:17,164 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:17,164 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:17,192 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:36:17,192 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:36:17,192 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:36:17,192 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:36:17,192 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:120 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/logging_000.log
Passed test/test_run_modules/test_run_environment.py::TestRunEnvironment::test_del 4.44
------------------------------Captured stderr call------------------------------
2023-06-30 10:36:17,194 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:17,194 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:17,194 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:17,194 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:17,194 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:36:17,395 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:17,395 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:17,395 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:17,395 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:17,395 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:36:21,610 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:21,610 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:21,610 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:21,610 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:21,610 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 10:36:21,638 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:36:21,638 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:36:21,638 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:36:21,638 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:36:21,638 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:120 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/logging_000.log
Passed test/test_run_modules/test_training.py::TestTraining::test_init 27.79
-----------------------------Captured stdout setup------------------------------
Model: "model_8" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_33 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_2 (Flatten) (None, 16) 0 _________________________________________________________________ dense_9 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_10 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
------------------------------Captured stdout call------------------------------
Epoch 1/2 13/13 - 1s - loss: 21.9214 - val_loss: 11.6813 Epoch 2/2 13/13 - 0s - loss: 14.1813 - val_loss: 9.1270
------------------------------Captured stderr call------------------------------
2023-06-30 10:36:47.555112: W tensorflow/python/util/util.cc:348] Sets are not currently considered sequences, but this may change in the future, so consider avoiding using them.
Passed test/test_run_modules/test_training.py::TestTraining::test_no_training 29.24
-----------------------------Captured stdout setup------------------------------
Model: "model_9" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_34 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_3 (Flatten) (None, 16) 0 _________________________________________________________________ dense_11 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_12 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
------------------------------Captured stderr call------------------------------
2023-06-30 10:37:18,677 - INFO: Training started [run_environment.py:__init__:103] 2023-06-30 10:37:18,677 - INFO: Training started [run_environment.py:__init__:103] 2023-06-30 10:37:18,677 - INFO: Training started [run_environment.py:__init__:103] 2023-06-30 10:37:18,677 - INFO: Training started [run_environment.py:__init__:103] 2023-06-30 10:37:18,677 - INFO: Training started [run_environment.py:__init__:103] 2023-06-30 10:37:18,678 - INFO: No training has started, because train_model parameter was false. [training.py:_run:92] 2023-06-30 10:37:18,678 - INFO: No training has started, because train_model parameter was false. [training.py:_run:92] 2023-06-30 10:37:18,678 - INFO: No training has started, because train_model parameter was false. [training.py:_run:92] 2023-06-30 10:37:18,678 - INFO: No training has started, because train_model parameter was false. [training.py:_run:92] 2023-06-30 10:37:18,678 - INFO: No training has started, because train_model parameter was false. [training.py:_run:92] 2023-06-30 10:37:18,679 - INFO: Training finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:37:18,679 - INFO: Training finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:37:18,679 - INFO: Training finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:37:18,679 - INFO: Training finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:37:18,679 - INFO: Training finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 Training started INFO root:training.py:92 No training has started, because train_model parameter was false. INFO root:run_environment.py:120 Training finished after 0:00:01 (hh:mm:ss)
Passed test/test_run_modules/test_training.py::TestTraining::test_run 31.00
-----------------------------Captured stdout setup------------------------------
Model: "model_10" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_35 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_4 (Flatten) (None, 16) 0 _________________________________________________________________ dense_13 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_14 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
------------------------------Captured stdout call------------------------------
Epoch 1/2 13/13 - 1s - loss: 2740.8828 - mse: 305.2979 - mae: 13.9014 - var_loss: 5176.4678 - val_loss: 3001.5547 - val_mse: 238.4157 - val_mae: 12.4464 - val_var_loss: 5764.6948 Epoch 2/2 13/13 - 0s - loss: 3068.6042 - mse: 240.3857 - mae: 12.4226 - var_loss: 5896.8228 - val_loss: 1201.6556 - val_mse: 244.9952 - val_mae: 12.5542 - val_var_loss: 2158.3159
Passed test/test_run_modules/test_training.py::TestTraining::test_make_predict_function 4.44
-----------------------------Captured stdout setup------------------------------
Model: "model_11" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_36 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_5 (Flatten) (None, 16) 0 _________________________________________________________________ dense_15 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_16 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_training.py::TestTraining::test_set_gen 4.72
-----------------------------Captured stdout setup------------------------------
Model: "model_12" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_37 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_6 (Flatten) (None, 16) 0 _________________________________________________________________ dense_17 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_18 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_training.py::TestTraining::test_set_generators 4.51
-----------------------------Captured stdout setup------------------------------
Model: "model_13" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_38 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_7 (Flatten) (None, 16) 0 _________________________________________________________________ dense_19 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_20 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_training.py::TestTraining::test_train 30.78
-----------------------------Captured stdout setup------------------------------
Model: "model_14" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_39 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_8 (Flatten) (None, 16) 0 _________________________________________________________________ dense_21 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_22 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
------------------------------Captured stdout call------------------------------
Epoch 1/2 13/13 - 0s - loss: 20.7856 - val_loss: 26.7898 Epoch 2/2 13/13 - 0s - loss: 17.5036 - val_loss: 17.8294
Passed test/test_run_modules/test_training.py::TestTraining::test_save_model 5.22
-----------------------------Captured stdout setup------------------------------
Model: "model_15" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_40 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_9 (Flatten) (None, 16) 0 _________________________________________________________________ dense_23 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_24 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
------------------------------Captured stderr call------------------------------
2023-06-30 10:38:38,694 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:38:38,694 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:38:38,694 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:38:38,694 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:38:38,694 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:38:38,702 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:38:38,702 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:38:38,702 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:38:38,702 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:38:38,702 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313]
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 get: model_name(general.model)=/builds/esde/machine-learning/mlair/test/test_run_modules/TestExperiment/model/test_model.h5 DEBUG root:training.py:188 save model to /builds/esde/machine-learning/mlair/test/test_run_modules/TestExperiment/model/test_model.h5 WARNING tensorflow:saving_utils.py:313 Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. WARNING tensorflow:saving_utils.py:313 Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. DEBUG root:datastore.py:118 set: model(general)=<mlair.model_modules.fully_connected_networks.FCN object at 0x7f7d1e80f280>
Passed test/test_run_modules/test_training.py::TestTraining::test_save_callbacks_history_created 4.62
-----------------------------Captured stdout setup------------------------------
Model: "model_16" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_41 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_10 (Flatten) (None, 16) 0 _________________________________________________________________ dense_25 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_26 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_training.py::TestTraining::test_save_callbacks_lr_created 4.86
-----------------------------Captured stdout setup------------------------------
Model: "model_17" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_42 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_11 (Flatten) (None, 16) 0 _________________________________________________________________ dense_27 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_28 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_training.py::TestTraining::test_save_callbacks_inspect_history 4.59
-----------------------------Captured stdout setup------------------------------
Model: "model_18" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_43 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_12 (Flatten) (None, 16) 0 _________________________________________________________________ dense_29 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_30 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_training.py::TestTraining::test_save_callbacks_inspect_lr 4.89
-----------------------------Captured stdout setup------------------------------
Model: "model_19" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_44 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_13 (Flatten) (None, 16) 0 _________________________________________________________________ dense_31 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_32 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_training.py::TestTraining::test_create_monitoring_plots 5.02
-----------------------------Captured stdout setup------------------------------
Model: "model_20" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_45 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_14 (Flatten) (None, 16) 0 _________________________________________________________________ dense_33 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_34 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_training.py::TestTraining::test_resume_training1 32.71
------------------------------Captured stdout call------------------------------
Model: "model_21" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_46 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_15 (Flatten) (None, 16) 0 _________________________________________________________________ dense_35 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_36 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None Epoch 1/4 13/13 - 1s - loss: 7312.2021 - mse: 226.6378 - mae: 11.8271 - var_loss: 14397.7646 - val_loss: 647.5741 - val_mse: 206.5503 - val_mae: 11.3717 - val_var_loss: 1088.5979 Epoch 2/4 13/13 - 0s - loss: 1039.6401 - mse: 187.7998 - mae: 10.7468 - var_loss: 1891.4806 - val_loss: 910.6807 - val_mse: 219.9926 - val_mae: 11.7427 - val_var_loss: 1601.3687 Epoch 3/4 13/13 - 0s - loss: 867.0977 - mse: 187.6640 - mae: 10.7285 - var_loss: 1546.5312 - val_loss: 438.2486 - val_mse: 177.5955 - val_mae: 10.3448 - val_var_loss: 698.9017 Epoch 4/4 13/13 - 0s - loss: 515.5302 - mse: 171.5455 - mae: 10.1860 - var_loss: 859.5148 - val_loss: 264.0354 - val_mse: 165.5191 - val_mae: 10.0200 - val_var_loss: 362.5516 Model: "model_22" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_47 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_16 (Flatten) (None, 16) 0 _________________________________________________________________ dense_37 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_38 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None Epoch 5/8 13/13 - 1s - loss: 382.0135 - mse: 167.4280 - mae: 10.1917 - var_loss: 596.5991 - val_loss: 1176.3452 - val_mse: 203.8989 - val_mae: 11.3340 - val_var_loss: 2148.7913 Epoch 6/8 13/13 - 0s - loss: 459.5804 - mse: 182.5315 - mae: 10.6003 - var_loss: 736.6295 - val_loss: 338.4073 - val_mse: 200.0312 - val_mae: 11.1227 - val_var_loss: 476.7834 Epoch 7/8 13/13 - 0s - loss: 783.4121 - mse: 203.6616 - mae: 11.2611 - var_loss: 1363.1622 - val_loss: 1543.6719 - val_mse: 167.0974 - val_mae: 10.2164 - val_var_loss: 2920.2463 Epoch 8/8 13/13 - 0s - loss: 1544.7994 - mse: 183.1665 - mae: 10.5575 - var_loss: 2906.4324 - val_loss: 195.3476 - val_mse: 163.6788 - val_mae: 10.1129 - val_var_loss: 227.0164
------------------------------Captured stderr call------------------------------
2023-06-30 10:39:37.577428: W tensorflow/core/util/tensor_slice_reader.cc:95] Could not open /builds/esde/machine-learning/mlair/test/test_run_modules/TestExperiment/model_checkpoint: Failed precondition: /builds/esde/machine-learning/mlair/test/test_run_modules/TestExperiment/model_checkpoint; Is a directory: perhaps your file is in a different file format and you need to use a different restore operator?
Passed test/test_workflows/test_abstract_workflow.py::TestWorkflow::test_init 0.00
No log output captured.
Passed test/test_workflows/test_abstract_workflow.py::TestWorkflow::test_add 0.00
No log output captured.
Passed test/test_workflows/test_abstract_workflow.py::TestWorkflow::test_run 5.69
------------------------------Captured stderr call------------------------------
2023-06-30 10:39:40,642 - INFO: Workflow started [run_environment.py:__init__:103] 2023-06-30 10:39:40,642 - INFO: Workflow started [run_environment.py:__init__:103] 2023-06-30 10:39:40,642 - INFO: Workflow started [run_environment.py:__init__:103] 2023-06-30 10:39:40,642 - INFO: Workflow started [run_environment.py:__init__:103] 2023-06-30 10:39:40,642 - INFO: Workflow started [run_environment.py:__init__:103] 2023-06-30 10:39:40,643 - INFO: 6 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:39:40,643 - INFO: 6 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:39:40,643 - INFO: 6 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:39:40,643 - INFO: 6 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:39:40,643 - INFO: 6 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:39:40,644 - INFO: 2 [test_abstract_workflow.py:__init__:42] 2023-06-30 10:39:40,644 - INFO: 2 [test_abstract_workflow.py:__init__:42] 2023-06-30 10:39:40,644 - INFO: 2 [test_abstract_workflow.py:__init__:42] 2023-06-30 10:39:40,644 - INFO: 2 [test_abstract_workflow.py:__init__:42] 2023-06-30 10:39:40,644 - INFO: 2 [test_abstract_workflow.py:__init__:42] 2023-06-30 10:39:40,644 - INFO: 3 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:39:40,644 - INFO: 3 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:39:40,644 - INFO: 3 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:39:40,644 - INFO: 3 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:39:40,644 - INFO: 3 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:39:40,644 - INFO: Workflow finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:39:40,644 - INFO: Workflow finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:39:40,644 - INFO: Workflow finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:39:40,644 - INFO: Workflow finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:39:40,644 - INFO: Workflow finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:39:45,344 - INFO: Training finished after 0:00:13 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:39:45,344 - INFO: Training finished after 0:00:13 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:39:45,344 - INFO: Training finished after 0:00:13 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:39:45,344 - INFO: Training finished after 0:00:13 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:39:45,344 - INFO: Training finished after 0:00:13 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:39:45,344 - INFO: Training finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:39:45,344 - INFO: Training finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:39:45,344 - INFO: Training finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:39:45,344 - INFO: Training finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:39:45,344 - INFO: Training finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:39:46,302 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:39:46,302 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:39:46,302 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:39:46,302 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:39:46,302 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:39:46,333 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:39:46,333 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:39:46,333 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:39:46,333 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:39:46,333 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 Workflow started INFO root:test_abstract_workflow.py:37 6 INFO root:test_abstract_workflow.py:42 2 INFO root:test_abstract_workflow.py:37 3 INFO root:run_environment.py:120 Workflow finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:120 Training finished after 0:00:13 (hh:mm:ss) INFO root:run_environment.py:120 Training finished after 0:00:09 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/logging_000.log
Passed test/test_workflows/test_default_workflow.py::TestDefaultWorkflow::test_init_no_args 0.00
No log output captured.
Passed test/test_workflows/test_default_workflow.py::TestDefaultWorkflow::test_init_with_args 0.00
No log output captured.
Passed test/test_workflows/test_default_workflow.py::TestDefaultWorkflow::test_init_with_kwargs 0.00
No log output captured.
Passed test/test_workflows/test_default_workflow.py::TestDefaultWorkflow::test_setup 0.00
No log output captured.
Passed test/test_workflows/test_default_workflow.py::TestDefaultWorkflowHPC::test_setup 0.01
No log output captured.