report.html

Report generated on 30-Jun-2023 at 10:03:47 by pytest-html v3.1.1

Environment

CI true
CI_COMMIT_REF_NAME master
CI_COMMIT_REF_SLUG master
CI_COMMIT_SHA 6d534b35334455a2e5afb72ec95c406940352a5f
CI_JOB_ID 853972
CI_JOB_NAME tests
CI_JOB_STAGE test
CI_PIPELINE_ID 144635
CI_PROJECT_DIR /builds/esde/machine-learning/mlair
CI_PROJECT_ID 2411
CI_PROJECT_NAME mlair
CI_PROJECT_NAMESPACE esde/machine-learning
CI_PROJECT_PATH esde/machine-learning/mlair
CI_PROJECT_URL https://gitlab.jsc.fz-juelich.de/esde/machine-learning/mlair
CI_REGISTRY registry.jsc.fz-juelich.de
CI_REGISTRY_IMAGE registry.jsc.fz-juelich.de/esde/machine-learning/mlair
CI_REGISTRY_USER gitlab-ci-token
CI_RUNNER_DESCRIPTION gitlab-runner on zam347 with already installed requirements of MLAir using opensuse/leap
CI_RUNNER_ID 657
CI_RUNNER_TAGS ["leap", "opensuse", "zam347", "mlair", "machinelearningtools"]
CI_SERVER yes
CI_SERVER_NAME GitLab
CI_SERVER_REVISION 9ce736bb2cd
CI_SERVER_VERSION 16.1.1
GITLAB_CI true
GITLAB_USER_EMAIL l.leufen@fz-juelich.de
GITLAB_USER_ID 659
Packages {"pluggy": "0.13.1", "py": "1.11.0", "pytest": "6.2.2"}
Platform Linux-5.15.0-73-generic-x86_64-with-glibc2.31
Plugins {"cov": "2.11.1", "html": "3.1.1", "lazy-fixture": "0.6.3", "metadata": "2.0.1"}
Python 3.9.13

Summary

578 tests ran in 1577.43 seconds.

578 passed, 0 skipped, 0 failed, 0 errors, 0 expected failures, 0 unexpected passes

Results

Result Test Duration Links
Passed test/test_configuration/test_defaults.py::TestGetDefaults::test_get_defaults 0.00
No log output captured.
Passed test/test_configuration/test_defaults.py::TestAllDefaults::test_training_parameters 0.00
No log output captured.
Passed test/test_configuration/test_defaults.py::TestAllDefaults::test_data_handler_parameters 0.00
No log output captured.
Passed test/test_configuration/test_defaults.py::TestAllDefaults::test_subset_parameters 0.00
No log output captured.
Passed test/test_configuration/test_defaults.py::TestAllDefaults::test_hpc_parameters 0.00
No log output captured.
Passed test/test_configuration/test_defaults.py::TestAllDefaults::test_postprocessing_parameters 0.00
No log output captured.
Passed test/test_configuration/test_join_settings.py::TestJoinSettings::test_no_args 0.00
No log output captured.
Passed test/test_configuration/test_join_settings.py::TestJoinSettings::test_daily 0.00
No log output captured.
Passed test/test_configuration/test_join_settings.py::TestJoinSettings::test_hourly 0.00
No log output captured.
Passed test/test_configuration/test_join_settings.py::TestJoinSettings::test_unknown_sampling 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestPrepareHost::test_prepare_host 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestPrepareHost::test_prepare_host_unknown 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestPrepareHost::test_prepare_host_given_path 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestPrepareHost::test_error_handling 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestPrepareHost::test_os_path_exists 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetExperimentName::test_set_experiment_name 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetExperimentName::test_set_experiment_name_sampling 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetExperimentName::test_set_experiment_name_tuple_sampling 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetExperimentName::test_set_experiment_path 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetExperimentName::test_set_experiment_path_given_path 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetBootstrapPath::test_bootstrap_path_is_none 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestSetBootstrapPath::test_bootstap_path_is_given 0.00
No log output captured.
Passed test/test_configuration/test_path_config.py::TestCheckPath::test_check_path_and_create 0.00
-------------------------------Captured log call--------------------------------
DEBUG root:path_config.py:125 Created path: data/test DEBUG root:path_config.py:132 Path already exists: data/test
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_required_attributes 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_init 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_build 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_own_args 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_skip_args 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_transformation 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_get_X 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_get_Y 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_get_data 0.00
No log output captured.
Passed test/test_data_handler/test_abstract_data_handler.py::TestAbstractDataHandler::test_get_coordinates 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSampling::test_data_handler 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSampling::test_data_handler_transformation 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSampling::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_init 0.21
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_update_kwargs_single_to_tuple 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_update_kwargs_tuple 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_update_kwargs_default 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_update_kwargs_assert_failure 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_setup_samples 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_load_and_interpolate 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_set_inputs_and_targets 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingSingleStation::test_setup_data_path 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingWithFilterSingleStation::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingWithFirFilter::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingWithFirFilterSingleStation::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingWithClimateFirFilter::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_mixed_sampling.py::TestDataHandlerMixedSamplingWithClimateFirFilterSingleStation::test_requirements 0.01
No log output captured.
Passed test/test_data_handler/test_data_handler_with_filter.py::TestDataHandlerFilter::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_with_filter.py::TestDataHandlerFilterSingleStation::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_with_filter.py::TestDataHandlerFirFilter::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_with_filter.py::TestDataHandlerFirFilterSingleStation::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_with_filter.py::TestDataHandlerClimateFirFilter::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_data_handler_with_filter.py::TestDataHandlerClimateFirFilterSingleStation::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_default_data_handler.py::TestDefaultDataHandler::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_default_data_handler_single_station.py::TestDataHandlerSingleStation::test_requirements 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestStandardIterator::test_blank 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestStandardIterator::test_init 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestStandardIterator::test_next 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_init 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_iter 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_add 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_name 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_set_mapping 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_getitem 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestDataCollection::test_keys 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_init 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_cleanup_path 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_len 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_concatenate 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_prepare_batches 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_prepare_batches_upsampling 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_prepare_batches_no_remaining 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_data_generation 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_getitem 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_on_epoch_end 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_get_model_rank_no_model 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_get_model_rank_single_output_branch 0.08
------------------------------Captured stdout call------------------------------
Model: "model" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_1 (InputLayer) [(None, 14, 1, 2)] 0 _________________________________________________________________ flatten (Flatten) (None, 28) 0 _________________________________________________________________ dense (Dense) (None, 64) 1856 _________________________________________________________________ prelu_1 (PReLU) (None, 64) 64 _________________________________________________________________ dense_1 (Dense) (None, 32) 2080 _________________________________________________________________ prelu_2 (PReLU) (None, 32) 32 _________________________________________________________________ dense_2 (Dense) (None, 16) 528 _________________________________________________________________ prelu_3 (PReLU) (None, 16) 16 _________________________________________________________________ dense_3 (Dense) (None, 3) 51 _________________________________________________________________ linear_output (Activation) (None, 3) 0 ================================================================= Total params: 4,627 Trainable params: 4,627 Non-trainable params: 0 _________________________________________________________________ None
------------------------------Captured stderr call------------------------------
2023-06-30 09:37:38.675816: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcuda.so.1'; dlerror: libcuda.so.1: cannot open shared object file: No such file or directory 2023-06-30 09:37:38.675880: W tensorflow/stream_executor/cuda/cuda_driver.cc:269] failed call to cuInit: UNKNOWN ERROR (303) 2023-06-30 09:37:38.675913: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:156] kernel driver does not appear to be running on this host (runner-r3wxqhgr-project-2411-concurrent-0): /proc/driver/nvidia/version does not exist 2023-06-30 09:37:38.676238: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_get_model_rank_multiple_output_branch 0.09
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestKerasIterator::test_get_model_rank_error 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestGetNumberOfMiniBatches::test_get_number_of_mini_batches 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestGetBatch::test_get_batch 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestSaveToPickle::test_save_to_pickle 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestPermuteData::test_permute_data 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestFProc::test_f_proc 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestFProc::test_f_proc_no_remaining 0.00
No log output captured.
Passed test/test_data_handler/test_iterator.py::TestFProc::test_f_proc_X_Y 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestAbstractDataStore::test_init 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestAbstractDataStore::test_clear_data_store 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_put 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_get 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_get_with_sub_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_get_with_not_existing_sub_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_raise_not_in_data_store 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_get_default 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_raise_not_in_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_list_all_scopes 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search_empty_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_list_all_names 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search_scope_and_all_superiors 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search_scope_return_all 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_search_scope_and_all_superiors_return_all 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_create_args_dict_default_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_create_args_dict_given_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_create_args_dict_missing_entry 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_set_args_from_dict 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByVariable::test_no_scope_given 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_put_with_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_get 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_get_with_sub_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_get_with_not_existing_sub_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_raise_not_in_data_store 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_get_default 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_raise_not_in_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_list_all_scopes 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search_empty_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_list_all_names 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search_scope_and_all_superiors 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search_scope_return_all 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_search_scope_and_all_superiors_return_all 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_create_args_dict_default_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_create_args_dict_given_scope 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_create_args_dict_missing_entry 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_set_args_from_dict 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestDataStoreByScope::test_no_scope_given 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestCorrectScope::test_init 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestTracking::test_init 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestTracking::test_track_first_entry 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestTracking::test_track_second_entry 0.00
No log output captured.
Passed test/test_helpers/test_datastore.py::TestTracking::test_decrypt_args 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_combine_observation_and_apriori_no_new_dim 0.03
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_combine_observation_and_apriori_with_new_dim 0.03
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_shift_data 0.01
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_index_array 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_tmp_dimension 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_tmp_dimension_iter_limit 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_next_order 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_next_order_with_kzf 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_calculate_filter_coefficients 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_monthly_mean 0.07
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_monthly_mean_sampling 0.12
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_monthly_mean_sel_opts 0.04
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_compute_hourly_mean_per_month 0.16
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_compute_hourly_mean_per_month_no_anomaly 0.16
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_seasonal_cycle_of_hourly_mean 0.27
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_seasonal_hourly_mean 1.23
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_seasonal_hourly_mean_sel_opts 0.59
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_unity_array 0.02
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_extend_apriori_at_end 0.02
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_extend_apriori_at_start 0.03
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_get_year_interval 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_time_range_extend 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_properties 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_trim_data_to_minimum_length 0.03
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_create_full_filter_result_array 0.02
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_clim_filter 13.51
No log output captured.
Passed test/test_helpers/test_filter.py::TestClimateFIRFilter::test_clim_filter_kwargs 32.94
No log output captured.
Passed test/test_helpers/test_filter.py::TestFirFilterConvolve::test_fir_filter_convolve 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestFirwinKzf::test_firwin_kzf 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestFilterWidthKzf::test_filter_width_kzf 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestOmegaNullKzf::test_omega_null_kzf 0.00
No log output captured.
Passed test/test_helpers/test_filter.py::TestOmegaNullKzf::test_omega_null_kzf_alpha 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestDeg2RadAllPoints::test_deg2rad_all_points_scalar_inputs[value0] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestDeg2RadAllPoints::test_deg2rad_all_points_scalar_inputs[value1] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestDeg2RadAllPoints::test_deg2rad_all_points_scalar_inputs[custom_np_arrays] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestDeg2RadAllPoints::test_deg2rad_all_points_xr_arr_inputs 0.01
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[90.0-0.0--90.0-0.0-True-3.141592653589793] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[1.5707963267948966-0.0--1.5707963267948966-0.0-False-3.141592653589793] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[0.0-0.0-0.0-180.0-True-3.141592653589793] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[0.0-0.0-0.0-3.141592653589793-False-3.141592653589793] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[0.0-0.0--45.0-0-True-0.7853981633974483] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_scalars[0.0-0.0--0.7853981633974483-0-False-0.7853981633974483] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_fields_and_scalars[lat10-lon10--90.0-0.0-True-expected_dist0] 0.01
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_fields_and_scalars[lat11-lon11-lat21-lon21-True-expected_dist1] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_missmatch_dimensions[lat10-0.0-0.0-0.0-True] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_missmatch_dimensions[0.0-lon11-0.0-0.0-True] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_missmatch_dimensions[0.0-0.0-lat22-0.0-True] 0.00
No log output captured.
Passed test/test_helpers/test_geofunctions.py::TestHaversineDist::test_haversine_dist_on_unit_sphere_missmatch_dimensions[0.0-0.0-0.0-lon23-True] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestToList::test_to_list 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_init 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test__start 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test__end 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test__duration 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_repr 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_run 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_stop 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_duration 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_enter_exit 0.00
-------------------------------Captured log call--------------------------------
INFO root:time_tracking.py:137 undefined job finished after 0:00:01 (hh:mm:ss)
Passed test/test_helpers/test_helpers.py::TestTimeTracking::test_name_enter_exit 0.00
-------------------------------Captured log call--------------------------------
INFO root:time_tracking.py:137 my job finished after 0:00:01 (hh:mm:ss)
Passed test/test_helpers/test_helpers.py::TestPytestRegex::test_pytest_regex_init 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestPytestRegex::test_pytest_regex_eq 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestPytestRegex::test_pytest_regex_repr 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestDictToXarray::test_dict_to_xarray 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestDictToXarray::test_dict_to_xarray_single_entry 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestFloatRound::test_float_round_ceil 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestFloatRound::test_float_round_decimals 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestFloatRound::test_float_round_type 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestFloatRound::test_float_round_negative 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_big_numbers 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_float_numbers 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_small_numbers 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_zero 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_negative_numbers 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_wrong_significance 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_floor 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_floor_neg_numbers 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_ceil 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_ceil_neg_numbers 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRelativeRound::test_relative_round_ceil_floor 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestGetOrder::test_get_order 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestGetOrder::test_get_order_neg_orders 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestGetOrder::test_get_order_neg_numbers 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSelectFromDict::test_select 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSelectFromDict::test_select_no_dict_given 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSelectFromDict::test_select_remove_none 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSelectFromDict::test_select_condition 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_dict_remove_single 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_dict_remove_multiple 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_list_remove_single 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_list_remove_multiple 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_remove_missing_argument 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestRemoveItems::test_remove_not_supported_type 0.03
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_init_default 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_setup_logging_path_none 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_setup_logging_path_given 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_logger_console_level0 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_logger_console_level1 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestLogger::test_logger_console_level_wrong_type 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestExtractValue::test_extract 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestExtractValue::test_extract_multiple_elements 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestIsXarray::test_is_xarray_xr_input 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestIsXarray::test_is_xarray_other_input 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_xrdata_in 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_npdata_in_nokwargs 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_npdata_in_nokwargs_default_true 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_npdata_in_kwargs[False] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_npdata_in_kwargs[True] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_int_float_in_nokwargs_default_true[1] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_int_float_in_nokwargs_default_true[2.0] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_wrong_type_in_default_true_nokwargs[wrong_input0] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_wrong_type_in_default_true_nokwargs[wrong_input1] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_wrong_type_in_default_true_nokwargs[abc] 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestConvert2xrDa::test_convert2xrda_dask_in_default_true_nokwargs 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSortLike::test_sort_like 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSortLike::test_sort_like_not_unique 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestSortLike::test_sort_like_missing_element 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestFilterDictByValue::test_filter_dict_by_value 0.00
No log output captured.
Passed test/test_helpers/test_helpers.py::TestFilterDictByValue::test_filter_dict_by_value_not_avail 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise[pandas-0] 0.01
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_apply_standardise_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_apply_standardise_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise_apply[pandas-pd_mean-pd_std-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestStandardise::test_standardise_apply[xarray-xr_mean-xr_std-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_apply_centre_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_apply_centre_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre_apply[pandas-pd_mean-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCentre::test_centre_apply[xarray-xr_mean-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_apply_min_max_inverse[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_apply_min_max_inverse[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max_apply[pandas-pd_min-pd_max-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMinMax::test_min_max_apply[xarray-xr_min-xr_max-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise[pandas_gamma-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise[xarray_gamma-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise_inverse[pandas_gamma-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise_inverse[xarray_gamma-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_apply_standardise_inverse[pandas_gamma-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_apply_standardise_inverse[xarray_gamma-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise_apply[pandas-0] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestLog::test_standardise_apply[xarray-index] 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCreateBootstrapRealizations::test_create_single_bootstrap_realization 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCreateBootstrapRealizations::test_calculate_average 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCreateBootstrapRealizations::test_create_n_bootstrap_realizations 1.59
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMeanSquaredError::test_mean_squared_error 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMeanSquaredError::test_mean_squared_error_xarray 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMeanAbsoluteError::test_mean_absolute_error 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMeanAbsoluteError::test_mean_absolute_error_xarray 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestIndexOfAgreement::test_index_of_agreement 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestIndexOfAgreement::test_index_of_agreement_xarray 0.01
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMNMB::test_modified_normalized_mean_bias 0.00
No log output captured.
Passed test/test_helpers/test_statistics.py::TestMNMB::test_modified_normalized_mean_bias_xarray 0.01
No log output captured.
Passed test/test_helpers/test_statistics.py::TestCalculateErrorMetrics::test_calculate_error_metrics 0.26
No log output captured.
Passed test/test_helpers/test_tables.py::TestTables::test_create_column_format_for_tex 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestRegex::test_init 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestRegex::test_eq 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestRegex::test_repr 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestAllEqual::test_numpy 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestAllEqual::test_xarray 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestAllEqual::test_other 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestPyTestAllEqual::test_encapsulated 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestNestedEquality::test_nested_equality_single_entries 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestNestedEquality::test_nested_equality_xarray 0.03
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestNestedEquality::test_nested_equality_numpy 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestNestedEquality::test_nested_equality_list_tuple 0.00
No log output captured.
Passed test/test_helpers/test_testing_helpers.py::TestNestedEquality::test_nested_equality_dict 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestDownloadJoin::test_download_single_var 2.99
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestDownloadJoin::test_download_empty 1.06
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestDownloadJoin::test_download_incomplete 1.11
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestCorrectDataFormat::test_correct_data_format 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestLoadSeriesInformation::test_standard_query 0.17
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestLoadSeriesInformation::test_empty_result 0.60
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctDataOrigin::test_no_origin_given 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctDataOrigin::test_different_origins 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctNetwork::test_no_network_given 0.00
------------------------------Captured stderr call------------------------------
2023-06-30 09:38:36,802 - INFO: Could not find a valid match for variable no2 and networks []! Therefore, use first answer from JOIN: {'id': 16686, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'no2', 'parameter_label': 'NO2', 'parameter_attribute': ''} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,802 - INFO: Could not find a valid match for variable no2 and networks []! Therefore, use first answer from JOIN: {'id': 16686, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'no2', 'parameter_label': 'NO2', 'parameter_attribute': ''} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,802 - INFO: Could not find a valid match for variable no2 and networks []! Therefore, use first answer from JOIN: {'id': 16686, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'no2', 'parameter_label': 'NO2', 'parameter_attribute': ''} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,802 - INFO: Could not find a valid match for variable no2 and networks []! Therefore, use first answer from JOIN: {'id': 16686, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'no2', 'parameter_label': 'NO2', 'parameter_attribute': ''} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,803 - INFO: Could not find a valid match for variable o3 and networks []! Therefore, use first answer from JOIN: {'id': 16687, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'o3', 'parameter_label': 'O3', 'parameter_attribute': ''} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,803 - INFO: Could not find a valid match for variable o3 and networks []! Therefore, use first answer from JOIN: {'id': 16687, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'o3', 'parameter_label': 'O3', 'parameter_attribute': ''} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,803 - INFO: Could not find a valid match for variable o3 and networks []! Therefore, use first answer from JOIN: {'id': 16687, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'o3', 'parameter_label': 'O3', 'parameter_attribute': ''} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,803 - INFO: Could not find a valid match for variable o3 and networks []! Therefore, use first answer from JOIN: {'id': 16687, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'o3', 'parameter_label': 'O3', 'parameter_attribute': ''} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,803 - INFO: Could not find a valid match for variable cloudcover and networks []! Therefore, use first answer from JOIN: {'id': 54036, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'cloudcover', 'parameter_label': 'CLOUDCOVER', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,803 - INFO: Could not find a valid match for variable cloudcover and networks []! Therefore, use first answer from JOIN: {'id': 54036, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'cloudcover', 'parameter_label': 'CLOUDCOVER', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,803 - INFO: Could not find a valid match for variable cloudcover and networks []! Therefore, use first answer from JOIN: {'id': 54036, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'cloudcover', 'parameter_label': 'CLOUDCOVER', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,803 - INFO: Could not find a valid match for variable cloudcover and networks []! Therefore, use first answer from JOIN: {'id': 54036, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'cloudcover', 'parameter_label': 'CLOUDCOVER', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,804 - INFO: Could not find a valid match for variable temp and networks []! Therefore, use first answer from JOIN: {'id': 88491, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'temp', 'parameter_label': 'TEMP-REA-MIUB', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,804 - INFO: Could not find a valid match for variable temp and networks []! Therefore, use first answer from JOIN: {'id': 88491, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'temp', 'parameter_label': 'TEMP-REA-MIUB', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,804 - INFO: Could not find a valid match for variable temp and networks []! Therefore, use first answer from JOIN: {'id': 88491, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'temp', 'parameter_label': 'TEMP-REA-MIUB', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,804 - INFO: Could not find a valid match for variable temp and networks []! Therefore, use first answer from JOIN: {'id': 88491, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'temp', 'parameter_label': 'TEMP-REA-MIUB', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,804 - INFO: Could not find a valid match for variable press and networks []! Therefore, use first answer from JOIN: {'id': 102660, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'press', 'parameter_label': 'PRESS-REA-MIUB', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,804 - INFO: Could not find a valid match for variable press and networks []! Therefore, use first answer from JOIN: {'id': 102660, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'press', 'parameter_label': 'PRESS-REA-MIUB', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,804 - INFO: Could not find a valid match for variable press and networks []! Therefore, use first answer from JOIN: {'id': 102660, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'press', 'parameter_label': 'PRESS-REA-MIUB', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288] 2023-06-30 09:38:36,804 - INFO: Could not find a valid match for variable press and networks []! Therefore, use first answer from JOIN: {'id': 102660, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'press', 'parameter_label': 'PRESS-REA-MIUB', 'parameter_attribute': 'REA'} [join.py:_select_distinct_network:288]
-------------------------------Captured log call--------------------------------
INFO root:join.py:288 Could not find a valid match for variable no2 and networks []! Therefore, use first answer from JOIN: {'id': 16686, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'no2', 'parameter_label': 'NO2', 'parameter_attribute': ''} INFO root:join.py:288 Could not find a valid match for variable o3 and networks []! Therefore, use first answer from JOIN: {'id': 16687, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'o3', 'parameter_label': 'O3', 'parameter_attribute': ''} INFO root:join.py:288 Could not find a valid match for variable cloudcover and networks []! Therefore, use first answer from JOIN: {'id': 54036, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'cloudcover', 'parameter_label': 'CLOUDCOVER', 'parameter_attribute': 'REA'} INFO root:join.py:288 Could not find a valid match for variable temp and networks []! Therefore, use first answer from JOIN: {'id': 88491, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'temp', 'parameter_label': 'TEMP-REA-MIUB', 'parameter_attribute': 'REA'} INFO root:join.py:288 Could not find a valid match for variable press and networks []! Therefore, use first answer from JOIN: {'id': 102660, 'network_name': 'UBA', 'station_id': 'DENW053', 'parameter_name': 'press', 'parameter_label': 'PRESS-REA-MIUB', 'parameter_attribute': 'REA'}
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctNetwork::test_single_network_given 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctNetwork::test_single_network_given_no_match 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctNetwork::test_multiple_networks_given 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctNetwork::test_multiple_networks_given_by_dict 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctSeries::test_no_origin_given 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctSeries::test_different_origins 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctSeries::test_different_networks 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctSeries::test_network_not_available 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSelectDistinctSeries::test_different_network_and_origin 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSaveToPandas::test_empty_df 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSaveToPandas::test_not_empty_df 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestSaveToPandas::test_alternative_date_format 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_join.py::TestLowerList::test_string_lowering 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestGetData::test 0.12
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestCreateUrl::test_minimal_args_given 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestCreateUrl::test_given_kwargs 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestCreateUrl::test_single_kwargs 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestCreateUrl::test_none_kwargs 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestCreateUrl::test_param_id 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestCreateUrl::test_param_id_kwargs 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestCorrectStatName::test_nothing_to_do 0.00
No log output captured.
Passed test/test_helpers/test_data_sources/test_toar_data.py::TestCorrectStatName::test_correct_string 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_model_property 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_all_empty 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_attr 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_mix_attr_dict_no_duplicates 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_mix_attr_dict_valid_duplicates_none_optimizer 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_property_type_error 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_mix_attr_dict_invalid_duplicates_other_optimizer 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_mix_attr_dict_invalid_duplicates_same_optimizer_other_args 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_compile_options_setter_as_dict_invalid_keys 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_getattr 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_get_settings 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_custom_objects 0.00
No log output captured.
Passed test/test_model_modules/test_abstract_model_class.py::TestAbstractModelClass::test_set_custom_objects 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_get_padding_for_same_negative_kernel_size 0.00
------------------------------Captured stdout call------------------------------
In test_get_padding_for_same_negative_kernel_size
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_get_padding_for_same_strides_greater_one 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_get_padding_for_same_non_int_kernel 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_get_padding_for_same_stride_3d 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_get_padding_for_same_even_pad 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_negative_pads 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_len_of_pad_tuple 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_tuple_of_none_integer 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_tuple_of_tuple_none_integer_first 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_tuple_of_tuple_none_integer_second 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_valid_mix_of_int_and_tuple 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_invalid_mixed_tuple_and_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadUtils::test_check_padding_format_invalid_mixed_int_and_tuple 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_valid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_negative_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_invalid_format_float 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_invalid_format_string 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_tuple_of_valid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_tuple_of_invalid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_init_tuple_of_tuple_of_invalid_format 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestReflectionPadding2D::test_call 0.40
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_valid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_negative_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_invalid_format_float 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_invalid_format_string 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_tuple_of_valid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_tuple_of_invalid_int 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_init_tuple_of_tuple_of_invalid_format 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestSymmerticPadding2D::test_call 0.04
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_check_and_get_padding_zero_padding 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_check_and_get_padding_sym_padding 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_check_and_get_padding_ref_padding 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_check_and_get_padding_raises 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[SymPad2D] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[SymmetricPadding2D0] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[SymmetricPadding2D1] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[RefPad2D] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[ReflectionPadding2D0] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[ReflectionPadding2D1] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[ZeroPad2D] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[ZeroPadding2D0] 0.00
No log output captured.
Passed test/test_model_modules/test_advanced_paddings.py::TestPadding2D::test_call[ZeroPadding2D1] 0.00
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestGetActivation::test_string_act 0.00
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestGetActivation::test_sting_act_unknown 0.00
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestGetActivation::test_layer_act 0.00
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestGetActivation::test_layer_act_invalid 0.00
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestFlattenTail::test_flatten_tail_no_bound_no_regul_no_drop 0.02
No log output captured.
Passed test/test_model_modules/test_flatten_tail.py::TestFlattenTail::test_flatten_tail_all_settings 0.03
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_block_part_name 0.00
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_conv_tower_3x3 0.02
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_conv_tower_3x3_batch_norm 0.03
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_conv_tower_3x3_activation 0.04
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_conv_tower_1x1 0.01
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_conv_towers 0.04
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_create_pool_tower 0.02
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_inception_block 0.14
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_inception_block_invalid_batchnorm 0.04
No log output captured.
Passed test/test_model_modules/test_inception_model.py::TestInceptionModelBase::test_batch_normalisation 0.01
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestHistoryAdvanced::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestHistoryAdvanced::test_on_train_begin 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestLearningRateDecay::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestLearningRateDecay::test_check_param 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestLearningRateDecay::test_on_epoch_begin 0.43
------------------------------Captured stdout call------------------------------
Epoch 1/5 1/1 [==============================] - ETA: 0s - loss: 5.0038 1/1 [==============================] - 0s 315ms/step - loss: 5.0038 Epoch 2/5 1/1 [==============================] - ETA: 0s - loss: 4.8265 1/1 [==============================] - 0s 2ms/step - loss: 4.8265 Epoch 3/5 1/1 [==============================] - ETA: 0s - loss: 4.6525 1/1 [==============================] - 0s 1ms/step - loss: 4.6525 Epoch 4/5 1/1 [==============================] - ETA: 0s - loss: 4.4903 1/1 [==============================] - 0s 2ms/step - loss: 4.4903 Epoch 5/5 1/1 [==============================] - ETA: 0s - loss: 4.3313 1/1 [==============================] - 0s 2ms/step - loss: 4.3313
------------------------------Captured stderr call------------------------------
2023-06-30 09:38:38.186257: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:185] None of the MLIR Optimization Passes are enabled (registered 2)
Passed test/test_model_modules/test_keras_extensions.py::TestModelCheckpointAdvanced::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestModelCheckpointAdvanced::test_update_best 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestModelCheckpointAdvanced::test_update_callbacks 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestModelCheckpointAdvanced::test_on_epoch_end 0.00
------------------------------Captured stdout call------------------------------
Epoch 00001: val_loss did not improve from 6.00000 Epoch 00010: val_loss did not improve from 6.00000 Epoch 00011: val_loss improved from 6.00000 to 4.00000, saving model to ckpt.test Epoch 00011: save to /builds/esde/machine-learning/mlair/test/test_model_modules/callback_lr Epoch 00011: save to /builds/esde/machine-learning/mlair/test/test_model_modules/callback_hist Epoch 00011: saving model to ckpt.test Epoch 00011: save to /builds/esde/machine-learning/mlair/test/test_model_modules/callback_lr Epoch 00011: save to /builds/esde/machine-learning/mlair/test/test_model_modules/callback_hist
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_init 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_callbacks_set 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_callbacks_get 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_update_callback 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_add_callback 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_add_callback_raise 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_get_callbacks_as_dict 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_get_callbacks_no_dict 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_get_callback_by_name 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test__get_callbacks 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_get_checkpoint 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_create_model_checkpoint 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_load_callbacks 0.00
No log output captured.
Passed test/test_model_modules/test_keras_extensions.py::TestCallbackHandler::test_update_checkpoint 0.00
No log output captured.
Passed test/test_model_modules/test_linear_model.py::TestOrdinaryLeastSquareModel::test_constant_input_variable 0.00
No log output captured.
Passed test/test_model_modules/test_loss.py::TestLPLoss::test_l_p_loss 0.32
------------------------------Captured stdout call------------------------------
1/1 [==============================] - ETA: 0s - loss: 1.2500 1/1 [==============================] - 0s 97ms/step - loss: 1.2500 1/1 [==============================] - ETA: 0s - loss: 2.2500 1/1 [==============================] - 0s 96ms/step - loss: 2.2500
Passed test/test_model_modules/test_loss.py::TestVarLoss::test_var_loss 0.21
------------------------------Captured stdout call------------------------------
1/1 [==============================] - ETA: 0s - loss: 0.1406 1/1 [==============================] - 0s 156ms/step - loss: 0.1406
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_no_weights 0.22
------------------------------Captured stdout call------------------------------
1/1 [==============================] - ETA: 0s - loss: 0.6953 1/1 [==============================] - 0s 167ms/step - loss: 0.6953
------------------------------Captured stderr call------------------------------
2023-06-30 09:38:39,349 - WARNING: 5 out of the last 9 calls to <function Model.make_train_function.<locals>.train_function at 0x7fed0d02f280> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [def_function.py:called_with_tracing:147] 2023-06-30 09:38:39,349 - WARNING: 5 out of the last 9 calls to <function Model.make_train_function.<locals>.train_function at 0x7fed0d02f280> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [def_function.py:called_with_tracing:147] 2023-06-30 09:38:39,349 - WARNING: 5 out of the last 9 calls to <function Model.make_train_function.<locals>.train_function at 0x7fed0d02f280> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [def_function.py:called_with_tracing:147] 2023-06-30 09:38:39,349 - WARNING: 5 out of the last 9 calls to <function Model.make_train_function.<locals>.train_function at 0x7fed0d02f280> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [def_function.py:called_with_tracing:147]
-------------------------------Captured log call--------------------------------
WARNING tensorflow:def_function.py:147 5 out of the last 9 calls to <function Model.make_train_function.<locals>.train_function at 0x7fed0d02f280> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_with_weights[weights0] 0.17
------------------------------Captured stdout call------------------------------
1/1 [==============================] - ETA: 0s - loss: 0.4734 1/1 [==============================] - 0s 123ms/step - loss: 0.4734
------------------------------Captured stderr call------------------------------
2023-06-30 09:38:39,529 - WARNING: 6 out of the last 10 calls to <function Model.make_train_function.<locals>.train_function at 0x7febb02478b0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [def_function.py:called_with_tracing:147] 2023-06-30 09:38:39,529 - WARNING: 6 out of the last 10 calls to <function Model.make_train_function.<locals>.train_function at 0x7febb02478b0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [def_function.py:called_with_tracing:147] 2023-06-30 09:38:39,529 - WARNING: 6 out of the last 10 calls to <function Model.make_train_function.<locals>.train_function at 0x7febb02478b0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [def_function.py:called_with_tracing:147] 2023-06-30 09:38:39,529 - WARNING: 6 out of the last 10 calls to <function Model.make_train_function.<locals>.train_function at 0x7febb02478b0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [def_function.py:called_with_tracing:147]
-------------------------------Captured log call--------------------------------
WARNING tensorflow:def_function.py:147 6 out of the last 10 calls to <function Model.make_train_function.<locals>.train_function at 0x7febb02478b0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_with_weights[weights1] 0.18
------------------------------Captured stdout call------------------------------
1/1 [==============================] - ETA: 0s - loss: 0.6953 1/1 [==============================] - 0s 133ms/step - loss: 0.6953
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_with_weights[weights2] 0.18
------------------------------Captured stdout call------------------------------
1/1 [==============================] - ETA: 0s - loss: 0.6953 1/1 [==============================] - 0s 119ms/step - loss: 0.6953
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_with_weights[weights3] 0.17
------------------------------Captured stdout call------------------------------
1/1 [==============================] - ETA: 0s - loss: 1.0281 1/1 [==============================] - 0s 121ms/step - loss: 1.0281
Passed test/test_model_modules/test_loss.py::TestCustomLoss::test_custom_loss_invalid_weights 0.00
No log output captured.
Passed test/test_model_modules/test_model_class.py::TestIntelliO3_ts_architecture::test_init 0.37
No log output captured.
Passed test/test_model_modules/test_model_class.py::TestIntelliO3_ts_architecture::test_set_model 0.31
No log output captured.
Passed test/test_model_modules/test_model_class.py::TestIntelliO3_ts_architecture::test_set_compile_options 0.31
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_init 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_repr 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_x_property 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_y_property 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_add_precursor 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackObject::test_add_successor 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_init 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_get_all_scopes 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_get_unique_scopes 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_get_unique_scopes_no_general 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_get_all_dims 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_create_track_chain 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_control_dict 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test__create_track_chain 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_precursor 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_track_object_same_stage 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_track_object_different_stage 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_update_control 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_set_object 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_set_object_no_control_obj 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_get_object_no_new_track_obj 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_get_object_no_control_obj 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_add_get_object_skip_update 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_recursive_decent_avail_in_1_up 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_recursive_decent_avail_in_2_up 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_recursive_decent_avail_from_chain 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_recursive_decent_avail_from_chain_get 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_recursive_decent_avail_from_chain_multiple_get 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackChain::test_clean_control 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_init 0.32
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_plot 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_line 0.01
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_step 0.01
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_rect 0.01
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_set_ypos_anchor 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_plot_track_chain 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_add_variable_names 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_add_stages 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_create_track_chain_plot_run_env 0.00
No log output captured.
Passed test/test_plotting/test_tracker_plot.py::TestTrackPlot::test_set_lims 0.01
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_get_plot_metric 0.00
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_get_plot_metric_short_metric 0.00
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_get_plot_metric_main_branch 0.00
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_filter_columns 0.00
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_plot_from_hist_obj 0.70
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_plot_from_hist_dict 0.25
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelHistory::test_plot_additional_loss 0.51
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelLearningRate::test_plot_from_lr_obj 0.18
No log output captured.
Passed test/test_plotting/test_training_monitoring.py::TestPlotModelLearningRate::test_plot_from_lr_dict 0.17
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceDataHandler::test_init 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceDataHandler::test_make_reference_available_locally 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceDataHandler::test_is_reference_available_locally 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceb2share::test_inheritance 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceb2share::test_init 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceb2share::test_b2share_url 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceb2share::test_bar_custom 0.00
No log output captured.
Passed test/test_reference_models/test_abstract_reference_model.py::TestAbstractReferenceb2share::test_download_from_b2share 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_init_none_path 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_init_extra_path 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_inheritance 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_untar_forecasts 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_file_list 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_read_and_drop 0.00
No log output captured.
Passed test/test_reference_models/test_reference_model_intellio3_v1.py::TestIntelliO3Reference::test_make_reference_available_locally 0.00
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_set_param_by_value 0.00
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 set: 23tester(general)=23 DEBUG root:experiment_setup.py:461 set experiment attribute: 23tester(general)=23 DEBUG root:datastore.py:118 get: 23tester(general)=23
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_set_param_by_value_and_scope 0.00
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 set: 109tester(general)=109 DEBUG root:experiment_setup.py:461 set experiment attribute: 109tester(general)=109 DEBUG root:datastore.py:118 get: 109tester(general.tester)=109
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_set_param_with_default 0.00
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 set: NoneTester(general.testing)=notNone DEBUG root:experiment_setup.py:461 set experiment attribute: NoneTester(general.testing)=notNone DEBUG root:datastore.py:118 get: NoneTester(general.testing)=notNone DEBUG root:datastore.py:118 set: AnotherNoneTester(general)=None DEBUG root:experiment_setup.py:461 set experiment attribute: AnotherNoneTester(general)=None DEBUG root:datastore.py:118 get: AnotherNoneTester(general)=None
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_set_param_with_apply 0.00
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 set: NoneTester(general)=notNone DEBUG root:experiment_setup.py:461 set experiment attribute: NoneTester(general)=notNone DEBUG root:datastore.py:118 get: NoneTester(general)=notNone DEBUG root:datastore.py:118 set: NoneTester(general)=['notNone'] DEBUG root:experiment_setup.py:461 set experiment attribute: NoneTester(general)=['notNone'] DEBUG root:datastore.py:118 get: NoneTester(general)=['notNone'] DEBUG root:datastore.py:118 set: NoneTester(general)=[None] DEBUG root:experiment_setup.py:461 set experiment attribute: NoneTester(general)=[None] DEBUG root:datastore.py:118 get: NoneTester(general)=[None] DEBUG root:datastore.py:118 set: NoneTester(general)=2 DEBUG root:experiment_setup.py:461 set experiment attribute: NoneTester(general)=2 DEBUG root:datastore.py:118 get: NoneTester(general)=2
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_init_default 0.01
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_init_no_default 0.01
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_init_train_model_behaviour 0.03
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_compare_variables_and_statistics 0.01
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_multiprocessing_no_debug 0.01
No log output captured.
Passed test/test_run_modules/test_experiment_setup.py::TestExperimentSetup::test_multiprocessing_debug 0.01
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_set_callbacks 0.48
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_set_callbacks_no_lr_decay 1.25
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_get_model_settings 2.93
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_build_model 4.14
------------------------------Captured stdout call------------------------------
Model: "model_7" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_32 (InputLayer) [(None, 14, 1, 5)] 0 _________________________________________________________________ flatten_1 (Flatten) (None, 70) 0 _________________________________________________________________ dense_5 (Dense) (None, 64) 4544 _________________________________________________________________ prelu_1 (PReLU) (None, 64) 64 _________________________________________________________________ dense_6 (Dense) (None, 32) 2080 _________________________________________________________________ prelu_2 (PReLU) (None, 32) 32 _________________________________________________________________ dense_7 (Dense) (None, 16) 528 _________________________________________________________________ prelu_3 (PReLU) (None, 16) 16 _________________________________________________________________ dense_8 (Dense) (None, 5) 85 _________________________________________________________________ linear_output (Activation) (None, 5) 0 ================================================================= Total params: 7,349 Trainable params: 7,349 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_set_shapes 3.43
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_load_weights 0.00
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_compile_model 0.00
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_run 0.00
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_init 0.00
No log output captured.
Passed test/test_run_modules/test_model_setup.py::TestModelSetup::test_clean_name 2.00
No log output captured.
Passed test/test_run_modules/test_partition_check.py::TestPartitionCheck::test_init 1.81
------------------------------Captured stderr call------------------------------
2023-06-30 09:38:57,816 - INFO: PartitionCheck started [run_environment.py:__init__:103] 2023-06-30 09:38:57,816 - INFO: PartitionCheck started [run_environment.py:__init__:103] 2023-06-30 09:38:57,816 - INFO: PartitionCheck started [run_environment.py:__init__:103] 2023-06-30 09:38:57,816 - INFO: PartitionCheck started [run_environment.py:__init__:103] 2023-06-30 09:38:57,816 - INFO: PartitionCheck started [run_environment.py:__init__:103] 2023-06-30 09:38:57,816 - INFO: PartitionCheck finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:38:57,816 - INFO: PartitionCheck finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:38:57,816 - INFO: PartitionCheck finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:38:57,816 - INFO: PartitionCheck finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:38:57,816 - INFO: PartitionCheck finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:38:57,816 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 09:38:57,816 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 09:38:57,816 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 09:38:57,816 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 09:38:57,816 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 09:38:57,817 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:38:57,817 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:38:57,817 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:38:57,817 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:38:57,817 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:38:59,615 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 09:38:59,615 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 09:38:59,615 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 09:38:59,615 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 09:38:59,615 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 09:38:59,628 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:38:59,628 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:38:59,628 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:38:59,628 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:38:59,628 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 PartitionCheck started INFO root:run_environment.py:120 PartitionCheck finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:120 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_partition_check.py::TestPartitionCheck::test_run_login 1.86
No log output captured.
Passed test/test_run_modules/test_partition_check.py::TestPartitionCheck::test_run_compute 1.82
No log output captured.
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_init 1149.46
------------------------------Captured stderr call------------------------------
2023-06-30 09:39:03,331 - INFO: PreProcessing started [run_environment.py:__init__:103] 2023-06-30 09:39:03,331 - INFO: PreProcessing started [run_environment.py:__init__:103] 2023-06-30 09:39:03,331 - INFO: PreProcessing started [run_environment.py:__init__:103] 2023-06-30 09:39:03,331 - INFO: PreProcessing started [run_environment.py:__init__:103] 2023-06-30 09:39:03,331 - INFO: PreProcessing started [run_environment.py:__init__:103] 2023-06-30 09:39:03,331 - INFO: check valid stations started (preprocessing) [pre_processing.py:validate_station:262] 2023-06-30 09:39:03,331 - INFO: check valid stations started (preprocessing) [pre_processing.py:validate_station:262] 2023-06-30 09:39:03,331 - INFO: check valid stations started (preprocessing) [pre_processing.py:validate_station:262] 2023-06-30 09:39:03,331 - INFO: check valid stations started (preprocessing) [pre_processing.py:validate_station:262] 2023-06-30 09:39:03,331 - INFO: check valid stations started (preprocessing) [pre_processing.py:validate_station:262] 2023-06-30 09:39:03,336 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:39:03,336 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:39:03,336 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:39:03,336 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:39:03,336 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:39:04,081 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:39:04,081 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:39:04,081 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:39:04,081 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:39:04,081 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:40:04,156 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:01:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:40:04,156 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:01:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:40:04,156 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:01:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:40:04,156 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:01:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:40:04,156 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:01:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:40:07,035 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:40:07,035 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:40:07,035 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:40:07,035 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:40:07,035 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:42:07,174 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:02:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:42:07,174 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:02:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:42:07,174 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:02:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:42:07,174 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:02:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:42:07,174 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:02:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:42:12,037 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:42:12,037 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:42:12,037 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:42:12,037 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:42:12,037 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:46:12,176 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:04:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:46:12,176 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:04:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:46:12,176 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:04:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:46:12,176 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:04:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:46:12,176 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:04:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:46:20,741 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:46:20,741 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:46:20,741 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:46:20,741 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:46:20,741 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:54:20,819 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:08:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:54:20,819 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:08:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:54:20,819 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:08:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:54:20,819 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:08:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:54:20,819 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:08:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:54:37,408 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:54:37,408 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:54:37,408 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:54:37,408 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:54:37,408 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:54:37,466 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:54:37,466 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:54:37,466 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:54:37,466 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:54:37,466 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:54:38,155 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:54:38,155 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:54:38,155 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:54:38,155 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:54:38,155 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:55:38,231 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:01:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:38,231 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:01:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:38,231 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:01:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:38,231 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:01:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:38,231 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:01:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:40,934 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:55:40,934 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:55:40,934 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:55:40,934 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:55:40,934 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:55:40,992 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:40,992 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:40,992 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:40,992 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:40,992 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:41,493 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 09:55:41,493 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 09:55:41,493 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 09:55:41,493 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 09:55:41,493 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 09:55:41,580 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:41,580 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:41,580 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:41,580 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:41,580 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:41,763 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:55:41,763 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:55:41,763 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:55:41,763 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:55:41,763 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:55:41,913 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:41,913 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:41,913 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:41,913 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:41,913 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:42,467 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 09:55:42,467 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 09:55:42,467 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 09:55:42,467 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 09:55:42,467 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 09:55:42,613 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:42,613 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:42,613 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:42,613 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:42,613 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:42,616 - INFO: load data for DEBW107 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 09:55:42,616 - INFO: load data for DEBW107 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 09:55:42,616 - INFO: load data for DEBW107 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 09:55:42,616 - INFO: load data for DEBW107 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 09:55:42,616 - INFO: load data for DEBW107 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 09:55:42,682 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:42,682 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:42,682 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:42,682 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:42,682 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:46,282 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily finished after 0:00:04 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:46,282 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily finished after 0:00:04 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:46,282 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily finished after 0:00:04 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:46,282 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily finished after 0:00:04 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:46,282 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily finished after 0:00:04 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:46,670 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:46,670 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:46,670 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:46,670 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:46,670 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:46,700 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:46,700 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:46,700 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:46,700 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:46,700 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:47,397 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:47,397 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:47,397 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:47,397 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:47,397 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:47,439 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:47,439 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:47,439 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:47,439 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:47,439 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:49,277 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:49,277 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:49,277 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:49,277 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:49,277 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:49,321 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:49,321 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:49,321 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:49,321 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:49,321 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:52,068 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:52,068 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:52,068 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:52,068 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:52,068 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:52,110 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:52,110 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:52,110 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:52,110 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:52,110 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:55,263 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:55,263 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:55,263 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:55,263 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:55,263 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:55:55,308 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:55,308 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:55,308 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:55,308 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:55:55,308 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:00,267 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:56:00,267 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:56:00,267 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:56:00,267 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:56:00,267 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:56:00,324 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:00,324 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:00,324 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:00,324 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:00,324 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:00,327 - INFO: load data for DEBW107 from JOIN [join.py:download_join:63] 2023-06-30 09:56:00,327 - INFO: load data for DEBW107 from JOIN [join.py:download_join:63] 2023-06-30 09:56:00,327 - INFO: load data for DEBW107 from JOIN [join.py:download_join:63] 2023-06-30 09:56:00,327 - INFO: load data for DEBW107 from JOIN [join.py:download_join:63] 2023-06-30 09:56:00,327 - INFO: load data for DEBW107 from JOIN [join.py:download_join:63] 2023-06-30 09:56:00,581 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:00,581 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:00,581 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:00,581 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:00,581 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:02,082 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:02,082 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:02,082 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:02,082 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:02,082 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:02,591 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:02,591 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:02,591 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:02,591 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:02,591 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:03,304 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:03,304 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:03,304 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:03,304 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:03,304 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,109 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 09:56:04,109 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 09:56:04,109 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 09:56:04,109 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 09:56:04,109 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 [data_loader.py:get_data:152] 2023-06-30 09:56:04,166 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,166 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,166 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,166 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,166 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,281 - INFO: setup_samples finished after 0:17:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,281 - INFO: setup_samples finished after 0:17:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,281 - INFO: setup_samples finished after 0:17:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,281 - INFO: setup_samples finished after 0:17:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,281 - INFO: setup_samples finished after 0:17:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,555 - INFO: PartitionCheck finished after 0:17:04 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:56:04,555 - INFO: PartitionCheck finished after 0:17:04 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:56:04,555 - INFO: PartitionCheck finished after 0:17:04 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:56:04,555 - INFO: PartitionCheck finished after 0:17:04 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:56:04,555 - INFO: PartitionCheck finished after 0:17:04 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:56:04,567 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,567 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,567 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,567 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,567 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,567 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,567 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,567 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,567 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,567 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:04,832 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:56:04,832 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:56:04,832 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:56:04,832 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:56:04,832 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:56:05,421 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:56:05,421 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:56:05,421 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:56:05,421 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:56:05,421 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:56:05,455 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:05,455 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:05,455 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:05,455 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:05,455 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:06,132 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:56:06,132 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:56:06,132 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:56:06,132 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:56:06,132 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:56:06,179 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:06,179 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:06,179 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:06,179 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:06,179 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:06,777 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 09:56:06,777 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 09:56:06,777 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 09:56:06,777 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 09:56:06,777 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 09:56:06,860 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:06,860 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:06,860 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:06,860 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:06,860 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:07,093 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:56:07,093 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:56:07,093 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:56:07,093 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:56:07,093 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:56:07,232 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:07,232 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:07,232 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:07,232 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:07,232 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:07,955 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 09:56:07,955 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 09:56:07,955 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 09:56:07,955 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 09:56:07,955 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 09:56:08,103 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:08,103 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:08,103 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:08,103 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:08,103 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:08,106 - INFO: load data for DEBW013 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 09:56:08,106 - INFO: load data for DEBW013 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 09:56:08,106 - INFO: load data for DEBW013 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 09:56:08,106 - INFO: load data for DEBW013 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 09:56:08,106 - INFO: load data for DEBW013 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 09:56:08,664 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:08,664 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:08,664 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:08,664 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:08,664 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:11,127 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:11,127 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:11,127 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:11,127 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:11,127 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:11,902 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:11,902 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:11,902 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:11,902 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:11,902 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:11,930 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:11,930 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:11,930 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:11,930 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:11,930 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:12,636 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:12,636 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:12,636 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:12,636 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:12,636 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:12,678 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:12,678 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:12,678 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:12,678 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:12,678 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:13,721 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:13,721 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:13,721 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:13,721 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:13,721 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:13,764 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:13,764 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:13,764 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:13,764 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:13,764 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:16,650 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:16,650 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:16,650 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:16,650 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:16,650 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:16,698 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:16,698 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:16,698 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:16,698 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:16,698 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:19,773 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:19,773 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:19,773 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:19,773 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:19,773 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:56:19,818 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:19,818 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:19,818 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:19,818 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:19,818 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:24,747 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:56:24,747 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:56:24,747 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:56:24,747 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:56:24,747 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:56:24,804 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:24,804 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:24,804 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:24,804 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:24,804 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:24,807 - INFO: load data for DEBW013 from JOIN [join.py:download_join:63] 2023-06-30 09:56:24,807 - INFO: load data for DEBW013 from JOIN [join.py:download_join:63] 2023-06-30 09:56:24,807 - INFO: load data for DEBW013 from JOIN [join.py:download_join:63] 2023-06-30 09:56:24,807 - INFO: load data for DEBW013 from JOIN [join.py:download_join:63] 2023-06-30 09:56:24,807 - INFO: load data for DEBW013 from JOIN [join.py:download_join:63] 2023-06-30 09:56:25,148 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:25,148 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:25,148 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:25,148 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:25,148 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:27,404 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:27,404 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:27,404 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:27,404 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:27,404 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:27,849 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:27,849 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:27,849 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:27,849 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:27,849 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:56:28,955 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:28,955 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:28,955 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:28,955 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:28,955 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:29,869 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 09:56:29,869 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 09:56:29,869 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 09:56:29,869 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 09:56:29,869 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 [data_loader.py:get_data:152] 2023-06-30 09:56:29,926 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:29,926 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:29,926 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:29,926 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:29,926 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,041 - INFO: setup_samples finished after 0:00:26 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,041 - INFO: setup_samples finished after 0:00:26 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,041 - INFO: setup_samples finished after 0:00:26 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,041 - INFO: setup_samples finished after 0:00:26 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,041 - INFO: setup_samples finished after 0:00:26 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,313 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,313 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,313 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,313 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,313 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,313 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,313 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,313 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,313 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,313 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,577 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:56:30,577 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:56:30,577 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:56:30,577 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:56:30,577 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:56:30,687 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:56:30,687 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:56:30,687 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:56:30,687 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:56:30,687 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:56:30,718 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,718 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,718 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,718 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:30,718 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:31,538 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:56:31,538 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:56:31,538 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:56:31,538 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:56:31,538 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:56:31,579 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:31,579 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:31,579 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:31,579 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:31,579 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:32,419 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 09:56:32,419 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 09:56:32,419 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 09:56:32,419 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 09:56:32,419 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 09:56:32,482 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:32,482 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:32,482 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:32,482 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:32,482 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:56:33,224 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:56:33,224 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:56:33,224 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:56:33,224 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:56:33,224 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:57:33,323 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:01:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:33,323 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:01:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:33,323 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:01:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:33,323 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:01:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:33,323 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:01:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:35,357 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:57:35,357 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:57:35,357 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:57:35,357 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:57:35,357 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 [data_loader.py:get_data:152] 2023-06-30 09:57:35,498 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:35,498 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:35,498 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:35,498 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:35,498 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:36,001 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 09:57:36,001 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 09:57:36,001 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 09:57:36,001 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 09:57:36,001 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 [data_loader.py:get_data:152] 2023-06-30 09:57:36,150 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:36,150 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:36,150 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:36,150 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:36,150 - INFO: https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:36,153 - INFO: load data for DEBW087 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 09:57:36,153 - INFO: load data for DEBW087 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 09:57:36,153 - INFO: load data for DEBW087 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 09:57:36,153 - INFO: load data for DEBW087 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 09:57:36,153 - INFO: load data for DEBW087 from TOAR-DATA [toar_data_v2.py:download_toar:64] 2023-06-30 09:57:36,829 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:36,829 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:36,829 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:36,829 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:36,829 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:40,860 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:40,860 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:40,860 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:40,860 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:40,860 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:41,709 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:41,709 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:41,709 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:41,709 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:41,709 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:41,736 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:41,736 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:41,736 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:41,736 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:41,736 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:42,164 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:42,164 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:42,164 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:42,164 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:42,164 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:42,208 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:42,208 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:42,208 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:42,208 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:42,208 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:44,205 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:44,205 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:44,205 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:44,205 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:44,205 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:44,249 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:44,249 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:44,249 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:44,249 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:44,249 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:46,350 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:46,350 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:46,350 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:46,350 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:46,350 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:46,393 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:46,393 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:46,393 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:46,393 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:46,393 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:50,326 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:50,326 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:50,326 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:50,326 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:50,326 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily [data_loader.py:get_data_with_query:115] 2023-06-30 09:57:50,370 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:50,370 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:50,370 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:50,370 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:50,370 - INFO: https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:55,083 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:57:55,083 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:57:55,083 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:57:55,083 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:57:55,083 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:57:55,140 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:55,140 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:55,140 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:55,140 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:55,140 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:55,143 - INFO: load data for DEBW087 from JOIN [join.py:download_join:63] 2023-06-30 09:57:55,143 - INFO: load data for DEBW087 from JOIN [join.py:download_join:63] 2023-06-30 09:57:55,143 - INFO: load data for DEBW087 from JOIN [join.py:download_join:63] 2023-06-30 09:57:55,143 - INFO: load data for DEBW087 from JOIN [join.py:download_join:63] 2023-06-30 09:57:55,143 - INFO: load data for DEBW087 from JOIN [join.py:download_join:63] 2023-06-30 09:57:55,188 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:57:55,188 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:57:55,188 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:57:55,188 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:57:55,188 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:57:57,170 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:57,170 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:57,170 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:57,170 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:57,170 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:57,991 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:57:57,991 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:57:57,991 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:57:57,991 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:57:57,991 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json [data_loader.py:get_data:152] 2023-06-30 09:57:58,993 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:58,993 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:58,993 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:58,993 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:58,993 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,466 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 09:57:59,466 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 09:57:59,466 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 09:57:59,466 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 09:57:59,466 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 [data_loader.py:get_data:152] 2023-06-30 09:57:59,511 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,511 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,511 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,511 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,511 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,621 - INFO: setup_samples finished after 0:01:30 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,621 - INFO: setup_samples finished after 0:01:30 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,621 - INFO: setup_samples finished after 0:01:30 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,621 - INFO: setup_samples finished after 0:01:30 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,621 - INFO: setup_samples finished after 0:01:30 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,890 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,890 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,890 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,890 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,890 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,890 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,890 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,890 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,890 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:57:59,890 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:00,164 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:00,164 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:00,164 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:00,164 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:00,164 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:00,166 - INFO: run for 0:18:57 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (preprocessing). [pre_processing.py:validate_station:305] 2023-06-30 09:58:00,166 - INFO: run for 0:18:57 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (preprocessing). [pre_processing.py:validate_station:305] 2023-06-30 09:58:00,166 - INFO: run for 0:18:57 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (preprocessing). [pre_processing.py:validate_station:305] 2023-06-30 09:58:00,166 - INFO: run for 0:18:57 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (preprocessing). [pre_processing.py:validate_station:305] 2023-06-30 09:58:00,166 - INFO: run for 0:18:57 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (preprocessing). [pre_processing.py:validate_station:305] 2023-06-30 09:58:00,166 - INFO: check valid stations started (train) [pre_processing.py:validate_station:262] 2023-06-30 09:58:00,166 - INFO: check valid stations started (train) [pre_processing.py:validate_station:262] 2023-06-30 09:58:00,166 - INFO: check valid stations started (train) [pre_processing.py:validate_station:262] 2023-06-30 09:58:00,166 - INFO: check valid stations started (train) [pre_processing.py:validate_station:262] 2023-06-30 09:58:00,166 - INFO: check valid stations started (train) [pre_processing.py:validate_station:262] 2023-06-30 09:58:00,167 - INFO: setup transformation using train data exclusively [pre_processing.py:validate_station:265] 2023-06-30 09:58:00,167 - INFO: setup transformation using train data exclusively [pre_processing.py:validate_station:265] 2023-06-30 09:58:00,167 - INFO: setup transformation using train data exclusively [pre_processing.py:validate_station:265] 2023-06-30 09:58:00,167 - INFO: setup transformation using train data exclusively [pre_processing.py:validate_station:265] 2023-06-30 09:58:00,167 - INFO: setup transformation using train data exclusively [pre_processing.py:validate_station:265] 2023-06-30 09:58:00,167 - INFO: start to calculate transformation parameters. [pre_processing.py:transformation:353] 2023-06-30 09:58:00,167 - INFO: start to calculate transformation parameters. [pre_processing.py:transformation:353] 2023-06-30 09:58:00,167 - INFO: start to calculate transformation parameters. [pre_processing.py:transformation:353] 2023-06-30 09:58:00,167 - INFO: start to calculate transformation parameters. [pre_processing.py:transformation:353] 2023-06-30 09:58:00,167 - INFO: start to calculate transformation parameters. [pre_processing.py:transformation:353] 2023-06-30 09:58:00,173 - INFO: use serial transformation approach [default_data_handler.py:transformation:322] 2023-06-30 09:58:00,173 - INFO: use serial transformation approach [default_data_handler.py:transformation:322] 2023-06-30 09:58:00,173 - INFO: use serial transformation approach [default_data_handler.py:transformation:322] 2023-06-30 09:58:00,173 - INFO: use serial transformation approach [default_data_handler.py:transformation:322] 2023-06-30 09:58:00,173 - INFO: use serial transformation approach [default_data_handler.py:transformation:322] 2023-06-30 09:58:00,236 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:00,236 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:00,236 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:00,236 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:00,236 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:00,529 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:00,529 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:00,529 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:00,529 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:00,529 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:00,831 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:00,831 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:00,831 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:00,831 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:00,831 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,078 - INFO: Store transformation options locally for later use at: /builds/esde/machine-learning/mlair/TestExperiment_daily/data/transformation/transformation.pickle [pre_processing.py:_store_transformation:386] 2023-06-30 09:58:01,078 - INFO: Store transformation options locally for later use at: /builds/esde/machine-learning/mlair/TestExperiment_daily/data/transformation/transformation.pickle [pre_processing.py:_store_transformation:386] 2023-06-30 09:58:01,078 - INFO: Store transformation options locally for later use at: /builds/esde/machine-learning/mlair/TestExperiment_daily/data/transformation/transformation.pickle [pre_processing.py:_store_transformation:386] 2023-06-30 09:58:01,078 - INFO: Store transformation options locally for later use at: /builds/esde/machine-learning/mlair/TestExperiment_daily/data/transformation/transformation.pickle [pre_processing.py:_store_transformation:386] 2023-06-30 09:58:01,078 - INFO: Store transformation options locally for later use at: /builds/esde/machine-learning/mlair/TestExperiment_daily/data/transformation/transformation.pickle [pre_processing.py:_store_transformation:386] 2023-06-30 09:58:01,084 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:01,084 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:01,084 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:01,084 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:01,084 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:01,141 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,141 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,141 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,141 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,141 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,374 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,374 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,374 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,374 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,374 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,374 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,374 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,374 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,374 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,374 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,607 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:01,607 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:01,607 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:01,607 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:01,607 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:01,668 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,668 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,668 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,668 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,668 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,902 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,902 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,902 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,902 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,902 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,902 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,902 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,902 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,902 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:01,902 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,136 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,136 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,136 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,136 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,136 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,197 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,197 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,197 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,197 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,197 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,430 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,430 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,430 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,430 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,430 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,430 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,430 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,430 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,430 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,430 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,665 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,665 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,665 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,665 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,665 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,665 - INFO: run for 0:00:03 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train). [pre_processing.py:validate_station:305] 2023-06-30 09:58:02,665 - INFO: run for 0:00:03 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train). [pre_processing.py:validate_station:305] 2023-06-30 09:58:02,665 - INFO: run for 0:00:03 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train). [pre_processing.py:validate_station:305] 2023-06-30 09:58:02,665 - INFO: run for 0:00:03 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train). [pre_processing.py:validate_station:305] 2023-06-30 09:58:02,665 - INFO: run for 0:00:03 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train). [pre_processing.py:validate_station:305] 2023-06-30 09:58:02,666 - INFO: check valid stations started (val) [pre_processing.py:validate_station:262] 2023-06-30 09:58:02,666 - INFO: check valid stations started (val) [pre_processing.py:validate_station:262] 2023-06-30 09:58:02,666 - INFO: check valid stations started (val) [pre_processing.py:validate_station:262] 2023-06-30 09:58:02,666 - INFO: check valid stations started (val) [pre_processing.py:validate_station:262] 2023-06-30 09:58:02,666 - INFO: check valid stations started (val) [pre_processing.py:validate_station:262] 2023-06-30 09:58:02,672 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:02,672 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:02,672 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:02,672 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:02,672 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:02,725 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,725 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,725 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,725 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,725 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,725 - INFO: remove station DEBW107 because it raised an error: self.history consist of NaNs only - station ['DEBW107'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 09:58:02,725 - INFO: remove station DEBW107 because it raised an error: self.history consist of NaNs only - station ['DEBW107'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 09:58:02,725 - INFO: remove station DEBW107 because it raised an error: self.history consist of NaNs only - station ['DEBW107'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 09:58:02,725 - INFO: remove station DEBW107 because it raised an error: self.history consist of NaNs only - station ['DEBW107'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 09:58:02,725 - INFO: remove station DEBW107 because it raised an error: self.history consist of NaNs only - station ['DEBW107'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 09:58:02,726 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,726 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,726 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,726 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,726 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,778 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,778 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,778 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,778 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,778 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,778 - INFO: remove station DEBW013 because it raised an error: self.history consist of NaNs only - station ['DEBW013'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 09:58:02,778 - INFO: remove station DEBW013 because it raised an error: self.history consist of NaNs only - station ['DEBW013'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 09:58:02,778 - INFO: remove station DEBW013 because it raised an error: self.history consist of NaNs only - station ['DEBW013'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 09:58:02,778 - INFO: remove station DEBW013 because it raised an error: self.history consist of NaNs only - station ['DEBW013'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 09:58:02,778 - INFO: remove station DEBW013 because it raised an error: self.history consist of NaNs only - station ['DEBW013'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 09:58:02,778 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,778 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,778 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,778 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,778 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,830 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,830 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,830 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,830 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,830 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,830 - INFO: remove station DEBW087 because it raised an error: self.history consist of NaNs only - station ['DEBW087'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 09:58:02,830 - INFO: remove station DEBW087 because it raised an error: self.history consist of NaNs only - station ['DEBW087'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 09:58:02,830 - INFO: remove station DEBW087 because it raised an error: self.history consist of NaNs only - station ['DEBW087'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 09:58:02,830 - INFO: remove station DEBW087 because it raised an error: self.history consist of NaNs only - station ['DEBW087'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 09:58:02,830 - INFO: remove station DEBW087 because it raised an error: self.history consist of NaNs only - station ['DEBW087'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') [pre_processing.py:f_proc:489] 2023-06-30 09:58:02,830 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,830 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,830 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,830 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,830 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:02,830 - INFO: run for 0:00:01 (hh:mm:ss) to check 3 station(s). Found 0/3 valid stations (val). [pre_processing.py:validate_station:305] 2023-06-30 09:58:02,830 - INFO: run for 0:00:01 (hh:mm:ss) to check 3 station(s). Found 0/3 valid stations (val). [pre_processing.py:validate_station:305] 2023-06-30 09:58:02,830 - INFO: run for 0:00:01 (hh:mm:ss) to check 3 station(s). Found 0/3 valid stations (val). [pre_processing.py:validate_station:305] 2023-06-30 09:58:02,830 - INFO: run for 0:00:01 (hh:mm:ss) to check 3 station(s). Found 0/3 valid stations (val). [pre_processing.py:validate_station:305] 2023-06-30 09:58:02,830 - INFO: run for 0:00:01 (hh:mm:ss) to check 3 station(s). Found 0/3 valid stations (val). [pre_processing.py:validate_station:305] 2023-06-30 09:58:02,831 - INFO: check valid stations started (test) [pre_processing.py:validate_station:262] 2023-06-30 09:58:02,831 - INFO: check valid stations started (test) [pre_processing.py:validate_station:262] 2023-06-30 09:58:02,831 - INFO: check valid stations started (test) [pre_processing.py:validate_station:262] 2023-06-30 09:58:02,831 - INFO: check valid stations started (test) [pre_processing.py:validate_station:262] 2023-06-30 09:58:02,831 - INFO: check valid stations started (test) [pre_processing.py:validate_station:262] 2023-06-30 09:58:02,837 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:02,837 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:02,837 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:02,837 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:02,837 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:02,893 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,893 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,893 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,893 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:02,893 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,126 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,126 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,126 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,126 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,126 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,126 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,126 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,126 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,126 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,126 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,359 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:03,359 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:03,359 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:03,359 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:03,359 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:03,417 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,417 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,417 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,417 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,417 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,649 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,649 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,649 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,649 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,649 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,650 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,650 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,650 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,650 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,650 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,906 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:03,906 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:03,906 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:03,906 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:03,906 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:03,967 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,967 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,967 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,967 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:03,967 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,200 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,200 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,200 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,200 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,200 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,200 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,200 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,200 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,200 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,200 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,432 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:04,432 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:04,432 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:04,432 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:04,432 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:04,432 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (test). [pre_processing.py:validate_station:305] 2023-06-30 09:58:04,432 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (test). [pre_processing.py:validate_station:305] 2023-06-30 09:58:04,432 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (test). [pre_processing.py:validate_station:305] 2023-06-30 09:58:04,432 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (test). [pre_processing.py:validate_station:305] 2023-06-30 09:58:04,432 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (test). [pre_processing.py:validate_station:305] 2023-06-30 09:58:04,433 - INFO: check valid stations started (train_val) [pre_processing.py:validate_station:262] 2023-06-30 09:58:04,433 - INFO: check valid stations started (train_val) [pre_processing.py:validate_station:262] 2023-06-30 09:58:04,433 - INFO: check valid stations started (train_val) [pre_processing.py:validate_station:262] 2023-06-30 09:58:04,433 - INFO: check valid stations started (train_val) [pre_processing.py:validate_station:262] 2023-06-30 09:58:04,433 - INFO: check valid stations started (train_val) [pre_processing.py:validate_station:262] 2023-06-30 09:58:04,439 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:04,439 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:04,439 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:04,439 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:04,439 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:58:04,497 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,497 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,497 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,497 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,497 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,731 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,731 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,731 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,731 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,731 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,731 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,731 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,731 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,731 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,731 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:04,964 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:04,964 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:04,964 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:04,964 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:04,964 - INFO: ...finished: DEBW107 (33%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:05,027 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,027 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,027 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,027 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,027 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,261 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,261 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,261 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,261 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,261 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,261 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,261 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,261 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,261 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,261 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,496 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:05,496 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:05,496 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:05,496 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:05,496 - INFO: ...finished: DEBW013 (66%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:05,557 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,557 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,557 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,557 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,557 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,791 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,791 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,791 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,791 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,791 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,791 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,791 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,791 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,791 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:05,791 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:58:06,025 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:06,025 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:06,025 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:06,025 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:06,025 - INFO: ...finished: DEBW087 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:58:06,025 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train_val). [pre_processing.py:validate_station:305] 2023-06-30 09:58:06,025 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train_val). [pre_processing.py:validate_station:305] 2023-06-30 09:58:06,025 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train_val). [pre_processing.py:validate_station:305] 2023-06-30 09:58:06,025 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train_val). [pre_processing.py:validate_station:305] 2023-06-30 09:58:06,025 - INFO: run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train_val). [pre_processing.py:validate_station:305] 2023-06-30 09:58:06,028 - INFO: use serial create_info_df (train) [pre_processing.py:create_info_df:180] 2023-06-30 09:58:06,028 - INFO: use serial create_info_df (train) [pre_processing.py:create_info_df:180] 2023-06-30 09:58:06,028 - INFO: use serial create_info_df (train) [pre_processing.py:create_info_df:180] 2023-06-30 09:58:06,028 - INFO: use serial create_info_df (train) [pre_processing.py:create_info_df:180] 2023-06-30 09:58:06,028 - INFO: use serial create_info_df (train) [pre_processing.py:create_info_df:180] 2023-06-30 09:58:06,722 - INFO: use serial create_info_df (val) [pre_processing.py:create_info_df:180] 2023-06-30 09:58:06,722 - INFO: use serial create_info_df (val) [pre_processing.py:create_info_df:180] 2023-06-30 09:58:06,722 - INFO: use serial create_info_df (val) [pre_processing.py:create_info_df:180] 2023-06-30 09:58:06,722 - INFO: use serial create_info_df (val) [pre_processing.py:create_info_df:180] 2023-06-30 09:58:06,722 - INFO: use serial create_info_df (val) [pre_processing.py:create_info_df:180] 2023-06-30 09:58:06,723 - INFO: use serial create_info_df (test) [pre_processing.py:create_info_df:180] 2023-06-30 09:58:06,723 - INFO: use serial create_info_df (test) [pre_processing.py:create_info_df:180] 2023-06-30 09:58:06,723 - INFO: use serial create_info_df (test) [pre_processing.py:create_info_df:180] 2023-06-30 09:58:06,723 - INFO: use serial create_info_df (test) [pre_processing.py:create_info_df:180] 2023-06-30 09:58:06,723 - INFO: use serial create_info_df (test) [pre_processing.py:create_info_df:180] 2023-06-30 09:58:07,471 - INFO: Searching for competitors to be prepared for use. [pre_processing.py:prepare_competitors:395] 2023-06-30 09:58:07,471 - INFO: Searching for competitors to be prepared for use. [pre_processing.py:prepare_competitors:395] 2023-06-30 09:58:07,471 - INFO: Searching for competitors to be prepared for use. [pre_processing.py:prepare_competitors:395] 2023-06-30 09:58:07,471 - INFO: Searching for competitors to be prepared for use. [pre_processing.py:prepare_competitors:395] 2023-06-30 09:58:07,471 - INFO: Searching for competitors to be prepared for use. [pre_processing.py:prepare_competitors:395] 2023-06-30 09:58:07,472 - INFO: No preparation required for competitor ols as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 09:58:07,472 - INFO: No preparation required for competitor ols as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 09:58:07,472 - INFO: No preparation required for competitor ols as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 09:58:07,472 - INFO: No preparation required for competitor ols as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 09:58:07,472 - INFO: No preparation required for competitor ols as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 09:58:07,472 - INFO: No preparation required for competitor persi as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 09:58:07,472 - INFO: No preparation required for competitor persi as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 09:58:07,472 - INFO: No preparation required for competitor persi as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 09:58:07,472 - INFO: No preparation required for competitor persi as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 09:58:07,472 - INFO: No preparation required for competitor persi as no specific instruction is provided. [pre_processing.py:prepare_competitors:425] 2023-06-30 09:58:07,474 - INFO: PreProcessing finished after 0:19:05 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:58:07,474 - INFO: PreProcessing finished after 0:19:05 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:58:07,474 - INFO: PreProcessing finished after 0:19:05 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:58:07,474 - INFO: PreProcessing finished after 0:19:05 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:58:07,474 - INFO: PreProcessing finished after 0:19:05 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:58:07,474 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 09:58:07,474 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 09:58:07,474 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 09:58:07,474 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 09:58:07,474 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 09:58:07,474 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:58:07,474 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:58:07,474 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:58:07,474 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:58:07,474 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:58:12,768 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 09:58:12,768 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 09:58:12,768 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 09:58:12,768 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 09:58:12,768 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 09:58:12,785 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:58:12,785 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:58:12,785 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:58:12,785 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:58:12,785 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 PreProcessing started INFO root:pre_processing.py:262 check valid stations started (preprocessing) INFO root:pre_processing.py:296 use serial validate station approach INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:01:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/variables/o3 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:02:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/variables/o3 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:04:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/variables/o3 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:08:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/variables/o3 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:01:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/variables/temp INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=5 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/search/?station_id=88&variable_id=21 finished after 0:00:01 (hh:mm:ss) INFO root:toar_data_v2.py:64 load data for DEBW107 from TOAR-DATA INFO root:data_loader.py:115 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18650&statistics=dma8eu&sampling=daily finished after 0:00:04 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=23329&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW107&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) INFO root:join.py:63 load data for DEBW107 from JOIN INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17057&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17059&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW107 finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 setup_samples finished after 0:17:01 (hh:mm:ss) INFO root:run_environment.py:120 PartitionCheck finished after 0:17:04 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW107 (33%) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=5 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/search/?station_id=84&variable_id=21 finished after 0:00:01 (hh:mm:ss) INFO root:toar_data_v2.py:64 load data for DEBW013 from TOAR-DATA INFO root:data_loader.py:115 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18629&statistics=dma8eu&sampling=daily finished after 0:00:03 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22604&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW013&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) INFO root:join.py:63 load data for DEBW013 from JOIN INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17031&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:03 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17035&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW013 finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 setup_samples finished after 0:00:26 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW013 (66%) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:01:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=5 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/search/?station_id=83&variable_id=21 finished after 0:00:01 (hh:mm:ss) INFO root:toar_data_v2.py:64 load data for DEBW087 from TOAR-DATA INFO root:data_loader.py:115 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=18649&statistics=dma8eu&sampling=daily finished after 0:00:05 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:115 connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/analysis/statistics/?id=22643&statistics=maximum&sampling=daily finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW087&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) INFO root:join.py:63 load data for DEBW087 from JOIN INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17022&statistics=dma8eu&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/stats/?id=17026&statistics=maximum&sampling=daily&capture=0&format=json finished after 0:00:02 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW087 finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 setup_samples finished after 0:01:30 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW087 (100%) INFO root:pre_processing.py:305 run for 0:18:57 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (preprocessing). INFO root:pre_processing.py:262 check valid stations started (train) INFO root:pre_processing.py:265 setup transformation using train data exclusively INFO root:pre_processing.py:353 start to calculate transformation parameters. INFO root:default_data_handler.py:322 use serial transformation approach INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:386 Store transformation options locally for later use at: /builds/esde/machine-learning/mlair/TestExperiment_daily/data/transformation/transformation.pickle INFO root:pre_processing.py:296 use serial validate station approach INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW107 (33%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW013 (66%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW087 (100%) INFO root:pre_processing.py:305 run for 0:00:03 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train). INFO root:pre_processing.py:262 check valid stations started (val) INFO root:pre_processing.py:296 use serial validate station approach INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:489 remove station DEBW107 because it raised an error: self.history consist of NaNs only - station ['DEBW107'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') INFO root:pre_processing.py:303 ...finished: DEBW107 (33%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:489 remove station DEBW013 because it raised an error: self.history consist of NaNs only - station ['DEBW013'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') INFO root:pre_processing.py:303 ...finished: DEBW013 (66%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:489 remove station DEBW087 because it raised an error: self.history consist of NaNs only - station ['DEBW087'] is therefore dropped -> self.remove_nan(self.time_dim) | File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 591, in remove_nan | raise ValueError(f'self.history consist of NaNs only - station {self.station} is therefore dropped') INFO root:pre_processing.py:303 ...finished: DEBW087 (100%) INFO root:pre_processing.py:305 run for 0:00:01 (hh:mm:ss) to check 3 station(s). Found 0/3 valid stations (val). INFO root:pre_processing.py:262 check valid stations started (test) INFO root:pre_processing.py:296 use serial validate station approach INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW107 (33%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW013 (66%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW087 (100%) INFO root:pre_processing.py:305 run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (test). INFO root:pre_processing.py:262 check valid stations started (train_val) INFO root:pre_processing.py:296 use serial validate station approach INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW107 (33%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW013 (66%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW087 (100%) INFO root:pre_processing.py:305 run for 0:00:02 (hh:mm:ss) to check 3 station(s). Found 3/3 valid stations (train_val). INFO root:pre_processing.py:180 use serial create_info_df (train) INFO root:pre_processing.py:180 use serial create_info_df (val) INFO root:pre_processing.py:180 use serial create_info_df (test) INFO root:pre_processing.py:395 Searching for competitors to be prepared for use. INFO root:pre_processing.py:425 No preparation required for competitor ols as no specific instruction is provided. INFO root:pre_processing.py:425 No preparation required for competitor persi as no specific instruction is provided. INFO root:run_environment.py:120 PreProcessing finished after 0:19:05 (hh:mm:ss) INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:120 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_000.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_run 19.27
No log output captured.
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_split_train_val_test 33.84
No log output captured.
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_create_set_split_not_all_stations 5.50
------------------------------Captured stderr call------------------------------
2023-06-30 09:59:05,919 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 09:59:05,919 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 09:59:05,919 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 09:59:05,919 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 09:59:05,919 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 09:59:05,925 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:05,925 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:05,925 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:05,925 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:05,925 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:05,990 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:05,990 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:05,990 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:05,990 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:05,990 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:06,346 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:06,346 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:06,346 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:06,346 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:06,346 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:06,347 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:06,347 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:06,347 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:06,347 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:06,347 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:06,698 - INFO: ...finished: DEBW107 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:06,698 - INFO: ...finished: DEBW107 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:06,698 - INFO: ...finished: DEBW107 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:06,698 - INFO: ...finished: DEBW107 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:06,698 - INFO: ...finished: DEBW107 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:06,768 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:06,768 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:06,768 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:06,768 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:06,768 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:07,120 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:07,120 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:07,120 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:07,120 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:07,120 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:07,120 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:07,120 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:07,120 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:07,120 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:07,120 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:07,474 - INFO: ...finished: DEBW013 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:07,474 - INFO: ...finished: DEBW013 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:07,474 - INFO: ...finished: DEBW013 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:07,474 - INFO: ...finished: DEBW013 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:07,474 - INFO: ...finished: DEBW013 (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:07,474 - INFO: run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations (awesome). [pre_processing.py:validate_station:305] 2023-06-30 09:59:07,474 - INFO: run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations (awesome). [pre_processing.py:validate_station:305] 2023-06-30 09:59:07,474 - INFO: run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations (awesome). [pre_processing.py:validate_station:305] 2023-06-30 09:59:07,474 - INFO: run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations (awesome). [pre_processing.py:validate_station:305] 2023-06-30 09:59:07,474 - INFO: run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations (awesome). [pre_processing.py:validate_station:305]
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 set: use_all_stations_on_all_data_sets(general)=False DEBUG root:datastore.py:118 get: stations(general.awesome)=['DEBW107', 'DEBW013', 'DEBW087', 'DEBW99X'] DEBUG root:datastore.py:118 get: use_all_stations_on_all_data_sets(general)=False DEBUG root:pre_processing.py:244 Awesome stations (len=2): ['DEBW107', 'DEBW013'] DEBUG root:datastore.py:118 get: data_handler(general)=<class 'mlair.data_handler.default_data_handler.DefaultDataHandler'> INFO root:pre_processing.py:262 check valid stations started (awesome) DEBUG root:datastore.py:118 get: target_dim(general.awesome)=variables DEBUG root:datastore.py:118 get: end(general.awesome)=2017-12-31 DEBUG root:datastore.py:118 get: data_origin(general.awesome)={'o3': 'UBA', 'temp': 'UBA'} DEBUG root:datastore.py:118 get: data_path(general.awesome)=/home/root/mlair/data/ DEBUG root:datastore.py:118 get: sampling(general.awesome)=daily DEBUG root:datastore.py:118 get: use_multiprocessing(general.awesome)=True DEBUG root:datastore.py:118 get: variables(general.awesome)=['o3', 'temp'] DEBUG root:datastore.py:118 get: window_lead_time(general.awesome)=3 DEBUG root:datastore.py:120 get: extremes_on_right_tail_only(general.awesome)=None DEBUG root:datastore.py:120 get: overwrite_local_data(general.awesome)=None DEBUG root:datastore.py:118 get: interpolation_limit(general.awesome)=1 DEBUG root:datastore.py:120 get: window_history_offset(general.awesome)=None DEBUG root:datastore.py:118 get: iter_dim(general.awesome)=Stations DEBUG root:datastore.py:120 get: store_processed_data(general.awesome)=None DEBUG root:datastore.py:120 get: ifs_data_path(general.awesome)=None DEBUG root:datastore.py:120 get: min_length(general.awesome)=None DEBUG root:datastore.py:120 get: store_data_locally(general.awesome)=None DEBUG root:datastore.py:118 get: experiment_path(general.awesome)=/builds/esde/machine-learning/mlair/TestExperiment_daily DEBUG root:datastore.py:120 get: extreme_values(general.awesome)=None DEBUG root:datastore.py:118 get: window_dim(general.awesome)=window DEBUG root:datastore.py:118 get: time_dim(general.awesome)=datetime DEBUG root:datastore.py:120 get: window_history_end(general.awesome)=None DEBUG root:datastore.py:120 get: overwrite_lazy_data(general.awesome)=None DEBUG root:datastore.py:118 get: max_number_multiprocessing(general.awesome)=16 DEBUG root:datastore.py:118 get: start(general.awesome)=1997-01-01 DEBUG root:datastore.py:118 get: transformation(general.awesome)={} DEBUG root:datastore.py:120 get: era5_data_path(general.awesome)=None DEBUG root:datastore.py:118 get: target_var(general.awesome)=o3 DEBUG root:datastore.py:118 get: window_history_size(general.awesome)=13 DEBUG root:datastore.py:120 get: era5_file_names(general.awesome)=None DEBUG root:datastore.py:118 get: interpolation_method(general.awesome)=linear DEBUG root:datastore.py:118 get: statistics_per_var(general.awesome)={'o3': 'dma8eu', 'temp': 'maximum'} DEBUG root:datastore.py:120 get: lazy_preprocessing(general.awesome)=None DEBUG root:datastore.py:120 get: ifs_file_names(general.awesome)=None DEBUG root:datastore.py:120 get: name_affix(general.awesome)=None DEBUG root:datastore.py:118 get: use_multiprocessing(general)=True DEBUG root:datastore.py:118 get: tmp_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/tmp DEBUG root:datastore.py:118 get: max_number_multiprocessing(general)=16 INFO root:pre_processing.py:296 use serial validate station approach DEBUG root:path_config.py:132 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:360 DEBW107: try to load local data from: /home/root/mlair/data/daily/DEBW107_o3_temp.nc DEBUG root:data_handler_single_station.py:364 DEBW107: loading finished INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:218 No extreme values given, skip multiply extremes INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:97 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBW107_awesome.pickle INFO root:pre_processing.py:303 ...finished: DEBW107 (50%) DEBUG root:path_config.py:132 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:360 DEBW013: try to load local data from: /home/root/mlair/data/daily/DEBW013_o3_temp.nc DEBUG root:data_handler_single_station.py:364 DEBW013: loading finished INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:218 No extreme values given, skip multiply extremes INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:97 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBW013_awesome.pickle INFO root:pre_processing.py:303 ...finished: DEBW013 (100%) INFO root:pre_processing.py:305 run for 0:00:02 (hh:mm:ss) to check 2 station(s). Found 2/2 valid stations (awesome). DEBUG root:datastore.py:118 set: stations(general.awesome)=['DEBW107', 'DEBW013'] DEBUG root:datastore.py:118 set: data_collection(general.awesome)=<mlair.data_handler.iterator.DataCollection object at 0x7fea705f9b20> DEBUG root:datastore.py:118 get: data_collection(general.awesome)=<mlair.data_handler.iterator.DataCollection object at 0x7fea705f9b20> DEBUG root:datastore.py:120 get: data_collection(general)=None DEBUG root:datastore.py:118 get: stations(general.awesome)=['DEBW107', 'DEBW013']
----------------------------Captured stderr teardown----------------------------
2023-06-30 09:59:07,476 - INFO: RunEnvironment finished after 0:00:02 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:07,476 - INFO: RunEnvironment finished after 0:00:02 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:07,476 - INFO: RunEnvironment finished after 0:00:02 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:07,476 - INFO: RunEnvironment finished after 0:00:02 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:07,476 - INFO: RunEnvironment finished after 0:00:02 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:11,396 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:11,396 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:11,396 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:11,396 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:11,396 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:11,419 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:11,419 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:11,419 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:11,419 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:11,419 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147]
-----------------------------Captured log teardown------------------------------
INFO root:run_environment.py:120 RunEnvironment finished after 0:00:02 (hh:mm:ss) DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_003.json DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_create_set_split_all_stations 11.05
------------------------------Captured stderr call------------------------------
2023-06-30 09:59:11,428 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 09:59:11,428 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 09:59:11,428 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 09:59:11,428 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 09:59:11,428 - INFO: check valid stations started (awesome) [pre_processing.py:validate_station:262] 2023-06-30 09:59:11,434 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:11,434 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:11,434 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:11,434 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:11,434 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:11,499 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:11,499 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:11,499 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:11,499 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:11,499 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:11,877 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:11,877 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:11,877 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:11,877 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:11,877 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:11,877 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:11,877 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:11,877 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:11,877 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:11,877 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:12,255 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:12,255 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:12,255 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:12,255 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:12,255 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:12,325 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:12,325 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:12,325 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:12,325 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:12,325 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:12,698 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:12,698 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:12,698 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:12,698 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:12,698 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:12,699 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:12,699 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:12,699 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:12,699 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:12,699 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:13,073 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:13,073 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:13,073 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:13,073 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:13,073 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:13,141 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:13,141 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:13,141 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:13,141 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:13,141 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:13,513 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:13,513 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:13,513 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:13,513 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:13,513 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:13,513 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:13,513 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:13,513 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:13,513 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:13,513 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:13,886 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:13,886 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:13,886 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:13,886 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:13,886 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:14,759 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:59:14,759 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:59:14,759 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:59:14,759 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:59:14,759 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:59:14,779 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:14,779 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:14,779 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:14,779 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:14,779 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:14,921 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:59:14,921 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:59:14,921 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:59:14,921 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:59:14,921 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:59:14,957 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:14,957 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:14,957 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:14,957 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:14,957 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:15,110 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:15,110 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:15,110 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:15,110 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:15,110 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:15,167 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:15,167 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:15,167 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:15,167 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:15,167 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:15,593 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:15,593 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:15,593 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:15,593 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:15,593 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:15,847 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:15,847 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:15,847 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:15,847 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:15,847 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:16,587 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:16,587 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:16,587 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:16,587 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:16,587 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:16,643 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:16,643 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:16,643 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:16,643 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:16,643 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:17,162 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:17,162 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:17,162 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:17,162 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:17,162 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:17,213 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:17,213 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:17,213 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:17,213 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:17,213 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:17,833 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:17,833 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:17,833 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:17,833 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:17,833 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:17,889 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:17,889 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:17,889 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:17,889 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:17,889 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:18,357 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:59:18,357 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:59:18,357 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:59:18,357 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:59:18,357 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:59:18,418 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:18,418 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:18,418 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:18,418 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:18,418 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:18,422 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:18,422 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:18,422 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:18,422 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:18,422 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:18,425 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 09:59:18,425 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 09:59:18,425 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 09:59:18,425 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 09:59:18,425 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 09:59:18,427 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:18,427 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:18,427 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:18,427 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:18,427 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:18,427 - INFO: run for 0:00:07 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (awesome). [pre_processing.py:validate_station:305] 2023-06-30 09:59:18,427 - INFO: run for 0:00:07 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (awesome). [pre_processing.py:validate_station:305] 2023-06-30 09:59:18,427 - INFO: run for 0:00:07 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (awesome). [pre_processing.py:validate_station:305] 2023-06-30 09:59:18,427 - INFO: run for 0:00:07 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (awesome). [pre_processing.py:validate_station:305] 2023-06-30 09:59:18,427 - INFO: run for 0:00:07 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (awesome). [pre_processing.py:validate_station:305]
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 get: stations(general.awesome)=['DEBW107', 'DEBW013', 'DEBW087', 'DEBW99X'] DEBUG root:datastore.py:118 get: use_all_stations_on_all_data_sets(general)=True DEBUG root:pre_processing.py:244 Awesome stations (len=4): ['DEBW107', 'DEBW013', 'DEBW087', 'DEBW99X'] DEBUG root:datastore.py:118 get: data_handler(general)=<class 'mlair.data_handler.default_data_handler.DefaultDataHandler'> INFO root:pre_processing.py:262 check valid stations started (awesome) DEBUG root:datastore.py:118 get: target_dim(general.awesome)=variables DEBUG root:datastore.py:118 get: end(general.awesome)=2017-12-31 DEBUG root:datastore.py:118 get: data_origin(general.awesome)={'o3': 'UBA', 'temp': 'UBA'} DEBUG root:datastore.py:118 get: data_path(general.awesome)=/home/root/mlair/data/ DEBUG root:datastore.py:118 get: sampling(general.awesome)=daily DEBUG root:datastore.py:118 get: use_multiprocessing(general.awesome)=True DEBUG root:datastore.py:118 get: variables(general.awesome)=['o3', 'temp'] DEBUG root:datastore.py:118 get: window_lead_time(general.awesome)=3 DEBUG root:datastore.py:120 get: extremes_on_right_tail_only(general.awesome)=None DEBUG root:datastore.py:120 get: overwrite_local_data(general.awesome)=None DEBUG root:datastore.py:118 get: interpolation_limit(general.awesome)=1 DEBUG root:datastore.py:120 get: window_history_offset(general.awesome)=None DEBUG root:datastore.py:118 get: iter_dim(general.awesome)=Stations DEBUG root:datastore.py:120 get: store_processed_data(general.awesome)=None DEBUG root:datastore.py:120 get: ifs_data_path(general.awesome)=None DEBUG root:datastore.py:120 get: min_length(general.awesome)=None DEBUG root:datastore.py:120 get: store_data_locally(general.awesome)=None DEBUG root:datastore.py:118 get: experiment_path(general.awesome)=/builds/esde/machine-learning/mlair/TestExperiment_daily DEBUG root:datastore.py:120 get: extreme_values(general.awesome)=None DEBUG root:datastore.py:118 get: window_dim(general.awesome)=window DEBUG root:datastore.py:118 get: time_dim(general.awesome)=datetime DEBUG root:datastore.py:120 get: window_history_end(general.awesome)=None DEBUG root:datastore.py:120 get: overwrite_lazy_data(general.awesome)=None DEBUG root:datastore.py:118 get: max_number_multiprocessing(general.awesome)=16 DEBUG root:datastore.py:118 get: start(general.awesome)=1997-01-01 DEBUG root:datastore.py:118 get: transformation(general.awesome)={} DEBUG root:datastore.py:120 get: era5_data_path(general.awesome)=None DEBUG root:datastore.py:118 get: target_var(general.awesome)=o3 DEBUG root:datastore.py:118 get: window_history_size(general.awesome)=13 DEBUG root:datastore.py:120 get: era5_file_names(general.awesome)=None DEBUG root:datastore.py:118 get: interpolation_method(general.awesome)=linear DEBUG root:datastore.py:118 get: statistics_per_var(general.awesome)={'o3': 'dma8eu', 'temp': 'maximum'} DEBUG root:datastore.py:120 get: lazy_preprocessing(general.awesome)=None DEBUG root:datastore.py:120 get: ifs_file_names(general.awesome)=None DEBUG root:datastore.py:120 get: name_affix(general.awesome)=None DEBUG root:datastore.py:118 get: use_multiprocessing(general)=True DEBUG root:datastore.py:118 get: tmp_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/tmp DEBUG root:datastore.py:118 get: max_number_multiprocessing(general)=16 INFO root:pre_processing.py:296 use serial validate station approach DEBUG root:path_config.py:132 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:360 DEBW107: try to load local data from: /home/root/mlair/data/daily/DEBW107_o3_temp.nc DEBUG root:data_handler_single_station.py:364 DEBW107: loading finished INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:218 No extreme values given, skip multiply extremes INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:97 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBW107_awesome.pickle INFO root:pre_processing.py:303 ...finished: DEBW107 (25%) DEBUG root:path_config.py:132 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:360 DEBW013: try to load local data from: /home/root/mlair/data/daily/DEBW013_o3_temp.nc DEBUG root:data_handler_single_station.py:364 DEBW013: loading finished INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:218 No extreme values given, skip multiply extremes INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:97 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBW013_awesome.pickle INFO root:pre_processing.py:303 ...finished: DEBW013 (50%) DEBUG root:path_config.py:132 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:360 DEBW087: try to load local data from: /home/root/mlair/data/daily/DEBW087_o3_temp.nc DEBUG root:data_handler_single_station.py:364 DEBW087: loading finished INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:218 No extreme values given, skip multiply extremes INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) DEBUG root:default_data_handler.py:97 save pickle data to /builds/esde/machine-learning/mlair/TestExperiment_daily/data/DEBW087_awesome.pickle INFO root:pre_processing.py:303 ...finished: DEBW087 (75%) DEBUG root:path_config.py:132 Path already exists: /home/root/mlair/data/daily DEBUG root:data_handler_single_station.py:360 DEBW99X: try to load local data from: /home/root/mlair/data/daily/DEBW99X_o3_temp.nc DEBUG root:data_handler_single_station.py:366 DEBW99X: [Errno 2] No such file or directory: b'/home/root/mlair/data/daily/DEBW99X_o3_temp.nc' DEBUG root:data_handler_single_station.py:367 DEBW99X: load new data INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 DEBUG urllib3.connectionpool:connectionpool.py:1003 Starting new HTTPS connection (1): toar-data.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:456 https://toar-data.fz-juelich.de:443 "GET /api/v2/variables/o3 HTTP/1.1" 200 156 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp DEBUG urllib3.connectionpool:connectionpool.py:1003 Starting new HTTPS connection (1): toar-data.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:456 https://toar-data.fz-juelich.de:443 "GET /api/v2/variables/temp HTTP/1.1" 200 161 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X DEBUG urllib3.connectionpool:connectionpool.py:1003 Starting new HTTPS connection (1): toar-data.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:456 https://toar-data.fz-juelich.de:443 "GET /api/v2/stationmeta/DEBW99X HTTP/1.1" 404 54 DEBUG root:data_loader.py:159 There was an error (STATUS 404) for request https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X DEBUG urllib3.connectionpool:connectionpool.py:1003 Starting new HTTPS connection (1): toar-data.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:456 https://toar-data.fz-juelich.de:443 "GET /api/v2/stationmeta/DEBW99X HTTP/1.1" 404 54 DEBUG root:data_loader.py:159 There was an error (STATUS 404) for request https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X DEBUG urllib3.connectionpool:connectionpool.py:1003 Starting new HTTPS connection (1): toar-data.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:456 https://toar-data.fz-juelich.de:443 "GET /api/v2/stationmeta/DEBW99X HTTP/1.1" 404 54 DEBUG root:data_loader.py:159 There was an error (STATUS 404) for request https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X DEBUG urllib3.connectionpool:connectionpool.py:1003 Starting new HTTPS connection (1): toar-data.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:456 https://toar-data.fz-juelich.de:443 "GET /api/v2/stationmeta/DEBW99X HTTP/1.1" 404 54 DEBUG root:data_loader.py:159 There was an error (STATUS 404) for request https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X DEBUG urllib3.connectionpool:connectionpool.py:1003 Starting new HTTPS connection (1): toar-data.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:456 https://toar-data.fz-juelich.de:443 "GET /api/v2/stationmeta/DEBW99X HTTP/1.1" 404 54 DEBUG root:data_loader.py:159 There was an error (STATUS 404) for request https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute DEBUG urllib3.connectionpool:connectionpool.py:1003 Starting new HTTPS connection (1): join.fz-juelich.de:443 DEBUG urllib3.connectionpool:connectionpool.py:456 https://join.fz-juelich.de:443 "GET /services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute HTTP/1.1" 200 2 INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) DEBUG root:join.py:218 ['DEBW99X']: [] INFO root:time_tracking.py:137 setup_samples finished after 0:00:05 (hh:mm:ss) INFO root:pre_processing.py:489 remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( DEBUG root:pre_processing.py:491 detailed information for removal of station DEBW99X: Traceback (most recent call last): File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/file_manager.py", line 199, in _acquire_with_cache_info file = self._cache[self._key] File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/lru_cache.py", line 53, in __getitem__ value = self._cache[key] KeyError: [<class 'netCDF4._netCDF4.Dataset'>, ('/home/root/mlair/data/daily/DEBW99X_o3_temp.nc',), 'r', (('clobber', True), ('diskless', False), ('format', 'NETCDF4'), ('persist', False))] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 361, in load_data data = xr.open_dataarray(file_name) File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/api.py", line 701, in open_dataarray dataset = open_dataset( File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/api.py", line 572, in open_dataset store = opener(filename_or_obj, **extra_kwargs, **backend_kwargs) File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/netCDF4_.py", line 364, in open return cls(manager, group=group, mode=mode, lock=lock, autoclose=autoclose) File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/netCDF4_.py", line 314, in __init__ self.format = self.ds.data_model File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/netCDF4_.py", line 373, in ds return self._acquire() File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/netCDF4_.py", line 367, in _acquire with self._manager.acquire_context(needs_lock) as root: File "/usr/lib64/python3.9/contextlib.py", line 119, in __enter__ return next(self.gen) File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/file_manager.py", line 187, in acquire_context file, cached = self._acquire_with_cache_info(needs_lock) File "/opt/venv/lib64/python3.9/site-packages/xarray/backends/file_manager.py", line 205, in _acquire_with_cache_info file = self._opener(*self._args, **kwargs) File "src/netCDF4/_netCDF4.pyx", line 2353, in netCDF4._netCDF4.Dataset.__init__ File "src/netCDF4/_netCDF4.pyx", line 1963, in netCDF4._netCDF4._ensure_nc_success FileNotFoundError: [Errno 2] No such file or directory: b'/home/root/mlair/data/daily/DEBW99X_o3_temp.nc' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/builds/esde/machine-learning/mlair/mlair/run_modules/pre_processing.py", line 486, in f_proc res = data_handler.build(station, name_affix=name_affix, store_processed_data=store, **kwargs) File "/builds/esde/machine-learning/mlair/mlair/data_handler/default_data_handler.py", line 72, in build sp = cls.data_handler(station, **sp_keys) File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 125, in __init__ self.setup_samples() File "/builds/esde/machine-learning/mlair/mlair/helpers/time_tracking.py", line 40, in __call__ return self.__wrapped__(*args, **kwargs) File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 271, in setup_samples self.make_input_target() File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 312, in make_input_target data, self.meta = self.load_data(self.path, self.station, stats_per_var, self.sampling, File "/builds/esde/machine-learning/mlair/mlair/data_handler/data_handler_single_station.py", line 368, in load_data data, meta = data_sources.download_data(file_name, meta_file, station, statistics_per_var, sampling, File "/builds/esde/machine-learning/mlair/mlair/helpers/data_sources/data_loader.py", line 69, in download_data df_toar, meta_toar = data_sources.toar_data.download_toar(station=station, toar_stats=toar_stats, File "/builds/esde/machine-learning/mlair/mlair/helpers/data_sources/toar_data.py", line 33, in download_toar xarr_merged = xr.DataArray(df_merged, dims=[time_dim, target_dim]) File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 403, in __init__ coords, dims = _infer_coords_and_dims(data.shape, coords, dims) File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims raise ValueError( ValueError: different number of dimensions on data and dims: 0 vs 2 INFO root:pre_processing.py:303 ...finished: DEBW99X (100%) INFO root:pre_processing.py:305 run for 0:00:07 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (awesome). DEBUG root:datastore.py:118 set: stations(general.awesome)=['DEBW107', 'DEBW013', 'DEBW087'] DEBUG root:datastore.py:118 set: data_collection(general.awesome)=<mlair.data_handler.iterator.DataCollection object at 0x7fea705f9370> DEBUG root:datastore.py:118 get: data_collection(general.awesome)=<mlair.data_handler.iterator.DataCollection object at 0x7fea705f9370> DEBUG root:datastore.py:120 get: data_collection(general)=None DEBUG root:datastore.py:118 get: stations(general.awesome)=['DEBW107', 'DEBW013', 'DEBW087']
----------------------------Captured stderr teardown----------------------------
2023-06-30 09:59:18,432 - INFO: RunEnvironment finished after 0:00:08 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:18,432 - INFO: RunEnvironment finished after 0:00:08 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:18,432 - INFO: RunEnvironment finished after 0:00:08 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:18,432 - INFO: RunEnvironment finished after 0:00:08 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:18,432 - INFO: RunEnvironment finished after 0:00:08 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:22,451 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:22,451 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:22,451 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:22,451 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:22,451 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:22,475 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:22,475 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:22,475 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:22,475 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:22,475 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147]
-----------------------------Captured log teardown------------------------------
INFO root:run_environment.py:120 RunEnvironment finished after 0:00:08 (hh:mm:ss) DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_004.json DEBUG root:datastore.py:118 get: logging_path(general)=/builds/esde/machine-learning/mlair/TestExperiment_daily/logging INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_validate_station_serial[None] 11.46
------------------------------Captured stderr call------------------------------
2023-06-30 09:59:22,483 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 09:59:22,483 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 09:59:22,483 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 09:59:22,483 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 09:59:22,483 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 09:59:22,487 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:22,487 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:22,487 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:22,487 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:22,487 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:22,551 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:22,551 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:22,551 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:22,551 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:22,551 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:22,946 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:22,946 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:22,946 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:22,946 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:22,946 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:22,946 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:22,946 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:22,946 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:22,946 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:22,946 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:23,335 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:23,335 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:23,335 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:23,335 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:23,335 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:23,405 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:23,405 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:23,405 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:23,405 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:23,405 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:23,792 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:23,792 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:23,792 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:23,792 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:23,792 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:23,792 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:23,792 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:23,792 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:23,792 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:23,792 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:24,188 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:24,188 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:24,188 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:24,188 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:24,188 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:24,257 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:24,257 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:24,257 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:24,257 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:24,257 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:24,646 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:24,646 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:24,646 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:24,646 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:24,646 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:24,647 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:24,647 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:24,647 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:24,647 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:24,647 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:25,036 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:25,036 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:25,036 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:25,036 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:25,036 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:25,979 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:59:25,979 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:59:25,979 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:59:25,979 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:59:25,979 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:59:26,002 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:26,002 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:26,002 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:26,002 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:26,002 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:26,679 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:59:26,679 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:59:26,679 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:59:26,679 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:59:26,679 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:59:26,712 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:26,712 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:26,712 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:26,712 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:26,712 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:27,579 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:27,579 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:27,579 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:27,579 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:27,579 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:27,628 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:27,628 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:27,628 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:27,628 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:27,628 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:27,631 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:27,631 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:27,631 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:27,631 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:27,631 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:27,680 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:27,680 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:27,680 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:27,680 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:27,680 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:28,238 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:28,238 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:28,238 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:28,238 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:28,238 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:28,288 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:28,288 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:28,288 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:28,288 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:28,288 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,271 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:29,271 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:29,271 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:29,271 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:29,271 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:29,322 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,322 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,322 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,322 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,322 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,382 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:29,382 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:29,382 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:29,382 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:29,382 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:29,438 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,438 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,438 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,438 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,438 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,783 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:59:29,783 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:59:29,783 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:59:29,783 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:59:29,783 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:59:29,840 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,840 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,840 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,840 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,840 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,843 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,843 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,843 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,843 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,843 - INFO: setup_samples finished after 0:00:05 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:29,846 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 09:59:29,846 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 09:59:29,846 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 09:59:29,846 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 09:59:29,846 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 09:59:29,848 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:29,848 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:29,848 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:29,848 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:29,848 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:29,848 - INFO: run for 0:00:08 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305] 2023-06-30 09:59:29,848 - INFO: run for 0:00:08 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305] 2023-06-30 09:59:29,848 - INFO: run for 0:00:08 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305] 2023-06-30 09:59:29,848 - INFO: run for 0:00:08 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305] 2023-06-30 09:59:29,848 - INFO: run for 0:00:08 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305]
-------------------------------Captured log call--------------------------------
INFO root:pre_processing.py:262 check valid stations started (all) INFO root:pre_processing.py:296 use serial validate station approach INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW107 (25%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW013 (50%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW087 (75%) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 setup_samples finished after 0:00:05 (hh:mm:ss) INFO root:pre_processing.py:489 remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( INFO root:pre_processing.py:303 ...finished: DEBW99X (100%) INFO root:pre_processing.py:305 run for 0:00:08 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None).
----------------------------Captured stderr teardown----------------------------
2023-06-30 09:59:29,853 - INFO: RunEnvironment finished after 0:00:08 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:29,853 - INFO: RunEnvironment finished after 0:00:08 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:29,853 - INFO: RunEnvironment finished after 0:00:08 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:29,853 - INFO: RunEnvironment finished after 0:00:08 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:29,853 - INFO: RunEnvironment finished after 0:00:08 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:33,912 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:33,912 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:33,912 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:33,912 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:33,912 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:33,939 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:33,939 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:33,939 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:33,939 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:33,939 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147]
-----------------------------Captured log teardown------------------------------
INFO root:run_environment.py:120 RunEnvironment finished after 0:00:08 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_005.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_validate_station_serial[tester] 13.11
------------------------------Captured stderr call------------------------------
2023-06-30 09:59:33,948 - INFO: check valid stations started (tester) [pre_processing.py:validate_station:262] 2023-06-30 09:59:33,948 - INFO: check valid stations started (tester) [pre_processing.py:validate_station:262] 2023-06-30 09:59:33,948 - INFO: check valid stations started (tester) [pre_processing.py:validate_station:262] 2023-06-30 09:59:33,948 - INFO: check valid stations started (tester) [pre_processing.py:validate_station:262] 2023-06-30 09:59:33,948 - INFO: check valid stations started (tester) [pre_processing.py:validate_station:262] 2023-06-30 09:59:33,952 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:33,952 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:33,952 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:33,952 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:33,952 - INFO: use serial validate station approach [pre_processing.py:validate_station:296] 2023-06-30 09:59:34,022 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,022 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,022 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,022 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,022 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,449 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,449 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,449 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,449 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,449 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,450 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,450 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,450 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,450 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,450 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,872 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:34,872 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:34,872 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:34,872 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:34,872 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:34,945 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,945 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,945 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,945 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:34,945 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:35,365 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:35,365 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:35,365 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:35,365 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:35,365 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:35,365 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:35,365 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:35,365 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:35,365 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:35,365 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:35,790 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:35,790 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:35,790 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:35,790 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:35,790 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:35,863 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:35,863 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:35,863 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:35,863 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:35,863 - INFO: setup_samples finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:36,292 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:36,292 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:36,292 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:36,292 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:36,292 - INFO: harmonise_X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:36,292 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:36,292 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:36,292 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:36,292 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:36,292 - INFO: multiply_extremes finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:36,716 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:36,716 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:36,716 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:36,716 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:36,716 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:37,151 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:59:37,151 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:59:37,151 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:59:37,151 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:59:37,151 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 [data_loader.py:get_data:152] 2023-06-30 09:59:37,177 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:37,177 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:37,177 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:37,177 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:37,177 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:37,456 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:59:37,456 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:59:37,456 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:59:37,456 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:59:37,456 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp [data_loader.py:get_data:152] 2023-06-30 09:59:37,492 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:37,492 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:37,492 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:37,492 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:37,492 - INFO: https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:38,197 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:38,197 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:38,197 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:38,197 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:38,197 - INFO: connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:38,250 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:38,250 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:38,250 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:38,250 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:38,250 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:39,017 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:39,017 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:39,017 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:39,017 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:39,017 - INFO: connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:39,283 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:39,283 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:39,283 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:39,283 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:39,283 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:40,267 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:40,267 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:40,267 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:40,267 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:40,267 - INFO: connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:40,319 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:40,319 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:40,319 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:40,319 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:40,319 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:40,755 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:40,755 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:40,755 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:40,755 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:40,755 - INFO: connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:40,807 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:40,807 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:40,807 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:40,807 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:40,807 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:41,517 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:41,517 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:41,517 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:41,517 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:41,517 - INFO: connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X [data_loader.py:get_data:152] 2023-06-30 09:59:41,567 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:41,567 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:41,567 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:41,567 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:41,567 - INFO: https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:42,336 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:59:42,336 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:59:42,336 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:59:42,336 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:59:42,336 - INFO: connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute [data_loader.py:get_data:152] 2023-06-30 09:59:42,395 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:42,395 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:42,395 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:42,395 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:42,395 - INFO: https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:42,399 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:42,399 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:42,399 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:42,399 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:42,399 - INFO: setup_samples finished after 0:00:06 (hh:mm:ss) [time_tracking.py:__exit__:137] 2023-06-30 09:59:42,401 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 09:59:42,401 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 09:59:42,401 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 09:59:42,401 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 09:59:42,401 - INFO: remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( [pre_processing.py:f_proc:489] 2023-06-30 09:59:42,402 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:42,402 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:42,402 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:42,402 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:42,402 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:303] 2023-06-30 09:59:42,403 - INFO: run for 0:00:09 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (tester). [pre_processing.py:validate_station:305] 2023-06-30 09:59:42,403 - INFO: run for 0:00:09 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (tester). [pre_processing.py:validate_station:305] 2023-06-30 09:59:42,403 - INFO: run for 0:00:09 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (tester). [pre_processing.py:validate_station:305] 2023-06-30 09:59:42,403 - INFO: run for 0:00:09 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (tester). [pre_processing.py:validate_station:305] 2023-06-30 09:59:42,403 - INFO: run for 0:00:09 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (tester). [pre_processing.py:validate_station:305]
-------------------------------Captured log call--------------------------------
INFO root:pre_processing.py:262 check valid stations started (tester) INFO root:pre_processing.py:296 use serial validate station approach INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW107 (25%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW013 (50%) INFO root:time_tracking.py:137 setup_samples finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 harmonise_X finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 multiply_extremes finished after 0:00:01 (hh:mm:ss) INFO root:pre_processing.py:303 ...finished: DEBW087 (75%) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/o3 INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/o3 finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/variables/temp INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/variables/temp finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=1, timeout=120) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=2, timeout=240) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=3, timeout=480) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=4, timeout=960) https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X INFO root:time_tracking.py:137 https://toar-data.fz-juelich.de/api/v2/stationmeta/DEBW99X finished after 0:00:01 (hh:mm:ss) INFO root:data_loader.py:152 connect (retry=0, timeout=60) https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute INFO root:time_tracking.py:137 https://join.fz-juelich.de/services/rest/surfacedata/search/?station_id=DEBW99X&network_name=UBA&as_dict=true&parameter_name=o3,temp&columns=id,network_name,station_id,parameter_name,parameter_label,parameter_attribute finished after 0:00:01 (hh:mm:ss) INFO root:time_tracking.py:137 setup_samples finished after 0:00:06 (hh:mm:ss) INFO root:pre_processing.py:489 remove station DEBW99X because it raised an error: different number of dimensions on data and dims: 0 vs 2 -> coords, dims = _infer_coords_and_dims(data.shape, coords, dims) | File "/opt/venv/lib64/python3.9/site-packages/xarray/core/dataarray.py", line 121, in _infer_coords_and_dims | raise ValueError( INFO root:pre_processing.py:303 ...finished: DEBW99X (100%) INFO root:pre_processing.py:305 run for 0:00:09 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (tester).
----------------------------Captured stderr teardown----------------------------
2023-06-30 09:59:42,406 - INFO: RunEnvironment finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:42,406 - INFO: RunEnvironment finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:42,406 - INFO: RunEnvironment finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:42,406 - INFO: RunEnvironment finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:42,406 - INFO: RunEnvironment finished after 0:00:09 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:47,026 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:47,026 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:47,026 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:47,026 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:47,026 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:47,054 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:47,054 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:47,054 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:47,054 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:47,054 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147]
-----------------------------Captured log teardown------------------------------
INFO root:run_environment.py:120 RunEnvironment finished after 0:00:09 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_006.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_validate_station_parallel 9.33
------------------------------Captured stderr call------------------------------
2023-06-30 09:59:47,063 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 09:59:47,063 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 09:59:47,063 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 09:59:47,063 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 09:59:47,063 - INFO: check valid stations started (all) [pre_processing.py:validate_station:262] 2023-06-30 09:59:47,067 - INFO: use parallel validate station approach [pre_processing.py:validate_station:277] 2023-06-30 09:59:47,067 - INFO: use parallel validate station approach [pre_processing.py:validate_station:277] 2023-06-30 09:59:47,067 - INFO: use parallel validate station approach [pre_processing.py:validate_station:277] 2023-06-30 09:59:47,067 - INFO: use parallel validate station approach [pre_processing.py:validate_station:277] 2023-06-30 09:59:47,067 - INFO: use parallel validate station approach [pre_processing.py:validate_station:277] 2023-06-30 09:59:47,067 - INFO: running 3 processes in parallel [pre_processing.py:validate_station:279] 2023-06-30 09:59:47,067 - INFO: running 3 processes in parallel [pre_processing.py:validate_station:279] 2023-06-30 09:59:47,067 - INFO: running 3 processes in parallel [pre_processing.py:validate_station:279] 2023-06-30 09:59:47,067 - INFO: running 3 processes in parallel [pre_processing.py:validate_station:279] 2023-06-30 09:59:47,067 - INFO: running 3 processes in parallel [pre_processing.py:validate_station:279] 2023-06-30 09:59:47,592 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:47,592 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:47,592 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:47,592 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:47,592 - INFO: ...finished: DEBW107 (25%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:47,669 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:47,669 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:47,669 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:47,669 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:47,669 - INFO: ...finished: DEBW013 (50%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:47,675 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:47,675 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:47,675 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:47,675 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:47,675 - INFO: ...finished: DEBW087 (75%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:51,896 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:51,896 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:51,896 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:51,896 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:51,896 - INFO: ...finished: DEBW99X (100%) [pre_processing.py:validate_station:286] 2023-06-30 09:59:51,945 - INFO: run for 0:00:05 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305] 2023-06-30 09:59:51,945 - INFO: run for 0:00:05 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305] 2023-06-30 09:59:51,945 - INFO: run for 0:00:05 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305] 2023-06-30 09:59:51,945 - INFO: run for 0:00:05 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305] 2023-06-30 09:59:51,945 - INFO: run for 0:00:05 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None). [pre_processing.py:validate_station:305]
-------------------------------Captured log call--------------------------------
INFO root:pre_processing.py:262 check valid stations started (all) INFO root:pre_processing.py:277 use parallel validate station approach INFO root:pre_processing.py:279 running 3 processes in parallel INFO root:pre_processing.py:286 ...finished: DEBW107 (25%) INFO root:pre_processing.py:286 ...finished: DEBW013 (50%) INFO root:pre_processing.py:286 ...finished: DEBW087 (75%) INFO root:pre_processing.py:286 ...finished: DEBW99X (100%) INFO root:pre_processing.py:305 run for 0:00:05 (hh:mm:ss) to check 4 station(s). Found 3/4 valid stations (None).
----------------------------Captured stderr teardown----------------------------
2023-06-30 09:59:51,947 - INFO: RunEnvironment finished after 0:00:05 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:51,947 - INFO: RunEnvironment finished after 0:00:05 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:51,947 - INFO: RunEnvironment finished after 0:00:05 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:51,947 - INFO: RunEnvironment finished after 0:00:05 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:51,947 - INFO: RunEnvironment finished after 0:00:05 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 09:59:56,361 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:56,361 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:56,361 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:56,361 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:56,361 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json [run_environment.py:__save_tracking:159] 2023-06-30 09:59:56,390 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:56,390 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:56,390 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:56,390 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 09:59:56,390 - INFO: Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log [run_environment.py:__move_log_file:147]
-----------------------------Captured log teardown------------------------------
INFO root:run_environment.py:120 RunEnvironment finished after 0:00:05 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/tracking_007.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/TestExperiment_daily/logging/logging_000.log
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_split_set_indices 4.18
No log output captured.
Passed test/test_run_modules/test_pre_processing.py::TestPreProcessing::test_transformation 0.00
No log output captured.
Passed test/test_run_modules/test_run_environment.py::TestRunEnvironment::test_enter 4.79
------------------------------Captured stderr call------------------------------
2023-06-30 10:00:00,590 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:00,590 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:00,590 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:00,590 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:00,590 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:00,591 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:00,591 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:00,591 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:00,591 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:00,591 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:05,358 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:05,358 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:05,358 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:05,358 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:05,358 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:05,387 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:00:05,387 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:00:05,387 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:00:05,387 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:00:05,387 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:120 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/logging_000.log
Passed test/test_run_modules/test_run_environment.py::TestRunEnvironment::test_exit 4.31
------------------------------Captured stderr call------------------------------
2023-06-30 10:00:05,390 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:05,390 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:05,390 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:05,390 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:05,390 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:05,490 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:05,490 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:05,490 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:05,490 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:05,490 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:09,674 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:09,674 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:09,674 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:09,674 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:09,674 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:09,702 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:00:09,702 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:00:09,702 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:00:09,702 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:00:09,702 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:120 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/tracking_001.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/logging_000.log
Passed test/test_run_modules/test_run_environment.py::TestRunEnvironment::test_init 4.23
------------------------------Captured stderr call------------------------------
2023-06-30 10:00:09,705 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:09,705 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:09,705 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:09,705 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:09,705 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:09,705 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:09,705 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:09,705 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:09,705 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:09,705 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:13,912 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:13,912 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:13,912 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:13,912 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:13,912 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:13,940 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:00:13,940 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:00:13,940 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:00:13,940 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:00:13,940 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:120 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/tracking_002.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/logging_000.log
Passed test/test_run_modules/test_run_environment.py::TestRunEnvironment::test_del 4.40
------------------------------Captured stderr call------------------------------
2023-06-30 10:00:13,943 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:13,943 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:13,943 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:13,943 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:13,943 - INFO: RunEnvironment started [run_environment.py:__init__:103] 2023-06-30 10:00:14,143 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:14,143 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:14,143 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:14,143 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:14,143 - INFO: RunEnvironment finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:00:18,318 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:18,318 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:18,318 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:18,318 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:18,318 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json [run_environment.py:__save_tracking:159] 2023-06-30 10:00:18,346 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:00:18,346 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:00:18,346 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:00:18,346 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:00:18,346 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 RunEnvironment started INFO root:run_environment.py:120 RunEnvironment finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/tracking_003.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/logging_000.log
Passed test/test_run_modules/test_training.py::TestTraining::test_init 27.30
-----------------------------Captured stdout setup------------------------------
Model: "model_8" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_33 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_2 (Flatten) (None, 16) 0 _________________________________________________________________ dense_9 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_10 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
------------------------------Captured stdout call------------------------------
Epoch 1/2 13/13 - 0s - loss: 30.5191 - val_loss: 25.2394 Epoch 2/2 13/13 - 0s - loss: 17.1131 - val_loss: 18.8627
------------------------------Captured stderr call------------------------------
2023-06-30 10:00:43.875640: W tensorflow/python/util/util.cc:348] Sets are not currently considered sequences, but this may change in the future, so consider avoiding using them.
Passed test/test_run_modules/test_training.py::TestTraining::test_no_training 32.01
-----------------------------Captured stdout setup------------------------------
Model: "model_9" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_34 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_3 (Flatten) (None, 16) 0 _________________________________________________________________ dense_11 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_12 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
------------------------------Captured stderr call------------------------------
2023-06-30 10:01:17,678 - INFO: Training started [run_environment.py:__init__:103] 2023-06-30 10:01:17,678 - INFO: Training started [run_environment.py:__init__:103] 2023-06-30 10:01:17,678 - INFO: Training started [run_environment.py:__init__:103] 2023-06-30 10:01:17,678 - INFO: Training started [run_environment.py:__init__:103] 2023-06-30 10:01:17,678 - INFO: Training started [run_environment.py:__init__:103] 2023-06-30 10:01:17,679 - INFO: No training has started, because train_model parameter was false. [training.py:_run:92] 2023-06-30 10:01:17,679 - INFO: No training has started, because train_model parameter was false. [training.py:_run:92] 2023-06-30 10:01:17,679 - INFO: No training has started, because train_model parameter was false. [training.py:_run:92] 2023-06-30 10:01:17,679 - INFO: No training has started, because train_model parameter was false. [training.py:_run:92] 2023-06-30 10:01:17,679 - INFO: No training has started, because train_model parameter was false. [training.py:_run:92] 2023-06-30 10:01:17,679 - INFO: Training finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:01:17,679 - INFO: Training finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:01:17,679 - INFO: Training finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:01:17,679 - INFO: Training finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:01:17,679 - INFO: Training finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 Training started INFO root:training.py:92 No training has started, because train_model parameter was false. INFO root:run_environment.py:120 Training finished after 0:00:01 (hh:mm:ss)
Passed test/test_run_modules/test_training.py::TestTraining::test_run 30.66
-----------------------------Captured stdout setup------------------------------
Model: "model_10" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_35 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_4 (Flatten) (None, 16) 0 _________________________________________________________________ dense_13 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_14 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
------------------------------Captured stdout call------------------------------
Epoch 1/2 13/13 - 1s - loss: 7939.2661 - mse: 448.5900 - mae: 16.5752 - var_loss: 15429.9424 - val_loss: 7103.3276 - val_mse: 812.1241 - val_mae: 22.4248 - val_var_loss: 13394.5303 Epoch 2/2 13/13 - 0s - loss: 4070.8794 - mse: 775.0147 - mae: 21.9497 - var_loss: 7366.7446 - val_loss: 3446.2437 - val_mse: 727.6967 - val_mae: 21.4421 - val_var_loss: 6164.7915
Passed test/test_run_modules/test_training.py::TestTraining::test_make_predict_function 4.43
-----------------------------Captured stdout setup------------------------------
Model: "model_11" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_36 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_5 (Flatten) (None, 16) 0 _________________________________________________________________ dense_15 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_16 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_training.py::TestTraining::test_set_gen 4.63
-----------------------------Captured stdout setup------------------------------
Model: "model_12" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_37 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_6 (Flatten) (None, 16) 0 _________________________________________________________________ dense_17 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_18 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_training.py::TestTraining::test_set_generators 4.44
-----------------------------Captured stdout setup------------------------------
Model: "model_13" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_38 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_7 (Flatten) (None, 16) 0 _________________________________________________________________ dense_19 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_20 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_training.py::TestTraining::test_train 32.63
-----------------------------Captured stdout setup------------------------------
Model: "model_14" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_39 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_8 (Flatten) (None, 16) 0 _________________________________________________________________ dense_21 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_22 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
------------------------------Captured stdout call------------------------------
Epoch 1/2 13/13 - 0s - loss: 22.7268 - val_loss: 20.0038 Epoch 2/2 13/13 - 0s - loss: 20.7756 - val_loss: 14.5490
Passed test/test_run_modules/test_training.py::TestTraining::test_save_model 5.10
-----------------------------Captured stdout setup------------------------------
Model: "model_15" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_40 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_9 (Flatten) (None, 16) 0 _________________________________________________________________ dense_23 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_24 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
------------------------------Captured stderr call------------------------------
2023-06-30 10:02:39,140 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:02:39,140 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:02:39,140 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:02:39,140 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:02:39,140 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:02:39,148 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:02:39,148 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:02:39,148 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:02:39,148 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313] 2023-06-30 10:02:39,148 - WARNING: Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. [saving_utils.py:try_build_compiled_arguments:313]
-------------------------------Captured log call--------------------------------
DEBUG root:datastore.py:118 get: model_name(general.model)=/builds/esde/machine-learning/mlair/test/test_run_modules/TestExperiment/model/test_model.h5 DEBUG root:training.py:188 save model to /builds/esde/machine-learning/mlair/test/test_run_modules/TestExperiment/model/test_model.h5 WARNING tensorflow:saving_utils.py:313 Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. WARNING tensorflow:saving_utils.py:313 Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model. DEBUG root:datastore.py:118 set: model(general)=<mlair.model_modules.fully_connected_networks.FCN object at 0x7fea90135c40>
Passed test/test_run_modules/test_training.py::TestTraining::test_save_callbacks_history_created 4.57
-----------------------------Captured stdout setup------------------------------
Model: "model_16" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_41 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_10 (Flatten) (None, 16) 0 _________________________________________________________________ dense_25 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_26 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_training.py::TestTraining::test_save_callbacks_lr_created 5.02
-----------------------------Captured stdout setup------------------------------
Model: "model_17" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_42 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_11 (Flatten) (None, 16) 0 _________________________________________________________________ dense_27 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_28 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_training.py::TestTraining::test_save_callbacks_inspect_history 4.72
-----------------------------Captured stdout setup------------------------------
Model: "model_18" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_43 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_12 (Flatten) (None, 16) 0 _________________________________________________________________ dense_29 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_30 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_training.py::TestTraining::test_save_callbacks_inspect_lr 4.91
-----------------------------Captured stdout setup------------------------------
Model: "model_19" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_44 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_13 (Flatten) (None, 16) 0 _________________________________________________________________ dense_31 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_32 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_training.py::TestTraining::test_create_monitoring_plots 5.02
-----------------------------Captured stdout setup------------------------------
Model: "model_20" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_45 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_14 (Flatten) (None, 16) 0 _________________________________________________________________ dense_33 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_34 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None
Passed test/test_run_modules/test_training.py::TestTraining::test_resume_training1 32.93
------------------------------Captured stdout call------------------------------
Model: "model_21" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_46 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_15 (Flatten) (None, 16) 0 _________________________________________________________________ dense_35 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_36 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None Epoch 1/4 13/13 - 1s - loss: 10468.7080 - mse: 421.2747 - mae: 15.9364 - var_loss: 20516.1465 - val_loss: 4670.6558 - val_mse: 744.8405 - val_mae: 21.6586 - val_var_loss: 8596.4697 Epoch 2/4 13/13 - 0s - loss: 4997.8604 - mse: 855.0233 - mae: 22.9078 - var_loss: 9140.6973 - val_loss: 5744.1064 - val_mse: 859.4410 - val_mae: 23.4845 - val_var_loss: 10628.7705 Epoch 3/4 13/13 - 0s - loss: 1597.7578 - mse: 767.1860 - mae: 21.5205 - var_loss: 2428.3296 - val_loss: 6977.8047 - val_mse: 678.6956 - val_mae: 19.8118 - val_var_loss: 13276.9131 Epoch 4/4 13/13 - 0s - loss: 10075.2930 - mse: 525.5815 - mae: 17.8715 - var_loss: 19625.0059 - val_loss: 3941.2266 - val_mse: 298.4184 - val_mae: 13.7603 - val_var_loss: 7584.0356 Model: "model_22" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_47 (InputLayer) [(None, 8, 1, 2)] 0 _________________________________________________________________ flatten_16 (Flatten) (None, 16) 0 _________________________________________________________________ dense_37 (Dense) (None, 10) 170 _________________________________________________________________ relu_1 (ReLU) (None, 10) 0 _________________________________________________________________ dense_38 (Dense) (None, 2) 22 _________________________________________________________________ linear_output (Activation) (None, 2) 0 ================================================================= Total params: 192 Trainable params: 192 Non-trainable params: 0 _________________________________________________________________ None Epoch 5/8 13/13 - 1s - loss: 1748.2147 - mse: 231.3290 - mae: 12.0762 - var_loss: 3265.1001 - val_loss: 475.7632 - val_mse: 185.6016 - val_mae: 10.8320 - val_var_loss: 765.9248 Epoch 6/8 13/13 - 0s - loss: 479.7494 - mse: 174.8763 - mae: 10.5260 - var_loss: 784.6223 - val_loss: 341.7430 - val_mse: 167.3031 - val_mae: 10.2839 - val_var_loss: 516.1827 Epoch 7/8 13/13 - 0s - loss: 479.2726 - mse: 167.3245 - mae: 10.2812 - var_loss: 791.2208 - val_loss: 1230.9269 - val_mse: 178.5996 - val_mae: 10.6079 - val_var_loss: 2283.2539 Epoch 8/8 13/13 - 0s - loss: 790.8780 - mse: 166.3756 - mae: 10.2239 - var_loss: 1415.3802 - val_loss: 348.5510 - val_mse: 163.5889 - val_mae: 10.1450 - val_var_loss: 533.5131
------------------------------Captured stderr call------------------------------
2023-06-30 10:03:37.973854: W tensorflow/core/util/tensor_slice_reader.cc:95] Could not open /builds/esde/machine-learning/mlair/test/test_run_modules/TestExperiment/model_checkpoint: Failed precondition: /builds/esde/machine-learning/mlair/test/test_run_modules/TestExperiment/model_checkpoint; Is a directory: perhaps your file is in a different file format and you need to use a different restore operator?
Passed test/test_workflows/test_abstract_workflow.py::TestWorkflow::test_init 0.00
No log output captured.
Passed test/test_workflows/test_abstract_workflow.py::TestWorkflow::test_add 0.00
No log output captured.
Passed test/test_workflows/test_abstract_workflow.py::TestWorkflow::test_run 5.58
------------------------------Captured stderr call------------------------------
2023-06-30 10:03:41,450 - INFO: Workflow started [run_environment.py:__init__:103] 2023-06-30 10:03:41,450 - INFO: Workflow started [run_environment.py:__init__:103] 2023-06-30 10:03:41,450 - INFO: Workflow started [run_environment.py:__init__:103] 2023-06-30 10:03:41,450 - INFO: Workflow started [run_environment.py:__init__:103] 2023-06-30 10:03:41,450 - INFO: Workflow started [run_environment.py:__init__:103] 2023-06-30 10:03:41,451 - INFO: 6 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:03:41,451 - INFO: 6 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:03:41,451 - INFO: 6 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:03:41,451 - INFO: 6 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:03:41,451 - INFO: 6 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:03:41,451 - INFO: 2 [test_abstract_workflow.py:__init__:42] 2023-06-30 10:03:41,451 - INFO: 2 [test_abstract_workflow.py:__init__:42] 2023-06-30 10:03:41,451 - INFO: 2 [test_abstract_workflow.py:__init__:42] 2023-06-30 10:03:41,451 - INFO: 2 [test_abstract_workflow.py:__init__:42] 2023-06-30 10:03:41,451 - INFO: 2 [test_abstract_workflow.py:__init__:42] 2023-06-30 10:03:41,452 - INFO: 3 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:03:41,452 - INFO: 3 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:03:41,452 - INFO: 3 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:03:41,452 - INFO: 3 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:03:41,452 - INFO: 3 [test_abstract_workflow.py:__init__:37] 2023-06-30 10:03:41,452 - INFO: Workflow finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:03:41,452 - INFO: Workflow finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:03:41,452 - INFO: Workflow finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:03:41,452 - INFO: Workflow finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:03:41,452 - INFO: Workflow finished after 0:00:01 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:03:43,113 - INFO: Training finished after 0:00:10 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:03:43,113 - INFO: Training finished after 0:00:10 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:03:43,113 - INFO: Training finished after 0:00:10 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:03:43,113 - INFO: Training finished after 0:00:10 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:03:43,113 - INFO: Training finished after 0:00:10 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:03:43,113 - INFO: Training finished after 0:00:06 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:03:43,113 - INFO: Training finished after 0:00:06 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:03:43,113 - INFO: Training finished after 0:00:06 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:03:43,113 - INFO: Training finished after 0:00:06 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:03:43,113 - INFO: Training finished after 0:00:06 (hh:mm:ss) [run_environment.py:__del__:120] 2023-06-30 10:03:46,995 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:03:46,995 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:03:46,995 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:03:46,995 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:03:46,995 - INFO: Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json [run_environment.py:__save_tracking:159] 2023-06-30 10:03:47,030 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:03:47,030 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:03:47,030 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:03:47,030 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147] 2023-06-30 10:03:47,030 - INFO: Move log file to /builds/esde/machine-learning/mlair/logging_000.log [run_environment.py:__move_log_file:147]
-------------------------------Captured log call--------------------------------
INFO root:run_environment.py:103 Workflow started INFO root:test_abstract_workflow.py:37 6 INFO root:test_abstract_workflow.py:42 2 INFO root:test_abstract_workflow.py:37 3 INFO root:run_environment.py:120 Workflow finished after 0:00:01 (hh:mm:ss) INFO root:run_environment.py:120 Training finished after 0:00:10 (hh:mm:ss) INFO root:run_environment.py:120 Training finished after 0:00:06 (hh:mm:ss) INFO root:run_environment.py:159 Copy tracker file to /builds/esde/machine-learning/mlair/tracking_000.json INFO root:run_environment.py:147 Move log file to /builds/esde/machine-learning/mlair/logging_000.log
Passed test/test_workflows/test_default_workflow.py::TestDefaultWorkflow::test_init_no_args 0.00
No log output captured.
Passed test/test_workflows/test_default_workflow.py::TestDefaultWorkflow::test_init_with_args 0.00
No log output captured.
Passed test/test_workflows/test_default_workflow.py::TestDefaultWorkflow::test_init_with_kwargs 0.00
No log output captured.
Passed test/test_workflows/test_default_workflow.py::TestDefaultWorkflow::test_setup 0.00
No log output captured.
Passed test/test_workflows/test_default_workflow.py::TestDefaultWorkflowHPC::test_setup 0.01
No log output captured.