2024-03-06T12:33:08Z INFO __main__ 290: PIPELINE VERSION Version: 1.3.1 PROCESSING VERSIONS Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: Ephemeris File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: LevelB File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/levelb/binary.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 2024-03-06T12:33:08Z INFO __main__ 257: CONFIG [Paths] tm_archive = /data/stix/SOLSOC/from_edds/tm/processing fits_archive = /data/stix/out/fits_v1.2.0 spice_kernels = /data/stix/spice/kernels soop_files = /data/stix/SOLSOC/from_soc [Logging] stop_on_error = False [IDLBridge] enabled = True gsw_path = /opt/STIX-GSW batchsize = 30 [Pipeline] status_server_port = 12388 parallel_batchsize_l0 = 100 parallel_batchsize_l1 = 100 parallel_batchsize_l2 = 100 log_level = INFO log_dir = /data/stix/out/fits_v1.2.0/logging error_mail_send = True error_mail_receivers = nicky.hochmuth@ateleris.ch error_mail_smpt_host = lmailer.fhnw.ch error_mail_smpt_port = 25 error_mail_sender = nicky.hochmuth@fhnw.ch start_with_unprocessed = True [Publish] db_file = /home/stixcore/soar_pub/published.sqlite include_levels = L0, L1 waiting_period = 21d target_dir = /home/stixcore/from_pub099 report_mail_receivers = nicky.hochmuth@ateleris.ch report_mail_send = True same_esa_name_dir = /data/stix/out/esa_conflicts rid_lut_file = ./stixcore/data/publish/rid_lut.csv rid_lut_file_update_url = https://datacenter.stix.i4ds.net/api/bsd/info/ batch_size = 20000 fits_dir = /data/stix/out/fits_v1.2.0 target_host = pub026.cs.technik.fhnw.ch supplement_report = /home/stixcore/soar_pub/supplement_report.csv include_products = ql,hk,sci,cal log_dir = /data/stix/out/fits_v1.2.0/logging [SOOP] endpoint = https://solarorbiter.esac.esa.int/soopkitchen/api user = smaloney password = xxxx soop_files_download = ./stixcore/data/soop 2024-03-06T12:33:08Z INFO __main__ 286: SINGLETONS SOOPManager: /data/stix/SOLSOC/from_soc SPICE: [PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20240229_003.tm'), PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20240305_002.tm')] IDBManager: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb Versions: [{'label': '2.26.37', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.37', 'version': ['2', '26', '37']}, {'label': '2.26.36', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.36', 'version': ['2', '26', '36']}, {'label': '2.26.32', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.32', 'version': ['2', '26', '32']}, {'label': '2.26.34', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.34', 'version': ['2', '26', '34']}, {'label': '2.26.38', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38', 'version': ['2', '26', '38']}, {'label': '2.26.33', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.33', 'version': ['2', '26', '33']}, {'label': '2.26.31', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.31', 'version': ['2', '26', '31']}, {'label': '2.26.35', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.35', 'version': ['2', '26', '35']}] Force version: None History: IntervalTree([Interval(0.0, 640198039.0, '2.26.32'), Interval(640198039.0, 640265396.0, '2.26.31'), Interval(640265396.0, 642159993.0, '2.26.32'), Interval(642159993.0, 643123725.0, '2.26.33'), Interval(643123725.0, 677774249.0, '2.26.34'), Interval(677774249.0, 692380776.0, '2.26.35'), Interval(692380776.0, 761270182.0, '2.26.36'), Interval(761270182.0, 4294967295.0, '2.26.38')]) 2024-03-06T12:33:08Z INFO stixcore.processing.TMTCtoLB 30: Processing file: SOCPacketFile('/data/stix/SOLSOC/from_edds/tm/processing/STIX_TM_11AM_BatchRequest.PktTmRaw.SOL.0.2024.043.07.54.41.837.yCrM@2024.066.11.00.01.964.2.xml') 2024-03-06T12:33:13Z INFO stixcore.io.fits.processors 474: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2401233884-55594.fits 2024-03-06T12:33:13Z INFO stixcore.io.fits.processors 443: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2401239142-55590.fits exists appending data 2024-03-06T12:33:13Z INFO stixcore.io.fits.processors 474: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2401239142-55590.fits 2024-03-06T12:33:13Z INFO stixcore.io.fits.processors 474: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2401239176-55591.fits 2024-03-06T12:33:13Z INFO stixcore.io.fits.processors 474: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2401236181-55595.fits 2024-03-06T12:33:14Z INFO stixcore.io.fits.processors 474: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2401234010-55592.fits 2024-03-06T12:33:14Z INFO stixcore.io.fits.processors 474: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2401235955-55593.fits 2024-03-06T12:33:14Z INFO __main__ 211: generated LB files: {PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2401233884-55594.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2401234010-55592.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2401235955-55593.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2401236181-55595.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2401239142-55590.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2401239176-55591.fits')} 2024-03-06T12:33:14Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2024-03-06T12:33:14Z INFO stixcore.ephemeris.manager 179: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20240229_003.tm 2024-03-06T12:33:14Z INFO stixcore.ephemeris.manager 179: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20240305_002.tm 2024-03-06T12:33:14Z WARNING stixcore.products.levelb.binary 322: Incomplete sequence sequence_count sequence_flag scet_coarse -------------- ------------- ----------- 3698 1 763005842 3699 0 763005843 3700 0 763005844 3701 0 763005844 3702 0 763005845 3703 0 763005846 3704 0 763005846 3705 0 763005847 3706 0 763005847 3707 0 763005848 3708 0 763005848 3709 0 763005849 3710 0 763005850 3711 0 763005851 3712 0 763005851 3713 0 763005852 3714 0 763005852 3715 0 763005853 3716 0 763005854 3717 0 763005854 3718 0 763005855 3719 0 763005856 3720 0 763005856 3721 0 763005857 3722 0 763005864 3723 0 763005865 3724 0 763005866 3725 0 763005866 3726 0 763005867 3727 0 763005868 3728 0 763005869 3729 0 763005870 3730 0 763005871 3731 0 763005872 3732 0 763005872 3733 0 763005874 3734 0 763005875 3735 0 763005876 3736 0 763005877 3737 0 763005878 3738 0 763005886 3739 0 763005887 3740 0 763005887 3741 0 763005889 3742 0 763005891 3743 0 763005892 3744 0 763005894 3745 0 763005895 3746 0 763005896 3747 0 763005904 3748 0 763005905 3749 0 763005906 3750 0 763005907 3751 0 763005908 3752 0 763005910 3753 0 763005911 3754 0 763005913 3755 0 763005914 3756 0 763005922 3757 0 763005922 3758 0 763005924 3759 0 763005925 3760 0 763005927 3761 0 763005928 3762 0 763005930 3763 0 763005931 3764 0 763005932 3765 0 763005934 3766 0 763005934 3767 0 763005942 3768 0 763005943 3769 0 763005944 3770 0 763005946 3771 0 763005947 3772 0 763005948 3773 0 763005949 3774 0 763005950 3775 0 763005951 3776 0 763005952 3777 0 763005953 3778 0 763005960 3779 0 763005962 3780 0 763005963 3781 0 763005964 3782 0 763005965 3783 0 763005965 3784 0 763005966 3785 0 763005967 3786 0 763005968 3787 0 763005969 3788 0 763005970 3789 0 763005971 3790 0 763005972 3791 0 763005972 3792 0 763005973 3793 0 763005980 3794 0 763005981 3795 0 763005982 3796 0 763005983 3797 0 763005984 3798 0 763005985 3799 0 763005986 3800 0 763005986 3801 0 763005987 3802 0 763005988 3803 0 763005988 3804 0 763005990 3805 0 763005990 3806 0 763005991 3807 0 763005992 3808 0 763005992 3809 0 763005993 3810 0 763005994 3811 0 763005995 3812 0 763006002 3813 0 763006003 3814 0 763006003 3815 0 763006004 3816 0 763006005 3817 0 763006006 3818 0 763006006 3819 0 763006007 3820 0 763006007 3821 0 763006008 3822 0 763006009 3823 0 763006010 3824 0 763006011 3825 0 763006011 3826 0 763006012 3827 0 763006012 3828 0 763006013 3829 0 763006014 3830 0 763006015 3831 0 763006015 3832 0 763006016 3833 0 763006017 3834 0 763006017 3835 0 763006018 3836 0 763006019 3837 0 763006019 3838 0 763006027 3839 0 763006027 3840 0 763006028 3841 0 763006029 3842 0 763006029 3843 0 763006030 3844 0 763006031 3845 0 763006031 3846 0 763006032 3847 0 763006033 3848 0 763006034 3849 0 763006034 3850 0 763006035 3851 0 763006035 3852 0 763006036 3853 0 763006037 3854 0 763006038 3855 0 763006038 3856 0 763006039 3857 0 763006039 3858 0 763006040 3859 0 763006040 3860 0 763006041 2024-03-06T12:34:33Z INFO __main__ 215: generated L0 files: [PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0759341038-0759346249_V02_2401235955-55593.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0759351675-0759356113_V02_2401233884-55594.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0759322623-0759324352_V02_2401234010-55592.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0759315364-0759318500_V02_2401239142-55590.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0759318444-0759319693_V02_2401239176-55591.fits')] 2024-03-06T12:34:34Z INFO stixcore.ephemeris.manager 179: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20240229_003.tm 2024-03-06T12:34:34Z INFO stixcore.ephemeris.manager 179: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20240305_002.tm 2024-03-06T12:34:34Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0759341038-0759346249_V02_2401235955-55593.fits 2024-03-06T12:34:34Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-03-06T12:34:34Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0759351675-0759356113_V02_2401233884-55594.fits 2024-03-06T12:34:34Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-03-06T12:34:35Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0759322623-0759324352_V02_2401234010-55592.fits 2024-03-06T12:34:35Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-03-06T12:34:35Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0759315364-0759318500_V02_2401239142-55590.fits 2024-03-06T12:34:35Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-03-06T12:34:35Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0759318444-0759319693_V02_2401239176-55591.fits 2024-03-06T12:34:35Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-03-06T12:34:36Z INFO __main__ 219: generated L1 files: [PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/01/23/SCI/solo_L1_stix-sci-xray-cpd_20240123T110036-20240123T112925_V02_2401234010-55592.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/01/23/SCI/solo_L1_stix-sci-xray-cpd_20240123T190449-20240123T201847_V02_2401233884-55594.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/01/23/SCI/solo_L1_stix-sci-xray-cpd_20240123T095058-20240123T101146_V02_2401239176-55591.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/01/23/SCI/solo_L1_stix-sci-xray-cpd_20240123T085938-20240123T095154_V02_2401239142-55590.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/01/23/SCI/solo_L1_stix-sci-xray-cpd_20240123T160732-20240123T173423_V02_2401235955-55593.fits')] 2024-03-06T12:34:36Z INFO stixcore.ephemeris.manager 179: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20240229_003.tm 2024-03-06T12:34:36Z INFO stixcore.ephemeris.manager 179: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20240305_002.tm 2024-03-06T12:34:36Z WARNING stixcore.processing.L1toL2 99: No L2 product match for product