2024-01-09T23:39:47Z INFO __main__ 290: PIPELINE VERSION Version: 1.2.0 PROCESSING VERSIONS Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: Ephemeris File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: LevelB File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/levelb/binary.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 2024-01-09T23:39:47Z INFO __main__ 257: CONFIG [Paths] tm_archive = /data/stix/SOLSOC/from_edds/tm/processing fits_archive = /data/stix/out/fits_v1.2.0 spice_kernels = /data/stix/spice/kernels soop_files = /data/stix/SOLSOC/from_soc [Logging] stop_on_error = False [IDLBridge] enabled = True gsw_path = /opt/STIX-GSW batchsize = 30 [Pipeline] status_server_port = 12388 parallel_batchsize_l0 = 100 parallel_batchsize_l1 = 100 parallel_batchsize_l2 = 100 log_level = INFO log_dir = /data/stix/out/fits_v1.2.0/logging error_mail_send = True error_mail_receivers = nicky.hochmuth@ateleris.ch error_mail_smpt_host = lmailer.fhnw.ch error_mail_smpt_port = 25 error_mail_sender = nicky.hochmuth@fhnw.ch start_with_unprocessed = True [Publish] db_file = /home/stixcore/soar_pub/published.sqlite include_levels = L0, L1 waiting_period = 21d target_dir = /home/solsoc/to_soc report_mail_receivers = nicky.hochmuth@ateleris.ch report_mail_send = True same_esa_name_dir = /data/stix/out/esa_conflicts rid_lut_file = ./stixcore/data/publish/rid_lut.csv rid_lut_file_update_url = https://datacenter.stix.i4ds.net/api/bsd/info/ batch_size = 20000 fits_dir = /data/stix/out/fits_v1.2.0 target_host = pub026.cs.technik.fhnw.ch supplement_report = /home/stixcore/soar_pub/supplement_report.csv include_products = ql,hk,sci,cal log_dir = /data/stix/out/fits_v1.2.0/logging [SOOP] endpoint = https://solarorbiter.esac.esa.int/soopkitchen/api user = smaloney password = xxxx soop_files_download = ./stixcore/data/soop 2024-01-09T23:39:47Z INFO __main__ 286: SINGLETONS SOOPManager: /data/stix/SOLSOC/from_soc SPICE: [PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V110_20231215_002.tm'), PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V110_20240108_001.tm')] IDBManager: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb Versions: [{'label': '2.26.37', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.37', 'version': ['2', '26', '37']}, {'label': '2.26.36', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.36', 'version': ['2', '26', '36']}, {'label': '2.26.32', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.32', 'version': ['2', '26', '32']}, {'label': '2.26.34', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.34', 'version': ['2', '26', '34']}, {'label': '2.26.33', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.33', 'version': ['2', '26', '33']}, {'label': '2.26.31', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.31', 'version': ['2', '26', '31']}, {'label': '2.26.35', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.35', 'version': ['2', '26', '35']}] Force version: None History: IntervalTree([Interval(0.0, 640198039.0, '2.26.32'), Interval(640198039.0, 640265396.0, '2.26.31'), Interval(640265396.0, 642159993.0, '2.26.32'), Interval(642159993.0, 643123725.0, '2.26.33'), Interval(643123725.0, 677774249.0, '2.26.34'), Interval(677774249.0, 692380776.0, '2.26.35'), Interval(692380776.0, 761270182.0, '2.26.36'), Interval(761270182.0, 4294967295.0, '2.26.37')]) 2024-01-09T23:39:47Z INFO stixcore.processing.TMTCtoLB 30: Processing file: SOCPacketFile('/data/stix/SOLSOC/from_edds/tm/processing/TM_BatchRequest.PktTmRaw.SOL.0.2023.305.14.56.07.356.tuJo@2023.357.16.00.01.764.4.xml') 2024-01-09T23:39:52Z INFO stixcore.io.fits.processors 443: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311150848-64152.fits exists appending data 2024-01-09T23:39:52Z INFO stixcore.io.fits.processors 474: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311150848-64152.fits 2024-01-09T23:39:52Z INFO stixcore.io.fits.processors 443: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311289082-64151.fits exists appending data 2024-01-09T23:39:56Z INFO stixcore.io.fits.processors 474: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311289082-64151.fits 2024-01-09T23:39:58Z INFO __main__ 211: generated LB files: {PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311150848-64152.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311289082-64151.fits')} 2024-01-09T23:39:58Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.36/idb.sqlite 2024-01-09T23:39:58Z INFO stixcore.ephemeris.manager 179: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V110_20231215_002.tm 2024-01-09T23:39:58Z INFO stixcore.ephemeris.manager 179: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V110_20240108_001.tm 2024-01-09T23:45:05Z INFO stixcore.io.fits.processors 533: Fits file solo_L0_stix-sci-xray-cpd_0754513297-0754516294_V02_2311289082-64151.fits exists appending data 2024-01-09T23:45:06Z INFO stixcore.processing.LBtoL0 117: Tried to combine 2 BSD products: sequence_count sequence_flag scet_coarse -------------- ------------- ----------- 5988 1 756610829 5989 0 756610836 5990 0 756610837 5991 0 756610838 5992 0 756610838 5993 0 756610839 5994 0 756610840 5995 0 756610840 5996 0 756610841 5997 0 756610841 5998 0 756610842 5999 0 756610843 6000 0 756610843 6001 0 756610844 6002 0 756610844 6003 0 756610845 6004 0 756610849 6005 0 756610849 6006 0 756610850 6007 0 756610851 6008 0 756610851 6009 0 756610851 6010 0 756610852 6011 0 756610853 6012 0 756610853 6013 0 756610853 6014 0 756610854 6015 0 756610855 6016 0 756610855 6017 0 756610856 6018 0 756610856 6019 0 756610857 6020 0 756610857 6021 0 756610858 6022 0 756610859 6023 0 756610859 6024 0 756610860 6025 0 756610860 6026 0 756610861 6027 0 756610862 6028 0 756610863 6029 0 756610863 6030 0 756610864 6031 0 756610864 6032 0 756610871 6033 0 756610871 6034 0 756610872 6035 0 756610873 6036 0 756610874 6037 0 756610875 6038 0 756610875 6039 0 756610876 6040 0 756610876 6041 0 756610877 6042 0 756610878 6043 0 756610879 6044 0 756610880 6045 0 756610881 6046 0 756610882 6047 0 756610882 6048 0 756610883 6049 0 756610884 6050 0 756610884 6051 0 756610885 6052 0 756610887 6053 0 756610887 6054 0 756610894 6055 0 756610895 6056 0 756610895 6057 0 756610896 6058 0 756610897 6059 0 756610898 6060 0 756610899 6061 0 756610900 6062 0 756610901 6063 0 756610902 6064 0 756610902 6065 0 756610903 6066 0 756610904 6067 0 756610905 6068 0 756610906 6069 0 756610907 6070 0 756610908 6071 0 756610909 6072 0 756610915 6073 0 756610916 6074 0 756610917 6075 0 756610917 6076 0 756610919 6077 0 756610919 6078 0 756610920 6079 0 756610921 6080 0 756610922 6081 0 756610923 6082 0 756610923 6083 0 756610924 6084 0 756610925 6085 0 756610926 6086 0 756610927 6087 0 756610928 6088 0 756610929 6089 0 756610930 6090 0 756610930 6091 0 756610937 6092 0 756610938 6093 0 756610939 6094 0 756610940 6095 0 756610941 6096 0 756610941 6097 0 756610943 6098 0 756610943 6099 0 756610944 6100 0 756610944 6101 0 756610945 6102 0 756610946 6103 0 756610947 6104 0 756610948 6105 0 756610949 6106 0 756610950 6107 0 756610950 6108 0 756610951 6109 0 756610952 6110 0 756610959 6111 0 756610960 6112 0 756610961 6113 0 756610961 6114 0 756610962 6115 0 756610963 6116 0 756610964 6117 0 756610964 6118 0 756610965 6119 0 756610966 6120 0 756610967 6121 0 756610968 6122 0 756610969 6123 0 756610969 6124 0 756610970 6125 0 756610971 6126 0 756610972 6127 0 756610972 6128 0 756610973 6129 0 756610974 6130 0 756610975 6131 0 756610981 6132 0 756610982 6133 0 756610983 6134 0 756610983 6135 0 756610984 6136 0 756610985 6137 0 756610986 6138 0 756610987 6139 0 756610987 6140 0 756610988 6141 0 756610988 6142 0 756610989 6143 0 756610990 6144 0 756610991 6145 0 756610992 6146 0 756610992 6147 0 756610993 6148 0 756610994 6149 0 756610994 6150 0 756610995 6151 0 756610996 6152 0 756610996 6153 0 756610997 6154 0 756610998 6155 0 756611005 6156 0 756611005 6157 0 756611006 6158 0 756611007 6159 0 756611007 6160 0 756611008 6161 0 756611009 6162 0 756611010 6163 0 756611011 6164 0 756611011 6165 0 756611012 6166 0 756611012 6167 0 756611013 6168 0 756611014 6169 0 756611015 6170 0 756611015 6171 0 756611016 6172 0 756611016 6173 0 756611017 6174 0 756611018 6175 0 756611018 6176 0 756611019 6177 0 756611020 6178 0 756611020 6179 0 756611021 6180 0 756611022 6181 0 756611023 6182 0 756611023 6183 0 756611024 6184 0 756611024 6185 0 756611031 6186 0 756611032 6187 0 756611032 6188 0 756611033 6189 0 756611034 6190 0 756611034 6191 0 756611035 6192 0 756611035 6193 0 756611036 6194 0 756611036 6195 0 756611037 6196 0 756611038 6197 0 756611038 6198 0 756611039 6199 0 756611040 6200 0 756611040 6201 0 756611040 6202 0 756611041 6203 0 756611042 6204 0 756611042 6205 0 756611043 6206 0 756611044 6207 0 756611044 6208 0 756611045 6209 0 756611045 6210 0 756611046 6211 0 756611046 6212 0 756611047 6213 0 756611048 6214 0 756611048 6215 0 756611049 6216 0 756611049 6217 0 756611050 6218 0 756611051 6219 0 756611051 6220 0 756611052 6221 0 756611052 6222 0 756611053 6223 0 756611054 6224 0 756611054 6225 0 756611055 6226 0 756611055 6227 0 756611062 6228 0 756611062 6229 0 756611063 6230 0 756611064 6231 0 756611064 6232 0 756611065 6233 0 756611065 6234 0 756611066 6235 0 756611066 6236 0 756611067 6237 0 756611068 6238 0 756611068 6239 0 756611069 6240 0 756611069 6241 0 756611070 6242 0 756611071 6243 0 756611071 6244 0 756611072 6245 0 756611072 6246 0 756611073 6247 0 756611073 6248 0 756611074 6249 0 756611074 6250 0 756611075 6251 0 756611075 6252 0 756611076 6253 0 756611076 6254 0 756611077 6255 0 756611077 6256 0 756611078 6257 0 756611078 6258 0 756611079 6259 0 756611079 6260 0 756611080 6261 0 756611080 6262 0 756611081 6263 0 756611081 6264 0 756611082 6265 0 756611082 6266 0 756611083 6267 0 756611083 6268 0 756611084 6269 0 756611084 6270 0 756611084 6271 0 756611085 6272 0 756611086 6273 0 756611086 6274 0 756611087 6275 0 756611087 6276 0 756611088 6277 0 756611088 6278 0 756611088 6279 0 756611089 6280 0 756611089 6281 0 756611090 6282 0 756611091 6283 0 756611091 6284 0 756611097 6285 0 756611098 6286 0 756611098 6287 0 756611099 6288 0 756611099 6289 0 756611100 6290 0 756611101 6291 0 756611101 6292 0 756611102 6293 0 756611102 6294 0 756611103 6295 0 756611103 6296 0 756611103 6297 0 756611104 6298 0 756611104 6299 0 756611105 6300 0 756611106 6301 0 756611106 6302 0 756611107 6303 0 756611107 6304 0 756611108 6305 0 756611108 6306 0 756611109 6307 0 756611109 6308 0 756611110 6309 0 756611110 6310 0 756611111 6311 0 756611111 6312 0 756611112 6313 0 756611112 6314 0 756611113 6315 0 756611113 6316 0 756611114 6317 0 756611115 6318 0 756611115 6319 0 756611115 6320 0 756611116 6321 0 756611116 6322 0 756611117 6323 0 756611117 6324 0 756611118 6325 0 756611119 6326 0 756611119 6327 0 756611120 6328 0 756611120 6329 0 756611121 6330 0 756611121 6331 0 756611122 6332 0 756611123 6333 0 756611123 6334 0 756611124 6335 0 756611124 6336 0 756611125 6337 0 756611125 6338 0 756611126 6339 0 756611132 6340 0 756611133 6341 0 756611133 6342 0 756611134 6343 0 756611135 6344 0 756611135 6345 0 756611136 6346 0 756611136 6347 0 756611137 6348 0 756611137 6349 0 756611138 6350 0 756611139 6351 0 756611139 2024-01-09T23:45:11Z INFO __main__ 215: generated L0 files: [] 2024-01-09T23:45:11Z INFO __main__ 219: generated L1 files: [] 2024-01-09T23:45:11Z INFO __main__ 223: generated L2 files: []