Two things: -- The discrepancy in the success count for today's jobs (116 total, but subtotals only added up to 114) was due to a rare event. Data came in on the 7th day for two stations -- TA00089 and TA00090, originally set to be scored for 22 July 2022. I'll update the code to print the entire 7-day tail, just in case we see another rare event like this. -- I think we'll skip the meeting tomorrow morning. I haven't had any time to do anything since the Wednesday meeting. We can pick things up next Wed/Thu/Fri. Thanks, Michael From: slater@oregonstate.edu <slater@oregonstate.edu> Sent: Friday, July 29, 2022 2:24 AM To: rainqc-jobman@ENGR.ORST.EDU Cc: Slater, Michael <slater@oregonstate.edu> Subject: RainQC Job Manager daily report 2022-07-29 Current UTC date: 2022-07-29 ----------------------------------------------------------- Daily Model Data Completeness Check: data completeness 50% | complete models: 125 of 222 (56.31%) data completeness 60% | complete models: 125 of 222 (56.31%) data completeness 70% | complete models: 123 of 222 (55.41%) data completeness 75% | complete models: 123 of 222 (55.41%) data completeness 80% | complete models: 123 of 222 (55.41%) data completeness 85% | complete models: 123 of 222 (55.41%) data completeness 90% | complete models: 123 of 222 (55.41%) data completeness 95% | complete models: 123 of 222 (55.41%) data completeness 100% | complete models: 120 of 222 (54.05%) 63 LOW DATA (< 0.9) and 46 NO DATA weather stations impacted 99 RainQC models LOW/NO data station impact on models: [('TA00447', 7), ('TA00199', 7), ('TA00078', 6), ('TA00069', 6), ('TA00677', 5), ('TA00652', 4), ('TA00586', 4), ('TA00335', 4), ('TA00691', 4), ('TA00044', 3), ('TA00043', 3), ('TA00050', 3), ('TA00089', 3), ('TA00091', 3), ('TA00422', 3), ('TA00180', 3), ('TA00530', 3), ('TA00533', 3), ('TA00655', 3), ('TA00276', 2), ('TA00308', 2), ('TA00171', 2), ('TA00094', 2), ('TA00155', 2), ('TA00203', 2), ('TA00217', 2), ('TA00262', 2), ('TA00265', 2), ('TA00307', 2), ('TA00361', 2), ('TA00367', 2), ('TA00368', 2), ('TA00471', 2), ('TA00466', 2), ('TA00547', 2), ('TA00664', 2), ('TA00014', 1), ('TA00031', 1), ('TA00039', 1), ('TA00092', 1), ('TA00128', 1), ('TA00254', 1), ('TA00219', 1), ('TA00236', 1), ('TA00286', 1), ('TA00279', 1), ('TA00277', 1), ('TA00336', 1), ('TA00350', 1), ('TA00351', 1), ('TA00322', 1), ('TA00362', 1), ('TA00375', 1), ('TA00333', 1), ('TA00382', 1), ('TA00383', 1), ('TA00231', 1), ('TA00482', 1), ('TA00602', 1), ('TA00639', 1), ('TA00641', 1), ('TA00638', 1), ('TA00702', 1)] ----------------------------------------------------------- Processed daily jobs for UTC date: 2022-07-28 Start time: 2022-07-29T08:05:24+00:00 End time : 2022-07-29T09:24:26+00:00 Elapsed time HH:MM:SS: 1:19:01 --------------------- Before job processing table stats: Active job table record count: 877 Active job table 'failure' count: 96 Active job table 'success' count: 150 Job history table record count: 70087 Scoring job record table record count: 320 --------------------- After job processing table stats: Active job table record count: 853 Active job table 'failure' count: 94 Active job table 'success' count: 116 Active job table 'success' count for 2022-07-28: 103 Active job table 'success' count for 2022-07-27: 11 Active job table 'success' count for 2022-07-26: 0 Active job table 'success' count for 2022-07-25: 0 Active job table 'success' count for 2022-07-24: 0 Active job table 'success' count for 2022-07-23: 0 Job history table record count: 70333 Scoring job record table record count: 321 -----------------------------------------------------------