Completeness continues to drop. Gilbert, do you have any insight into what is happening? --Tom Thomas G. Dietterich, Distinguished Professor (Emeritus) School of EECS, Oregon State University US Mail: 1148 Kelley Engineering Center, Corvallis, OR 97331-5501 USA Office: 2063 Kelley Engineering Center Voice: 541-737-5559; FAX: 541-737-1300 https://web.engr.oregonstate.edu/~tgd/ From: Rainqc-jobman <rainqc-jobman-bounces@engr.oregonstate.edu> On Behalf Of RainQC Job Manager Sent: Thursday, December 21, 2023 23:23 To: rainqc-jobman@engr.oregonstate.edu Cc: Michael Slater <science@baidala.com> Subject: [Rainqc-jobman] RainQC Job Manager daily report 2023-12-22 Some people who received this message don't often get email from noreply@tahmo.org<mailto:noreply@tahmo.org>. Learn why this is important<https://aka.ms/LearnAboutSenderIdentification> [This email originated from outside of OSU. Use caution with links and attachments.] Current UTC date: 2023-12-22 -> scoring models for previous day: 2023-12-21 --------------------------------------------------------------------------------- Daily Model Data Completeness Check: data completeness 50% | complete models: 132 of 273 (48.35%) data completeness 60% | complete models: 130 of 273 (47.62%) data completeness 70% | complete models: 130 of 273 (47.62%) data completeness 75% | complete models: 130 of 273 (47.62%) data completeness 80% | complete models: 130 of 273 (47.62%) data completeness 85% | complete models: 128 of 273 (46.89%) data completeness 90% | complete models: 122 of 273 (44.69%) data completeness 95% | complete models: 115 of 273 (42.12%) data completeness 100% | complete models: 111 of 273 (40.66%) ---------------------------- station status | total: 313, delayed: 131, offline 24h: 74, offline week: 70 | battery, min: 0, max: 100, mean: 63.33, std dev: 28.99 | battery, common values: [(100, 183), (0, 72), (74, 4), (95, 3), (84, 3)] | battery <= mean, common countries: [('KE', 19), ('GH', 15), ('UG', 12), ('ZM', 8), ('TZ', 6)] ---------------------------- 89 LOW DATA (< 0.9) and 79 NO DATA weather stations impacted 151 RainQC models LOW/NO data station impact on models: [('TA00196', 7), ('TA00061', 7), ('TA00719', 7), ('TA00185', 7), ('TA00124', 6), ('TA00414', 6), ('TA00621', 5), ('TA00320', 5), ('TA00587', 5), ('TA00537', 5), ('TA00067', 4), ('TA00231', 4), ('TA00301', 4), ('TA00530', 4), ('TA00565', 4), ('TA00543', 4), ('TA00700', 4), ('TA00035', 3), ('TA00036', 3), ('TA00222', 3), ('TA00041', 3), ('TA00267', 3), ('TA00178', 3), ('TA00066', 3), ('TA00126', 3), ('TA00217', 3), ('TA00482', 3), ('TA00385', 3), ('TA00289', 3), ('TA00436', 3), ('TA00430', 3), ('TA00542', 3), ('TA00119', 2), ('TA00308', 2), ('TA00050', 2), ('TA00302', 2), ('TA00072', 2), ('TA00118', 2), ('TA00136', 2), ('TA00165', 2), ('TA00148', 2), ('TA00155', 2), ('TA00487', 2), ('TA00210', 2), ('TA00232', 2), ('TA00271', 2), ('TA00309', 2), ('TA00691', 2), ('TA00339', 2), ('TA00373', 2), ('TA00451', 2), ('TA00462', 2), ('TA00471', 2), ('TA00014', 1), ('TA00031', 1), ('TA00044', 1), ('TA00070', 1), ('TA00078', 1), ('TA00091', 1), ('TA00095', 1), ('TA00123', 1), ('TA00212', 1), ('TA00219', 1), ('TA00229', 1), ('TA00237', 1), ('TA00251', 1), ('TA00269', 1), ('TA00290', 1), ('TA00336', 1), ('TA00343', 1), ('TA00344', 1), ('TA00350', 1), ('TA00362', 1), ('TA00369', 1), ('TA00382', 1), ('TA00389', 1), ('TA00422', 1), ('TA00432', 1), ('TA00493', 1), ('TA00528', 1), ('TA00529', 1), ('TA00533', 1), ('TA00535', 1), ('TA00547', 1), ('TA00588', 1), ('TA00652', 1), ('TA00655', 1), ('TA00677', 1), ('TA00702', 1)] ----------------------------------------------------------- Processed daily jobs for UTC date: 2023-12-21 Start time: 2023-12-22T06:29:45+00:00 End time : 2023-12-22T07:22:30+00:00 Elapsed time HH:MM:SS: 0:52:46 --------------------- Before job processing job table stats: Total 'success' count: 111 Total 'failure' count: 160 Total record count: 1237 Job history table record count: 123062 Scoring job record table record count: 469 --------------------- After job processing job table stats: Total 'success' count: 102 (flag=2 count: 1) (flag 2->1 downgrades: 4) | 'success' count for 2023-12-21: 101 (flag=2 count: 1) | 'success' count for 2023-12-20: 1 (flag=2 count: 0) | 'success' count for 2023-12-19: 0 (flag=2 count: 0) | 'success' count for 2023-12-18: 0 (flag=2 count: 0) | 'success' count for 2023-12-17: 0 (flag=2 count: 0) | 'success' count for 2023-12-16: 0 (flag=2 count: 0) | 'success' count for 2023-12-15: 0 (flag=2 count: 0) Anomalies (flag=2): TA00444 2023-12-21 | score: 21.927 (thresh: 12.643) -- 'pr' t: 0.000 mm n: (5.29 mm, 56 km), (0.153 mm, 73 km) -------- Total 'failure' count: 155 Total record count: 1239 Job history table record count: 123333 Scoring job record table record count: 470 -----------------------------------------------------------