Another really bad day somewhere in our system Thomas G. Dietterich, University Distinguished Professor (Emeritus) School of EECS, Oregon State University US Mail: 1148 Kelley Engineering Center, Corvallis, OR 97331-5501 USA Office: 2063 Kelley Engineering Center Voice: 541-737-5559; FAX: 541-737-1300 https://web.engr.oregonstate.edu/~tgd/<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fweb.engr.oregonstate.edu%2F~tgd%2F&data=05%7C02%7Crainqc-jobman%40ENGR.ORST.EDU%7Cdd7b30d621064da3e54108dd118479c7%7Cce6d05e13c5e4d6287a84c4a2713c113%7C0%7C0%7C638685982852150256%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=N3CNHrSbYIzyjpu7tX34zl68v0jQdwIVuXP3UxaTZN4%3D&reserved=0> From: RainQC Job Manager <noreply@tahmo.org> Sent: Wednesday, November 27, 2024 11:22 PM To: rainqc-jobman@ENGR.ORST.EDU Cc: Michael Slater <science@baidala.com>; Dietterich, Thomas <tgd@oregonstate.edu> Subject: RainQC Job Manager daily report 2024-11-28 [This email originated from outside of OSU. Use caution with links and attachments.] Current UTC date: 2024-11-28 -> scoring models for previous day: 2024-11-27 --------------------------------------------------------------------------------- Daily Model Data Completeness Check: data completeness 50% | complete models: 110 of 273 (40.29%) data completeness 60% | complete models: 85 of 273 (31.14%) data completeness 70% | complete models: 38 of 273 (13.92%) data completeness 75% | complete models: 11 of 273 ( 4.03%) data completeness 80% | complete models: 3 of 273 ( 1.10%) data completeness 85% | complete models: 3 of 273 ( 1.10%) data completeness 90% | complete models: 3 of 273 ( 1.10%) data completeness 95% | complete models: 2 of 273 ( 0.73%) data completeness 100% | complete models: 2 of 273 ( 0.73%) ---------------------------- station status | total: 313, delayed: 302, offline 24h: 79, offline week: 76 | battery, min: 0, max: 100, mean: 72.87, std dev: 23.4 | battery, common values: [(100, 193), (0, 84), (94, 3), (76, 3), (72, 2)] | battery <= mean, common countries: [('KE', 18), ('UG', 13), ('GH', 12), ('ML', 9), ('ZM', 7)] ---------------------------- 269 LOW DATA (< 0.9) and 88 NO DATA weather stations impacted 270 RainQC models LOW/NO data station impact on models: [('TA00647', 11), ('TA00057', 11), ('TA00567', 9), ('TA00651', 9), ('TA00004', 8), ('TA00127', 8), ('TA00715', 8), ('TA00182', 8), ('TA00283', 8), ('TA00189', 8), ('TA00568', 8), ('TA00242', 8), ('TA00025', 7), ('TA00026', 7), ('TA00074', 7), ('TA00196', 7), ('TA00719', 7), ('TA00098', 7), ('TA00185', 7), ('TA00192', 7), ('TA00674', 7), ('TA00447', 7), ('TA00199', 7), ('TA00122', 6), ('TA00124', 6), ('TA00679', 6), ('TA00414', 6), ('TA00073', 6), ('TA00029', 6), ('TA00413', 6), ('TA00388', 6), ('TA00076', 6), ('TA00068', 6), ('TA00131', 6), ('TA00129', 6), ('TA00448', 6), ('TA00184', 6), ('TA00198', 6), ('TA00331', 6), ('TA00327', 6), ('TA00005', 5), ('TA00621', 5), ('TA00678', 5), ('TA00320', 5), ('TA00056', 5), ('TA00045', 5), ('TA00587', 5), ('TA00480', 5), ('TA00391', 5), ('TA00317', 5), ('TA00243', 5), ('TA00319', 5), ('TA00332', 5), ('TA00323', 5), ('TA00537', 5), ('TA00023', 4), ('TA00156', 4), ('TA00067', 4), ('TA00473', 4), ('TA00231', 4), ('TA00042', 4), ('TA00047', 4), ('TA00282', 4), ('TA00064', 4), ('TA00377', 4), ('TA00379', 4), ('TA00158', 4), ('TA00683', 4), ('TA00190', 4), ('TA00301', 4), ('TA00370', 4), ('TA00361', 4), ('TA00367', 4), ('TA00368', 4), ('TA00638', 4), ('TA00530', 4), ('TA00536', 4), ('TA00565', 4), ('TA00543', 4), ('TA00700', 4), ('TA00636', 4), ('TA00019', 3), ('TA00003', 3), ('TA00006', 3), ('TA00121', 3), ('TA00011', 3), ('TA00080', 3), ('TA00030', 3), ('TA00573', 3), ('TA00032', 3), ('TA00035', 3), ('TA00036', 3), ('TA00222', 3), ('TA00041', 3), ('TA00178', 3), ('TA00288', 3), ('TA00094', 3), ('TA00110', 3), ('TA00115', 3), ('TA00126', 3), ('TA00154', 3), ('TA00444', 3), ('TA00274', 3), ('TA00360', 3), ('TA00174', 3), ('TA00108', 3), ('TA00244', 3), ('TA00484', 3), ('TA00217', 3), ('TA00482', 3), ('TA00385', 3), ('TA00289', 3), ('TA00326', 3), ('TA00436', 3), ('TA00375', 3), ('TA00372', 3), ('TA00408', 3), ('TA00430', 3), ('TA00696', 3), ('TA00574', 3), ('TA00542', 3), ('TA00603', 3), ('TA00607', 3), ('TA00641', 3), ('TA00013', 2), ('TA00119', 2), ('TA00020', 2), ('TA00024', 2), ('TA00226', 2), ('TA00308', 2), ('TA00043', 2), ('TA00280', 2), ('TA00050', 2), ('TA00302', 2), ('TA00054', 2), ('TA00281', 2), ('TA00171', 2), ('TA00101', 2), ('TA00102', 2), ('TA00256', 2), ('TA00118', 2), ('TA00130', 2), ('TA00136', 2), ('TA00165', 2), ('TA00148', 2), ('TA00155', 2), ('TA00487', 2), ('TA00168', 2), ('TA00684', 2), ('TA00247', 2), ('TA00186', 2), ('TA00187', 2), ('TA00210', 2), ('TA00223', 2), ('TA00232', 2), ('TA00224', 2), ('TA00265', 2), ('TA00495', 2), ('TA00271', 2), ('TA00494', 2), ('TA00399', 2), ('TA00303', 2), ('TA00309', 2), ('TA00691', 2), ('TA00374', 2), ('TA00335', 2), ('TA00339', 2), ('TA00354', 2), ('TA00355', 2), ('TA00364', 2), ('TA00373', 2), ('TA00429', 2), ('TA00397', 2), ('TA00398', 2), ('TA00409', 2), ('TA00451', 2), ('TA00462', 2), ('TA00471', 2), ('TA00592', 2), ('TA00594', 2), ('TA00001', 1), ('TA00002', 1), ('TA00007', 1), ('TA00278', 1), ('TA00014', 1), ('TA00015', 1), ('TA00028', 1), ('TA00031', 1), ('TA00044', 1), ('TA00046', 1), ('TA00062', 1), ('TA00065', 1), ('TA00077', 1), ('TA00078', 1), ('TA00089', 1), ('TA00091', 1), ('TA00095', 1), ('TA00113', 1), ('TA00112', 1), ('TA00120', 1), ('TA00157', 1), ('TA00172', 1), ('TA00183', 1), ('TA00201', 1), ('TA00209', 1), ('TA00212', 1), ('TA00206', 1), ('TA00219', 1), ('TA00650', 1), ('TA00227', 1), ('TA00239', 1), ('TA00237', 1), ('TA00251', 1), ('TA00689', 1), ('TA00257', 1), ('TA00260', 1), ('TA00268', 1), ('TA00392', 1), ('TA00276', 1), ('TA00287', 1), ('TA00286', 1), ('TA00290', 1), ('TA00300', 1), ('TA00310', 1), ('TA00316', 1), ('TA00334', 1), ('TA00336', 1), ('TA00343', 1), ('TA00344', 1), ('TA00350', 1), ('TA00351', 1), ('TA00322', 1), ('TA00362', 1), ('TA00366', 1), ('TA00333', 1), ('TA00369', 1), ('TA00382', 1), ('TA00383', 1), ('TA00386', 1), ('TA00359', 1), ('TA00394', 1), ('TA00396', 1), ('TA00407', 1), ('TA00416', 1), ('TA00422', 1), ('TA00432', 1), ('TA00433', 1), ('TA00446', 1), ('TA00454', 1), ('TA00470', 1), ('TA00485', 1), ('TA00493', 1), ('TA00524', 1), ('TA00528', 1), ('TA00529', 1), ('TA00533', 1), ('TA00535', 1), ('TA00547', 1), ('TA00548', 1), ('TA00586', 1), ('TA00602', 1), ('TA00639', 1), ('TA00652', 1), ('TA00655', 1), ('TA00677', 1), ('TA00685', 1), ('TA00686', 1), ('TA00687', 1), ('TA00702', 1)] ----------------------------------------------------------- Processed daily jobs for UTC date: 2024-11-27 Start time: 2024-11-28T06:31:30+00:00 End time : 2024-11-28T07:21:36+00:00 Elapsed time HH:MM:SS: 0:50:06 --------------------- Before job processing job table stats: Total 'success' count: 110 Total 'failure' count: 180 Total record count: 1395 Job history table record count: 215997 Scoring job record table record count: 810 --------------------- After job processing job table stats: Total 'success' count: 7 (flag=2 count: 0) (flag 2->1 downgrades: 0) | 'success' count for 2024-11-27: 3 (flag=2 count: 0) | 'success' count for 2024-11-26: 4 (flag=2 count: 0) | 'success' count for 2024-11-25: 0 (flag=2 count: 0) | 'success' count for 2024-11-24: 0 (flag=2 count: 0) | 'success' count for 2024-11-23: 0 (flag=2 count: 0) | 'success' count for 2024-11-22: 0 (flag=2 count: 0) | 'success' count for 2024-11-21: 0 (flag=2 count: 0) Anomalies (flag=2): -------- Total 'failure' count: 191 Total record count: 1378 Job history table record count: 216287 Scoring job record table record count: 811 ----------------------------------------------------------- RainQC JobMan LR | version 1.2