Completeness continues to drop. Gilbert, do you have any insight into what is happening?
--Tom
Thomas G. Dietterich, Distinguished Professor (Emeritus)
School of EECS, Oregon State University
US Mail: 1148 Kelley Engineering Center, Corvallis, OR 97331-5501 USA
Office: 2063 Kelley Engineering Center
Voice: 541-737-5559; FAX: 541-737-1300
https://web.engr.oregonstate.edu/~tgd/
From: Rainqc-jobman <rainqc-jobman-bounces@engr.oregonstate.edu>
On Behalf Of RainQC Job Manager
Sent: Thursday, December 21, 2023 23:23
To: rainqc-jobman@engr.oregonstate.edu
Cc: Michael Slater <science@baidala.com>
Subject: [Rainqc-jobman] RainQC Job Manager daily report 2023-12-22
|
Some people who received this message don't often get email from
noreply@tahmo.org.
Learn why this is important |
[This email originated from outside of OSU. Use caution with links and attachments.]
Current UTC date: 2023-12-22 -> scoring models for previous day: 2023-12-21
---------------------------------------------------------------------------------
Daily Model Data Completeness Check:
data completeness 50% | complete models: 132 of 273 (48.35%)
data completeness 60% | complete models: 130 of 273 (47.62%)
data completeness 70% | complete models: 130 of 273 (47.62%)
data completeness 75% | complete models: 130 of 273 (47.62%)
data completeness 80% | complete models: 130 of 273 (47.62%)
data completeness 85% | complete models: 128 of 273 (46.89%)
data completeness 90% | complete models: 122 of 273 (44.69%)
data completeness 95% | complete models: 115 of 273 (42.12%)
data completeness 100% | complete models: 111 of 273 (40.66%)
----------------------------
station status | total: 313, delayed: 131, offline 24h: 74, offline week: 70
| battery, min: 0, max: 100, mean: 63.33, std dev: 28.99
| battery, common values: [(100, 183), (0, 72), (74, 4), (95, 3), (84, 3)]
| battery <= mean, common countries: [('KE', 19), ('GH', 15), ('UG', 12), ('ZM', 8), ('TZ', 6)]
----------------------------
89 LOW DATA (< 0.9) and 79 NO DATA weather stations impacted 151 RainQC models
LOW/NO data station impact on models: [('TA00196', 7), ('TA00061', 7), ('TA00719', 7), ('TA00185', 7), ('TA00124', 6), ('TA00414', 6), ('TA00621', 5), ('TA00320', 5), ('TA00587', 5), ('TA00537', 5), ('TA00067', 4), ('TA00231', 4), ('TA00301', 4), ('TA00530', 4), ('TA00565', 4), ('TA00543', 4), ('TA00700', 4), ('TA00035', 3), ('TA00036', 3), ('TA00222', 3), ('TA00041', 3), ('TA00267', 3), ('TA00178', 3), ('TA00066', 3), ('TA00126', 3), ('TA00217', 3), ('TA00482', 3), ('TA00385', 3), ('TA00289', 3), ('TA00436', 3), ('TA00430', 3), ('TA00542', 3), ('TA00119', 2), ('TA00308', 2), ('TA00050', 2), ('TA00302', 2), ('TA00072', 2), ('TA00118', 2), ('TA00136', 2), ('TA00165', 2), ('TA00148', 2), ('TA00155', 2), ('TA00487', 2), ('TA00210', 2), ('TA00232', 2), ('TA00271', 2), ('TA00309', 2), ('TA00691', 2), ('TA00339', 2), ('TA00373', 2), ('TA00451', 2), ('TA00462', 2), ('TA00471', 2), ('TA00014', 1), ('TA00031', 1), ('TA00044', 1), ('TA00070', 1), ('TA00078', 1), ('TA00091', 1), ('TA00095', 1), ('TA00123', 1), ('TA00212', 1), ('TA00219', 1), ('TA00229', 1), ('TA00237', 1), ('TA00251', 1), ('TA00269', 1), ('TA00290', 1), ('TA00336', 1), ('TA00343', 1), ('TA00344', 1), ('TA00350', 1), ('TA00362', 1), ('TA00369', 1), ('TA00382', 1), ('TA00389', 1), ('TA00422', 1), ('TA00432', 1), ('TA00493', 1), ('TA00528', 1), ('TA00529', 1), ('TA00533', 1), ('TA00535', 1), ('TA00547', 1), ('TA00588', 1), ('TA00652', 1), ('TA00655', 1), ('TA00677', 1), ('TA00702', 1)]
-----------------------------------------------------------
Processed daily jobs for UTC date: 2023-12-21
Start time: 2023-12-22T06:29:45+00:00
End time : 2023-12-22T07:22:30+00:00
Elapsed time HH:MM:SS: 0:52:46
---------------------
Before job processing job table stats:
Total 'success' count: 111
Total 'failure' count: 160
Total record count: 1237
Job history table record count: 123062
Scoring job record table record count: 469
---------------------
After job processing job table stats:
Total 'success' count: 102 (flag=2 count: 1) (flag 2->1 downgrades: 4)
| 'success' count for 2023-12-21: 101 (flag=2 count: 1)
| 'success' count for 2023-12-20: 1 (flag=2 count: 0)
| 'success' count for 2023-12-19: 0 (flag=2 count: 0)
| 'success' count for 2023-12-18: 0 (flag=2 count: 0)
| 'success' count for 2023-12-17: 0 (flag=2 count: 0)
| 'success' count for 2023-12-16: 0 (flag=2 count: 0)
| 'success' count for 2023-12-15: 0 (flag=2 count: 0)
Anomalies (flag=2):
TA00444 2023-12-21 | score: 21.927 (thresh: 12.643) -- 'pr' t: 0.000 mm n: (5.29 mm, 56 km), (0.153 mm, 73 km)
--------
Total 'failure' count: 155
Total record count: 1239
Job history table record count: 123333
Scoring job record table record count: 470
-----------------------------------------------------------