June 2022 - Rainqc-jobman - Engineering Mailing Lists

RainQC Job Manager daily report 2022-06-06
by slater＠oregonstate.edu 06 Jun '22

06 Jun '22

1 0

RainQC Job Manager daily report
by Slater, Michael 05 Jun '22

05 Jun '22

Current UTC date: 2022-06-05 ----------------------------------------------------------- Daily Model Data Completeness Check: data completeness 50% | complete models: 132 of 222 (59.46%) data completeness 60% | complete models: 130 of 222 (58.56%) data completeness 70% | complete models: 129 of 222 (58.11%) data completeness 75% | complete models: 129 of 222 (58.11%) data completeness 80% | complete models: 127 of 222 (57.21%) data completeness 85% | complete models: 127 of 222 (57.21%) data completeness 90% | complete models: 127 of 222 (57.21%) data completeness 95% | complete models: 93 of 222 (41.89%) data completeness 100% | complete models: 86 of 222 (38.74%) ----------------------------------------------------------- Processed daily jobs for UTC date: 2022-06-04 Start time: 2022-06-05T04:15:55+00:00 End time : 2022-06-05T04:43:51+00:00 Elapsed time HH:MM:SS: 0:27:56 --------------------- Before job processing table stats: Active job table record count: 860 Active job table 'failure' count: 89 Active job table 'success' count: 151 Active job table 'success' count for today's jobs (2022-06-04): 0 Job history table record count: 58014 Scoring job record table record count: 263 --------------------- After job processing table stats: Active job table record count: 842 Active job table 'failure' count: 90 Active job table 'success' count: 72 Active job table 'success' count for today's jobs (2022-06-04): 71 Job history table record count: 58254 Scoring job record table record count: 264 -----------------------------------------------------------

1 0

Daily status message from RainQC JobMan
by slater＠oregonstate.edu 04 Jun '22

04 Jun '22

The time is now 2022-06-04T07:47:47+00:00 and RainQC JobMan is alive and well! Current UTC date: 2022-06-04 ----------------------------------------------------------- Daily Model Data Completeness Check: data completeness 50% | complete models: 130 of 222 (58.56%) data completeness 60% | complete models: 130 of 222 (58.56%) data completeness 70% | complete models: 130 of 222 (58.56%) data completeness 75% | complete models: 130 of 222 (58.56%) data completeness 80% | complete models: 130 of 222 (58.56%) data completeness 85% | complete models: 130 of 222 (58.56%) data completeness 90% | complete models: 130 of 222 (58.56%) data completeness 95% | complete models: 129 of 222 (58.11%) data completeness 100% | complete models: 129 of 222 (58.11%) ----------------------------------------------------------- Processed daily jobs for UTC date: 2022-06-03 Start time: 2022-06-04T07:15:31+00:00 End time : 2022-06-04T07:47:47+00:00 Elapsed time HH:MM:SS: 0:32:16 --------------------- Before job processing table stats: Active job table record count: 943Active job table 'failure' count: 88Active job table 'success' count: 217Active job table 'success' count for today's jobs (2022-06-03): 0Job history table record count: 57709Scoring job record table record count: 262--------------------- After job processing table stats: Active job table record count: 860Active job table 'failure' count: 89Active job table 'success' count: 151Active job table 'success' count for today's jobs (2022-06-03): 115Job history table record count: 58014Scoring job record table record count: 263-----------------------------------------------------------

1 0

Daily status message from RainQC JobMan
by slater＠oregonstate.edu 03 Jun '22

03 Jun '22

The time is now 2022-06-03T07:02:55+00:00 and RainQC JobMan is alive and well! Current UTC date: 2022-06-03 ----------------------------------------------------------- Daily Model Data Completeness Check: data completeness 50% | complete models: 125 of 222 (56.31%) data completeness 60% | complete models: 125 of 222 (56.31%) data completeness 70% | complete models: 125 of 222 (56.31%) data completeness 75% | complete models: 125 of 222 (56.31%) data completeness 80% | complete models: 125 of 222 (56.31%) data completeness 85% | complete models: 125 of 222 (56.31%) data completeness 90% | complete models: 125 of 222 (56.31%) data completeness 95% | complete models: 122 of 222 (54.95%) data completeness 100% | complete models: 119 of 222 (53.60%) ----------------------------------------------------------- Processed daily jobs for UTC date: 2022-06-02 Start time: 2022-06-03T06:27:27+00:00 End time : 2022-06-03T07:02:55+00:00 Elapsed time HH:MM:SS: 0:35:28 --------------------- Before job processing table stats: Active job table record count: 823Active job table 'failure' count: 84Active job table 'success' count: 18Active job table 'success' count for today's jobs (2022-06-02): 0Job history table record count: 57607Scoring job record table record count: 261--------------------- After job processing table stats: Active job table record count: 943Active job table 'failure' count: 88Active job table 'success' count: 217Active job table 'success' count for today's jobs (2022-06-02): 107Job history table record count: 57709Scoring job record table record count: 262-----------------------------------------------------------

1 0

Daily status message from RainQC JobMan
by slater＠oregonstate.edu 02 Jun '22

02 Jun '22

The time is now 2022-06-02T04:59:15+00:00 and RainQC JobMan is alive and well! Current UTC date: 2022-06-02 ----------------------------------------------------------- Daily Model Data Completeness Check: data completeness 50% | complete models: 131 of 222 (59.01%) data completeness 60% | complete models: 128 of 222 (57.66%) data completeness 70% | complete models: 120 of 222 (54.05%) data completeness 75% | complete models: 118 of 222 (53.15%) data completeness 80% | complete models: 118 of 222 (53.15%) data completeness 85% | complete models: 117 of 222 (52.70%) data completeness 90% | complete models: 117 of 222 (52.70%) data completeness 95% | complete models: 101 of 222 (45.50%) data completeness 100% | complete models: 96 of 222 (43.24%) ----------------------------------------------------------- Processed daily jobs for UTC date: 2022-06-01 Start time: 2022-06-02T04:31:26+00:00 End time : 2022-06-02T04:59:15+00:00 Elapsed time HH:MM:SS: 0:27:49 --------------------- Before job processing table stats: Active job table record count: 797 Active job table 'failure' count: 89 Active job table 'success' count: 107 Active job table 'success' count for today's jobs (2022-06-01): 0 Job history table record count: 57411 Scoring job record table record count: 260 --------------------- After job processing table stats: Active job table record count: 823 Active job table 'failure' count: 84 Active job table 'success' count: 18 Active job table 'success' count for today's jobs (2022-06-01): 0 Job history table record count: 57607 Scoring job record table record count: 261 -----------------------------------------------------------

1 0

A small correction for the Twilio account
by Slater, Michael 02 Jun '22

02 Jun '22

Hi everyone, My apologies for the duplicate test messages -- it didn't look like the new API key change had worked... so I tried it again. In today's talk on the job manager, I mentioned that we will need a new Twilio account for sending the daily email status messages. This is not quite correct. We need to make a new SendGrid account. While SendGrid is owned by Twilio, the easy way to do get going is to go to sendgrid.com and follow the prompts for 'Start for Free'. What we want is to send email using Python, verify the sender (or domain of the sender), and then create an API key. Prompts and code are provided and it only takes a few minutes. https://sendgrid.com/ We should need only one SendGrid account, e.g., one person should be responsible for the sending of the daily status messages via SendGrid. Michael

1 0

Daily status message from RainQC JobMan
by slater＠oregonstate.edu 02 Jun '22

02 Jun '22

The time is now 2022-06-02T00:13:05+00:00 and RainQC JobMan is alive and well! Test of new API key for email: slater(a)oregonstate.edu

1 0

Daily status message from RainQC JobMan
by slater＠oregonstate.edu 02 Jun '22

02 Jun '22

The time is now 2022-06-02T00:10:37+00:00 and RainQC JobMan is alive and well! Test of new API key for email: slater(a)oregonstate.edu

1 0

Daily status message from RainQC JobMan
by slater＠oregonstate.edu 02 Jun '22

02 Jun '22

The time is now 2022-06-02T00:10:15+00:00 and RainQC JobMan is alive and well! Test of new API key for email: slater(a)oregonstate.edu

1 0