I've been reviewing the logs from the weekend, to make sure everything has been running OK (we have 12 days left on our trial).
I have noticed two odd things in the logs:
1. In many cases, there are multiple identical entries for a task or a job completing.
Here's an example with multiple identical task completion entries:
9/12/2010 12:51:00 AM Info Job started: Genotyperv2
9/12/2010 12:51:00 AM Info Job started: Genemapper
9/12/2010 12:51:00 AM Info Job started: merge
9/12/2010 12:51:00 AM Info Task started: Genotyperv2.cgi in Genotyper (200)
9/12/2010 12:51:00 AM Info Task started: Genemapper.cgi in Genemapper (201)
9/12/2010 12:51:00 AM Info Task started: merge.cgi in merge (202)
9/12/2010 12:51:00 AM Info Task completed: Genotyperv2.cgi in Genotyper (200)
9/12/2010 12:51:00 AM Info Task completed: Genotyperv2.cgi in Genotyper (200)
9/12/2010 12:51:00 AM Info Task completed: Genemapper.cgi in Genemapper (201)
9/12/2010 12:51:00 AM Info Task completed: Genotyperv2.cgi in Genotyper (200)
9/12/2010 12:51:00 AM Info Task completed: Genemapper.cgi in Genemapper (201)
9/12/2010 12:51:00 AM Info Task completed: merge.cgi in merge (202)
9/12/2010 12:51:00 AM Info Job completed: Genotyperv2
9/12/2010 12:51:00 AM Info Job completed: merge
9/12/2010 12:51:00 AM Info Job completed: Genemapper
Here's an example with multiple identical task completion and multiple identical job completion entries:
9/12/2010 12:05:00 AM Info Job started: hl7beta
9/12/2010 12:05:00 AM Info Job started: OmnigenReleaseBeta
9/12/2010 12:05:00 AM Info Job started: GCID
9/12/2010 12:05:00 AM Info Task started: LISHL7beta.cgi in hl7beta (112)
9/12/2010 12:05:00 AM Info Task started: OmnigenRelease.exe in omnigenreleasebeta (113)
9/12/2010 12:05:00 AM Info Task started: GCID.cgi in GCID (114)
9/12/2010 12:05:00 AM Info Task completed: LISHL7beta.cgi in hl7beta (112)
9/12/2010 12:05:00 AM Info Job completed: hl7beta
9/12/2010 12:05:03 AM Debug Saving Jobs
9/12/2010 12:05:12 AM Info Task completed: OmnigenRelease.exe in omnigenreleasebeta (113)
9/12/2010 12:05:12 AM Info Task completed: OmnigenRelease.exe in omnigenreleasebeta (113)
9/12/2010 12:05:12 AM Info Task completed: GCID.cgi in GCID (114)
9/12/2010 12:05:13 AM Info Job completed: GCID
9/12/2010 12:05:13 AM Info Job completed: GCID
9/12/2010 12:05:13 AM Info Job completed: OmnigenReleaseBeta
These jobs all consist of one process execution task each, and are generally set to run every 5-10 minutes. They typically take only a few seconds to complete. All are set to not start when already running, but to be queued.
My suspicion is that this is a logging issue, rather than a job/task running issue, because of the second oddity I am seeing:
2. From time to time, I am seeing incomplete lines of logging statements. For example:
9/12/2010 12:43:00 AM Info Job started: Genotyperv2
9/12/2010 12:43:00 AM Info Job started: GenemapperSJC
9/12/2010 12:43:00 AM Info Job started: Genotyper
9/12/2010 12:43:00 AM Info Task started: Genotyperv2.cgi in Genotyper (184)
9/12/2010 12:43:00 AM Info Task started: GenemapperSJC.cgi in Genemapper (185)
9/12/2010 12:43:00 AM Info Task started: Genotyper.cgi in Genotyper (186)
9/12/2010 12:43:00 AM Info Task completed: Genotyperv2.cgi in Genotyper (184)
)
72)
9)
ed: GenemapperSJC
eted: LISHL7beta.cgi in hl7beta (139)
9/12/2010 12:43:00 AM Info Task completed: Genotyperv2.cgi in Genotyper (184)
)
72)
9)
ed: GenemapperSJC
eted: LISHL7beta.cgi in hl7beta (139)
9/12/2010 12:43:00 AM Info Task completed: Genotyper.cgi in Genotyper (186)
9/12/2010 12:43:00 AM Info Job completed: Genotyperv2
9/12/2010 12:43:00 AM Info Job completed: GenemapperSJC
9/12/2010 12:43:00 AM Info Job completed: Genotyper
What do you think is going on?
Thanks,
Rebeccah