[7.6.0] [Solved] On complete flow with file write notification - VisualCron

Please note that VisualCron support is not actively monitoring this community forum. Please use our contact page for contacting the VisualCron support directly.

Welcome Guest! To enable all features please Login or Register.

ErikC
Free support Topic Starter

10 years ago

Hi,

I installed version 7.6.0 over 6.2.2 yesterday and I encountered some delay today with my jobs.
On (almost) all my tasks I have an 'On complete' notification which is writing to a file.
The filename in this notification is:

f:\jobs\log\{JOB(Active,Name)}-{DATEFORMAT(yyyyMMdd)}.txt

Nothing fancy here, but before yesterday I did not have the folowwing issue:

Tasks from different jobs are writing in the same log file.

This is a bit strange while the filename depends on the jobname. It could be that this delays my server by queing up the file writes, I don't know.
The jobs are running at the same time, so there might be a name mix-up.
So there is a bug to be found / fixed here.

My file notificatioin is:

{TASK(PrevTask,Name)}
Result:         {TASK(PrevTask,Result)}
Last run:       {TASK(PrevTask,LastRun,M/d/yyyy h:mm:ss.ff tt)}
Last exited:    {TASK(PrevTask,LastExited,M/d/yyyy h:mm:ss.ff tt)}
Execution time: {TASK(PrevTask,ExecutionTime)} seconds
------------------------------------------------------------------------------------------------------------------
Output:
{TASK(PrevTask,StdOut)}
---------------
Error output:
{TASK(PrevTask,StdErr)}
------------------------------------------------------------------------------------------------------------------

Regards,
Erik

Edited by user 10 years ago | Reason: Not specified

Uses Visualcron since 2006.

Sponsor

Forum information

Wanna join the discussion?! Login to your Forum forum account or Register a new forum account

Support
Official support

10 years ago

Are the Jobs running at the same time or?

Henrik
Support
http://www.visualcron.com
Please like VisualCron on facebook!

ErikC
Free support Topic Starter

10 years ago

Yes they are.
I have several jobs (5) running at exact 07:15AM and all my tasks are using the same generic file notification in the on complete flow.
Job running times: 0:37/3:15/1:47/47:43/0:58 (m:s)

Other jobs start at 07:25AM, 07:30AM and more and more...

Regards
Erik

Uses Visualcron since 2006.

Support
Official support

10 years ago

We could not reproduce this. We created 4 Jobs with first a wait Task, then On complete write file with the Variable Job name as file name, then another Wait Task. We cloned this so we had 4 Jobs and started them right after each other. Please tell us if there is a way to reproduce this.

Henrik
Support
http://www.visualcron.com
Please like VisualCron on facebook!

ErikC
Free support Topic Starter

10 years ago

Hi,

I'm now on 7.6.3 and it's happening again.

I have a job with two tasks which runs at 7AM. It deletes a file and when the file is not there, the next task is emailing about it otherwise the job stops.
This is done with the use of an condition and the flow.

The file is there, and the emai lis send anyway.
In the flow of each task, there is a file write on complete with the task output, writing to a file with the name of the job.
In this file, there are two entrys, but the file delete output is not there, it's an output of an other task (other job) running the same time.

There are alslo a lot of errors of the server itself which I will post in an other topic.

Regards,
Erik

Uses Visualcron since 2006.

Support
Official support

10 years ago

Originally Posted by: ErikC

Hi,

I'm now on 7.6.3 and it's happening again.

I have a job with two tasks which runs at 7AM. It deletes a file and when the file is not there, the next task is emailing about it otherwise the job stops.
This is done with the use of an condition and the flow.

The file is there, and the emai lis send anyway.
In the flow of each task, there is a file write on complete with the task output, writing to a file with the name of the job.
In this file, there are two entrys, but the file delete output is not there, it's an output of an other task (other job) running the same time.

There are alslo a lot of errors of the server itself which I will post in an other topic.

Regards,
Erik

Can you reproduce this by re-running it now?

Henrik
Support
http://www.visualcron.com
Please like VisualCron on facebook!

ErikC
Free support Topic Starter

10 years ago

No, I can not.

I have to look at my logfiles and see if the task title/output is diffferent than the real task title/output. That's a pain to do...
The server is also restarted today, so it might be all good again...

Regards
Erik

Uses Visualcron since 2006.

ErikC
Free support Topic Starter

10 years ago

This morning the process went fine. the job which had the wrong enty in the log file now has the right lines in the log files.

There is an issue here which I believe doesn't has anything to do with log files.
The reason why I believe this is because the condition bound to a task did not work either.

I have a task deleting a file and a following task emailing the file is not there.
Condition bound to the 1st task checking if the file is there (continue), is not start the next task.
If the delete went fine the fow will stop the job, if there is an error the next task will run.

Yesterday I received the mail telling me the file wasn't there, but the file was deleted by the 1st task.
The condition did not work properly.

I think it's all related to a higher problem that VC lost track of the right task information.
Hard thing for me is to prove it and to reproduce it...

Regards
Erik

Uses Visualcron since 2006.

ErikC
Free support Topic Starter

10 years ago

Hi,

I tried to reproduce it and I think I did it 🤤 , here's how:

I have two file write notifications:
1) the job on start flow:
f:\jobs\log\{JOB(Active,Name)}-{DATEFORMAT(yyyyMMdd)}.txt (append to file)

******************************************************************************************************************
Start job | {JOB(Active|CounterProcessId)} | {JOB(Active,Name)}
******************************************************************************************************************

2) the task on complete flow:
f:\jobs\log\{JOB(Active,Name)}-{DATEFORMAT(yyyyMMdd)}.txt (append to file)

{JOB(Active|CounterProcessId)} | {TASK(PrevTask,LastRun,M/d/yyyy h:mm:ss.ff tt)}| {TASK(PrevTask,Result)} | {TASK(PrevTask,ExecutionTime)} seconds | {TASK(PrevTask,Name)}
------------------------------------------------------------------------------------------------------------------
{TASK(PrevTask,StdOut)}
{TASK(PrevTask,StdErr)}
------------------------------------------------------------------------------------------------------------------

I created a job with three .NET tasks in there.
Job name: Bulktest 1
Tasknames: Bulktest 1 - task 1 / Bulktest 1 - task 2 / Bulktest 1 - task 3
the output of the .NET task is for all three tasks: Bulktest 1
I setup the notifications as mentioned above
I made a loop for task 1 to 3 running it 50 times.

I made a clone of this job, modifing the 'Bulktest 1' text to 'Bulktest 2'. So for the jobname, tasksnames and the .NET output.
I made another clone making it Bulktest 3

the last job I created runs all three jobs at once at random order.
I used three start jop tasks for this which are not waiting to complete the task before going to the next run job task.

When I fire this 'run Bulktest' job it generates three log files named Bulktest 1 - 📅.txt / Bulktest 3 - 📅.txt / Bulktest 3 - 📅.txt
Every bulktest log file should have only entries of their own bulktest nr, but it isn't.

Bulktest 1 - 📅.txt

******************************************************************************************************************
Start job | 4 | Bulktest 1
******************************************************************************************************************
4 | 5/21/2015 8:40:22.76 AM| Success | 0.826 seconds | Bulktest 3 - task 1
------------------------------------------------------------------------------------------------------------------
Bulktest 3

------------------------------------------------------------------------------------------------------------------
4 | 5/21/2015 8:40:23.58 AM| Success | 0.888 seconds | Bulktest 1 - task 2
------------------------------------------------------------------------------------------------------------------
Bulktest 1

------------------------------------------------------------------------------------------------------------------
4 | 5/21/2015 8:40:24.67 AM| Success | 0.612 seconds | Bulktest 2- task 3
------------------------------------------------------------------------------------------------------------------
Bulktest 2

------------------------------------------------------------------------------------------------------------------
4 | 5/21/2015 8:40:25.36 AM| Success | 0.865 seconds | Bulktest 1 - task 1
------------------------------------------------------------------------------------------------------------------
Bulktest 1

------------------------------------------------------------------------------------------------------------------
4 | 5/21/2015 8:40:26.33 AM| Success | 0.78 seconds | Bulktest 1 - task 2
------------------------------------------------------------------------------------------------------------------
Bulktest 1

------------------------------------------------------------------------------------------------------------------
4 | 5/21/2015 8:40:27.14 AM| Success | 1.093 seconds | Bulktest 1 - task 3
------------------------------------------------------------------------------------------------------------------
Bulktest 1

Bulktest 2-📅.txt

******************************************************************************************************************
Start job | 5 | Bulktest 2
******************************************************************************************************************
5 | 5/21/2015 8:40:22.76 AM| Success | 0.826 seconds | Bulktest 3 - task 1
------------------------------------------------------------------------------------------------------------------
Bulktest 3

------------------------------------------------------------------------------------------------------------------
5 | 5/21/2015 8:40:23.69 AM| Success | 0.906 seconds | Bulktest 2 - task 2
------------------------------------------------------------------------------------------------------------------
Bulktest 2

------------------------------------------------------------------------------------------------------------------
5 | 5/21/2015 8:40:24.67 AM| Success | 0.612 seconds | Bulktest 2- task 3
------------------------------------------------------------------------------------------------------------------
Bulktest 2

------------------------------------------------------------------------------------------------------------------
5 | 5/21/2015 8:40:25.47 AM| Success | 0.956 seconds | Bulktest 2 - task 1
------------------------------------------------------------------------------------------------------------------
Bulktest 2

Bulktest 3-📅.txt

******************************************************************************************************************
Start job | 6 | Bulktest 3
******************************************************************************************************************
6 | 5/21/2015 8:40:22.76 AM| Success | 0.826 seconds | Bulktest 3 - task 1
------------------------------------------------------------------------------------------------------------------
Bulktest 3

------------------------------------------------------------------------------------------------------------------
6 | 5/21/2015 8:40:23.69 AM| Success | 0.906 seconds | Bulktest 2 - task 2
------------------------------------------------------------------------------------------------------------------
Bulktest 2

------------------------------------------------------------------------------------------------------------------
6 | 5/21/2015 8:40:24.67 AM| Success | 0.612 seconds | Bulktest 2- task 3
------------------------------------------------------------------------------------------------------------------
Bulktest 2

------------------------------------------------------------------------------------------------------------------
6 | 5/21/2015 8:40:25.36 AM| Success | 0.865 seconds | Bulktest 1 - task 1
------------------------------------------------------------------------------------------------------------------
Bulktest 1