I have a job setup with a FTP/FTPS/SFTP/SCP task. This task has an Upload subtask that is connecting to an AIX server and is copying 2 files over to a directory on this AIX server. The 2 files are both on average 5GB. When I run the job it fails with the following error.

Exception in Task: Failed to upload file: /SourceDirectory/File to /DestinationDirectory/File, err: Failure

Despite this error, I see that ~1GB of the 5GB file has been moved.

When I go into the Upload subtask I see tab called File Filter, under that a tab called Size, and under that there are settings for "check if file is smaller than x size" and "check if file is larger than x size". So here I selected and entered a "3" so that it reads "File is larger than 3 GB".
But when I run the job, it still fails with the same error. And again when I look at the AIX server, I see that only ~1GB of the 5GB file has been moved.

Any suggestions?

Update with no success yet:
I tried messing with the "Max packet size" and "Upload block size" (in the Connections settings for the particular SFTP (SSH) connection) by changing the values to the max allowed by VisualCron, but this too failed and only 1 gb of the file was moved.

I had a lot of trouble with something similiar. Unfortunately you seem to have tried most of the things I could suggest:) I managed to get decent performance with these settings:



One thing that sometimes helps is the uncheck the lowest sftp version support fields. Uncheck one at the time, to find out the highest version the server supports. I believe the servers are supposed to agree on the highest version anyway, but I have found this can help sometimes. Apart from that, add logging and see if there is something helpful there. Post an image of your settings.

I assume you have tried with another client like FileZilla, and it works there?

I have a job setup with a FTP/FTPS/SFTP/SCP task. This task has an Upload subtask that is connecting to an AIX server and is copying 2 files over to a directory on this AIX server. The 2 files are both on average 5GB. When I run the job it fails with the following error.

Exception in Task: Failed to upload file: /SourceDirectory/File to /DestinationDirectory/File, err: Failure

Despite this error, I see that ~1GB of the 5GB file has been moved.

When I go into the Upload subtask I see tab called File Filter, under that a tab called Size, and under that there are settings for "check if file is smaller than x size" and "check if file is larger than x size". So here I selected and entered a "3" so that it reads "File is larger than 3 GB".
But when I run the job, it still fails with the same error. And again when I look at the AIX server, I see that only ~1GB of the 5GB file has been moved.

Any suggestions?

We've had email contact, but did you try Thomas suggestion on settings?

I had a lot of trouble with something similiar. Unfortunately you seem to have tried most of the things I could suggest:) I managed to get decent performance with these settings:



One thing that sometimes helps is the uncheck the lowest sftp version support fields. Uncheck one at the time, to find out the highest version the server supports. I believe the servers are supposed to agree on the highest version anyway, but I have found this can help sometimes. Apart from that, add logging and see if there is something helpful there. Post an image of your settings.

I assume you have tried with another client like FileZilla, and it works there?

Hey Thomas,
Thank you for your reply. I'm sorry for the delay.
So I made my connection settings match yours. And I checked the "SFTP version support" one at a time from the highest one down until one that worked (3 & above). Unfortunately I still had the same results in the end. Only 1 GB of the .csv file was transferred.

I had a lot of trouble with something similiar. Unfortunately you seem to have tried most of the things I could suggest:) I managed to get decent performance with these settings:



One thing that sometimes helps is the uncheck the lowest sftp version support fields. Uncheck one at the time, to find out the highest version the server supports. I believe the servers are supposed to agree on the highest version anyway, but I have found this can help sometimes. Apart from that, add logging and see if there is something helpful there. Post an image of your settings.

I assume you have tried with another client like FileZilla, and it works there?

And to answer the last part of your question. I have not tried FileZilla, just the SFTP via VisualCron because that's the approved tool I have to use.

Ok this was an AIX server issue.
Modifying the fsize in /etc/security/limits to -1 resolved this.

/etc/security/limits
vc_ftp_user
fsize = -1

This article talks about the fsize issue.

https://www.ibm.com/supp...te-size-1073741312-bytes 

Ok this was an AIX server issue.
Modifying the fsize in /etc/security/limits to -1 resolved this.

/etc/security/limits
vc_ftp_user
fsize = -1

Ah, glad you found the issue and that it was on the sftp server side. Thank you for the information!