Quick Question: Limit on FTPGetDirList return ?

Technical support and scripting issues

Moderators: JRL, Dorian (MJT support)

Post Reply
Methuselah
Junior Coder
Posts: 49
Joined: Fri Oct 15, 2004 8:42 am
Location: Johannesburg, South Africa

Quick Question: Limit on FTPGetDirList return ?

Post by Methuselah » Mon Oct 17, 2005 1:56 pm

Trying to figure out where the limit lies ... Unix or MSched.

Over a certain (unknown) number of lines the command returns 0 bytes.
It does not die (i.e. returns FTP_RESULT=Success), but filelen is 0.

e.g restricting by portion of filename produces a result.
... ,/main/software/siebel/export/mis/*10*,D

but asking for everything gives nothing at all.
... /main/software/siebel/export/mis/*,D ... gives nothing.

(It used to produce output, but now there are more files present)


FTP_TIMEOUT doesn't change anything - status window closes immediately - under 1 second so nothing there either.

Specific file transfers (by name) over 45 Mb are working, so no limit there either.


Any Other Clues ?

Meths.

Methuselah
Junior Coder
Posts: 49
Joined: Fri Oct 15, 2004 8:42 am
Location: Johannesburg, South Africa

Any ideas ?

Post by Methuselah » Tue Oct 25, 2005 8:22 am



I would still be keen on an opinion.


User avatar
pgriffin
Automation Wizard
Posts: 460
Joined: Wed Apr 06, 2005 5:56 pm
Location: US and Europe

Post by pgriffin » Mon Oct 31, 2005 7:30 pm

If you are having success with "a portion of a file name", then have you tried accomplishing this task with multiple "portions"?

Probably wouldn't be too difficult to combine the results from multiple operations of the command.

Me_again
Automation Wizard
Posts: 1101
Joined: Fri Jan 07, 2005 5:55 pm
Location: Somewhere else on the planet

Post by Me_again » Mon Oct 31, 2005 8:29 pm

Can you give us any idea (order of magnitude even) of the number of files that is causing this problem? I'm sure there are some users who could test this, but without a better idea of how it's failing for you I don't see how to make a meaningful test.

Could it be just the timeout?

Methuselah
Junior Coder
Posts: 49
Joined: Fri Oct 15, 2004 8:42 am
Location: Johannesburg, South Africa

How many files are there ?

Post by Methuselah » Tue Nov 01, 2005 6:47 am

The folder contains an additional 14 files each day ... and I do not know how many were there the last time the full directory listing worked.
(Been going since 29 August, so go figure ;-))

I have been retrieving "a portion" by the extract date - and so only ever get 14 files.

Have tried combinations ... biggest I can achieve due to naming convention ... *10* returned 425 files.
Other combinations produce less or all files = empty file returned.

Totals:
*2005_08_* = 22
*2005_09_* = 363
*2005_10_* = 414



HTH !

Me_again
Automation Wizard
Posts: 1101
Joined: Fri Jan 07, 2005 5:55 pm
Location: Somewhere else on the planet

Post by Me_again » Tue Nov 01, 2005 6:48 pm

I don't think the problem is on the macro scheduler side. I couldn't quickly find a huge directory but I had no problem using ftpgetdirlist to fully and correctly list a VMS system directory with 2,659 files, the output listing file size was 221K. That would be equivalent to about 6 months of files at 14 per day.

Post Reply
Sign up to our newsletter for free automation tips, tricks & discounts