Extracting text from BIG text file?

rullbandspelare · Post by **rullbandspelare** » Tue Oct 16, 2007 5:32 am

Hi!
I have a BIG log file wich is about 60MB.
I whant to extract all the lines that contain the text "ERROR" and all the following lines until a "----------" is reached. This is appended to a ERROR.log file

I have this working but it takes a LOOOONG time. With a smal log file it is no problem.

I use the Windows XP command >find "ERROR" largefile.log.0 /N to get the line numbers of lines wich contains "ERROR". This is fairly fast.
Then i extract all the lines in this list + following lines until "-----" is encountered.

At first it is fast but when row numbers increase it gets slower and slower.

Any design ideas on how to do this faster?

Post by **Marcus Tettmar** » Tue Oct 16, 2007 7:33 am

You don't provide any information as to how you are reading the file in. ReadLn will be very slow on big files. ReadFile would be much faster. See:
http://www.mjtnet.com/blog/2007/07/02/r ... in-memory/

Alternatively you can read text files with VBScript using the FileSystemObject and OpenTextFile (search for those on this forum).