Web Page Scraping with the following...

fthomas · Post by **fthomas** » Thu Nov 11, 2010 2:19 am

Hey all, I'm wondering the following. Is it possible to scrape a web page with the following situations in mind:

1. Scraping with not an ID or Name, but a Class name?
2. Scraping the data that exists between a set of delimiters, such as, .
3. With the above in mind with also the ability to perform this with wildcards or regex expressions?

Second, is there any way to do this and have it all inserted into an array set if more then one instance exists?

Thanks!

Frank

Post by **Marcus Tettmar** » Thu Nov 11, 2010 9:09 am

Yes. Use ExtractTag to extract the entire BODY element (or even HTML element) or if there is a more defined section containing the data like a DIV then use that. Tell it to extract all HTML. Then parse that HTML using RegEx.

fthomas · Post by **fthomas** » Thu Nov 11, 2010 8:19 pm

Thanks for the reply Marcus,

Can you offer up some examples or possibly would it be possible to hire an hour of your time to get some condensed learning?

Frank