Hi I do alot of web scrapping. I currently use iMacros which has been very good tool for scrapping. I also use alot of other automation tools in my daily work. I would like to find 1 solutions instead of the 3-4 tools and various scripts I use.
Looking for an opinion of a avid web scrapper on MJT as a real single solution for scrapping various website complexities, also if you have an experience & opinion of how it compares to iMacros that would be helpful as well.
thanks!!
Web Scraper? vs iMacros?
Moderators: JRL, Dorian (MJT support)
- CyberCitizen
- Automation Wizard
- Posts: 724
- Joined: Sun Jun 20, 2004 7:06 am
- Location: Adelaide, South Australia
Re: Web Scraper? vs iMacros?
I think Macro Scheduler would be perfect for you to incorporate everything into one application / tool.
Macro Scheduler has IE Automation wizard which you can use to record a webpage, login info, extract data to variables, import data etc. That being said use you also use HTTP Requests / Posts, Python, etc.
Download the demo and check it out.
Macro Scheduler has IE Automation wizard which you can use to record a webpage, login info, extract data to variables, import data etc. That being said use you also use HTTP Requests / Posts, Python, etc.
Download the demo and check it out.
FIREFIGHTER
-
- Pro Scripter
- Posts: 70
- Joined: Sun May 03, 2009 11:49 pm
- Location: AU
Re: Web Scraper? vs iMacros?
Totally agree with @CyberCitizen.
Give it a trial. You will never look back. It adds mulitiple dimensions to your automation capabilities...love it...
Here is one way i use it:
>Scrape data from excel file (2,000 odd rows, 12 columns) without opening the file(XLSheetToArray)
>Each row and column holds a value needed in a web form held in the array
>Fill in the data into a form (IE WebRecorderFunctions) 2,000 times. Form has about 10 pages to fulfil each task. (done in 25 secs each average)
>Report status and result of each one
Would normally take days to fulfill this manually...
Give it a trial. You will never look back. It adds mulitiple dimensions to your automation capabilities...love it...
Here is one way i use it:
>Scrape data from excel file (2,000 odd rows, 12 columns) without opening the file(XLSheetToArray)
>Each row and column holds a value needed in a web form held in the array
>Fill in the data into a form (IE WebRecorderFunctions) 2,000 times. Form has about 10 pages to fulfil each task. (done in 25 secs each average)
>Report status and result of each one
Would normally take days to fulfill this manually...
Loving MS's Capabilities!!!