Recently I was assign to do some Web Scraping and Data Scraping work. I do some research and find it is pretty easy but somehow Cumbersome job.
I managed to use simple Classic VBScript programming to read and save each web pages and get the useful data out with Regular Expression. However this job is not a one-time job, you need to analyze each HTML code first before you can get the correct data out using correct way. Usually you will face a lot of rule violations so you need fix many exceptions.
The best of all, it can also compile into an exe file for other specific purpose. I suggest you try this tool if you are doing web scraping, it will save you a lot of programming and debuging time.