Data Scrapping & A Final Repor 30.06.08
I am looking for some help in data scrapping from the web.
First - this site http://www.optionmonster.com/ - they have a section called - Thermal Imaging (with 4 tab options) can you scrap all of this info.
secondly - http://biz.yahoo.com/opt/stat2.html & http://biz.yahoo.com/opt/stat1.html
lastly - http://www.schaeffersresearch.com/streetools/centers/sttc/tools/unusually_high_option_volume.aspx and http://www.schaeffersresearch.com/streetools/centers/sttc/tools/daily_oi.aspx
Since each page only has 20 options listed. My goal would be scan these pages and have it data put together to then only provide me with details of matches that occur between all those sites listed.
So if all sites had YHOO listed it should appear on the top of my final report.
The software will be run via crontab maybe each hour during trading hours and a report is generating that listed from the order of option symbol appearing the most on those pages.
The final report should its results per scan but only showing the most updated one to admin. This is a small aside only if its possible without big increase in time to do it. I would like the report to show symbol and if their appearance has increased across those sites or decreased as well. The final report does not need this but I would like this option if its not too much.
