Scrape Google Trends 25.03.08
I want a site that takes Google Trends top 100 list each day, generates a page for each term (static)… very much like trendspulse. com
I want each page to have the top 10 Google, Google Blogs, Yahoo and Live results imported onto the page, along with 10 or so images pulled from Google Images and linked to the associated image.
I want each day in its own folder with the 100 html pages for each respective keyword… so today would be domain.com/2008/3/24/keyword1.html etc
I am familiar with PHP/MySQL but I’m not sure about scraping and making it look pretty (filtering out the junk from search results etc).
I’m not sure the best way to implement this system, other than starting with Google’s XML feed located here: http://www.google.com/trends/hottrends/atom/hourly
Perhaps importing these top 100 once a day at 7am, querying each search engine, scraping the data, and posting it out to each page?
