Footprint Finder Google Scraper

Harvest Urls from Google

I am not going to lie. There is really nothing special about this software. In fact, it’s pretty crappy. There are a couple of other tools out there with more features than mine has. The only feature mine has that there’s doesn’t is absence of a price tag. But in the spirit of a sales page begging you to take my free software. Let me tell you some of things you can do with this tool and why someone would want to harvest urls from Google.

• You may want to spy on a web design competitor by taking his footer credentials and putting them in quotes and then run it through my scraper tool to see the caliber and just how many sites he’s designed. If the designer adds a link, you could enter link:www.competitorsite.com. Or do both and then run the domain cleaner
• Look for traditional link sources by combining your niche keyword with phrases like “Suggest a Site”, “Add a Site”, “Submit Your Website”
• You may want to find sources for building backlinks. Open source web software is used by the masses. Millions of people use WordPress. And many of these WordPress installations have “powered by WordPress” in the footer. Add a niche keyword to that phrase and pull down a list of blogs to comment on. There are literally hundreds of searches you can uses to find common web 2.0 site footprints

So what about the features. Here they are:

• The search is limited to Google which is limited to 1000 results no matter what the page says.
• But you can add search after search to the list box to build a longer list of urls
• The list is exportable to text
• You can clean the list down to only unique domains if required
• I doubt it raises any objections with Google since it uses a true browser and only processes the page the browser has loaded.

Current Known Bugs

• Any query with a “+” in it does not make it to Google. So look for an update coming soon with a few more features, such as scraping more than just Google and the ability to save queries.

Huge Ass Bug

• The software broke with Google Instant. It only grabs the last page of results. So I am working sooner rather than later on an update. After all, what we are looking for is footprints and if all else fails, Google is not the only show in town.

Update

Both bugs above currently fixed in development version. Will build the installer and release it this weekend. Anyone who signed up for the list will get notified of the new version once the minute it is released – 9-10-2010

As of 9-11-2010, I have a working installation file, so scrape away. It comes with the Bing Toolbar. I feel it best to tell you that now. The software is free to you and Bing gives me some pocket money for the work I put into the software. You can always uninstall the toolbar if you no likey.

Download My Google Url Harvester Here

Related articles by Zemanta

• Google Killing Off Automated Queries – num=100 R.I.P ? (andybeard.eu)
• The SEO impact of Google Instant (epiphanysolutions.co.uk)
• Google Instant Search – Experts View (seoservicesgroup.com)
• No API? Use ScraperWiki to Add One (programmableweb.com)
• How Google Instant Changes the SEO Landscape (seobook.com)