custom will be the best ..... can save under any format
I'm looking for a tool (either a script or something I can run locally on my laptop) that will crawl an entire website and give me this info on all pages on the site:
meta description tag
meta keywords tag
Do you know of a script or website crawler program that will do that?
I don't recall seeing anything that does exactly what you need, but maybe you could use this script below to build a list of all the urls on a site.
PHP Examples: Extract all URLS from a webpage
and then feed that list into a script like this.
Bot that retrieves url meta data and other infos - Barattalo
Mini Bots PHP Class - Barattalo
There's a ton of similar scripts which could be useful, I'll keep an eye out for something better.
Submit Your Webmaster Related Sites to the NB Directory
I swear, by my life and my love of it, that I will never live for the sake of another man, nor ask another man to live for mine.
bhartzer (17 January, 2011)