Visual Web Spider 5.2
Visual Web Spider is a software for collecting relevant websites on the Internet. Visual Web Spider is a website crawler, fully automated, multithreaded web robot. It helps you to populate a database of websites, META data and locate relevant information for research purposes. Visual Web Spider extracts title, keywords, description, plain text content, HTML content and last modified time from the web pages.
Web Bot Programming Library 1.0.0
Crawl the web with this free ActiveX web bot component. Advanced features include caching, "avoid" patterns, and robots.txt compliance.