Preview the site directory and file structure and download only what you're looking for.
byDownload.com staff/ February 27, 2009
This Web spider utility detects and displays detailed information for a user-selected Web page, and it offers other Web page tools.
BlackWidow's clean, logically tabbed interface is simple enough for intermediate users to follow but offers just enough under the hood to satisfy advanced users. Simply enter your URL of choice and press Go. BlackWidow uses multithreading to quickly download all files and test the links. The operation takes only a few minutes for small Web sites.
Webmasters will love the comprehensive list of broken links and error codes. Finding file locations is simple, since the utility displays the full Web site directory structure. A handy feature searches a Web site to find all properly formatted e-mail addresses, although a tool to find broken addresses would have been a nice addition. It's easy to track the spider's process in the Threads tab, and you'll find a powerful net sniffer in the Net Spy tab that can watch all traffic that moves through your network card. Advanced users will enjoy tools to create plug-ins and apply filters to the spidering process.