| The last human family is already dead! This just leaves you, and endless hordes of evil killer robots. You will certainly die. But how many of them can you take with you? Play for the glory. Only hiscores matter! |
Manage and track visits by robots, spiders and crawlers to your website. Identify which spiders visited, when they visited, and what pages they indexed. Direct spiders to your most important pages, and exclude them from non-public pages. Easy to use |
Spiders a site and creates output files containing (1) a list of URLs in the site, (2) a Google sitemap, (3) an XML summary file with title, description, and keywords for each page, and (4) links to URLs external to the spidered domain. |
WTS is a perfect tool for collecting data from the web. Easily configure WTS settings in Windows application mode to collect information you're interested in from other web sites. WTS can be run either as a Windows application or as a background proc |