download crawlers [21 articles found] (supplemental result)
Saving bandwidth by fixing IIS etags..
ETagFix is an
ISAPI plugin for Internet Information Server (
IIS) that changes the etag produced by IIS so that your etag does not change every time your computer reboots. This can result in web crawlers and user clients wanting to recache your web
page when they don`t need to.
Internet Servers - Other, On January 20, 2008 updated, downloaded 30 times, file size is 713Kb.
XML Sitemap for Zen Cart.
XML Sitemap for Zen Cart - Zen Cart module generates XML Sitemap, REQUIRED for search engine optimization for Google, MSN, Yahoo - all at once! Web crawlers usually discover pages from links within the site and from other sites. Sitemaps supplement this data to allow crawlers that support Sitemaps to pick up all URLs in the Sitemap and learn about those URLs using the associated metadata.
Web Design - E-Commerce, On September 8, 2008 updated, downloaded 29 times, file size is 189Kb.
Create snazzy Google sitemaps in seconds!.
By placing a
Sitemap-formatted file on your webserver, you enable the
Google crawlers to find out what pages are present and which have recently changed, and to crawl your site accordingly. Using Sitemaps to inform and direct the Google crawlers, they hope to expand their coverage of the web and improve the time of inclusion in their index.
Web Design - HTML Tools, On June 5, 2009 updated, downloaded 34 times, file size is 2897Kb.
Software extract data from website.
VietSpider Web Data Extractor (VDER) implement the website parse template concept, a web 3.0 crawling technology that is based on human-machine clever associations. The new web crawler model allows the admin to define the the regions of a site that have the valuable data as well as the block or field of data that the crawler should extract from a webpage.
Internet Servers - Web, On November 28, 2009 updated, downloaded 1 times, file size is 18005Kb.
Manage and track visits by robots/spiders.
Manage and track visits by
robots,
spiders and
crawlers to your website. Identify which spiders visited, when they visited, and what pages they indexed. Direct spiders to your most important pages, and exclude them from non-public pages. Maximizes effectiveness with search engines by avoiding over/under submitting. Excellent to improve search engine placements for users of automatic submission software such as WebPosition, TopDog, AddWeb, etc.
Computer Networking - Other Internet Tools, On January 15, 2008 updated, downloaded 21 times, file size is 3475Kb.
Log Advertiser is tool to gain links..
Why do you need
Log Advertiser?
Have you ever seen sites with `last 10 referrers` area? Just go to Yahoo! and input this query string `link:http://cialis-online-bu y.surf.to`. Then click search. Almost each site from results contains a small area with referrals.
Those areas are indexed by search engines too. You found results using search engine? Crawlers find same results too. You do not need any expensive advertising to get your site indexed.
Web Design - Web Design & Other Tools, On November 28, 2008 updated, downloaded 42 times, file size is 1202Kb.
XML Sitemap for CRE Loaded - CRE Loaded mod.
Generates XML Sitemap, REQUIRED for search engine optimization for Google, MSN, Yahoo - all at once! 4 Step very easy installation, start using in 5 minutes! Completely dynamic - no additional support required. Supports UNLIMITED number of pages (when million is not enough). Supports XML Sitemap Index. Support Google, MSN, Yahoo at ONCE. Advanced Admin Section available for advanced users. 1 year FREE module upgrade included.
Web Design - E-Commerce, On July 5, 2008 updated, downloaded 29 times, file size is 30Kb.
Web Extract with Web Spider / Web Crawler.
Build a custom
web spider /
web crawler using web data extraction / screen scraping technology. Use the
web extract for web data mining of contact lists, product catalogs, government databases, real estate listings, or build a custom
email extractor.
Creating your own
web grabber that can Screen Scrape the data to a database or Excel has never been easier. The
website spider / crawlers can even sort and filter the webpages while
spidering.
Computer Networking - Browser Add-Ons, On January 18, 2008 updated, downloaded 63 times, file size is 52521Kb.
KeyWord generator is free powerfull tool..
KeyWord generator is free powerfull tool to generate
keywords and save them. Using KeyWord generator lite you can generate more than 100 keywords and use them in your meta tags, titles or content of your web page. Keywords are really powerfull way to make search engines remember about you. Meta keywords can be extremely effective if they feat content properly. But beware of spam keywording. Awoid repeating of the same keyword too often.
Web Design - Site SEO, On January 16, 2008 updated, downloaded 77 times, file size is 138Kb.
Email address code scrambler. Fight spam..
Email address code scrambler. Fight spam. Your spam problem comes from spam crawler robots. They crawl your site to add your email addresses their spam lists. Make your email addresses invisible to spam crawlers. Hide your mail addresses from robots in plain sight. Visitors to your web pages can read and click on your email addresses the same way they do now. Robots will not find them. Stay off spam lists. Search engine friendly. Easy to use.
Web Design - Java & JavaScript, On January 19, 2008 updated, downloaded 46 times, file size is 9Kb.
Robots.txt files in seconds for all websites..
Create your
robots.
txt files in seconds and maintain them easilly and effortlesly with the unique utility Advanced Robots.
txt Generator. The software supports 300 robots, works in a WYSWIWYG visual way and comes with full documentation and unlimited customer support. It`s features include automatic creation of Robots.txt files, automatic uploading, comparison with previously saved project, online/offline documentation, manual, free upgrades etc.
Web Design - HTML Tools, On January 15, 2008 updated, downloaded 34 times, file size is 1577Kb.
A tool to create and manage Robots.txt files.
Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions
Web Design - E-Commerce, On January 21, 2008 updated, downloaded 22 times, file size is 2870Kb.
~~ Get keywords and phrases from log files ~~.
Use your web logs to discover which search terms lead to sales.
Reports by words and phrases within Search Term, Sta
Includes reports by Search Term, Start Page and specific Search Term + Start Page combinations.
See a graph of the number of finds plotted against time.
See a breakdown of the pages to which user surfed.
Advanced robot - crawler filtering.
Define groups of keywords and view all statistics for the group as a whole
Web Design - Log Parsers, On October 2, 2008 updated, downloaded 31 times, file size is 4371Kb.
Essensial web tools not available elsewhere..
The
InnerPeace WebMaster Toolkit is a collection of essensial tools assembeled and made by the Webmasters of InnerPeace. Some of these essensial tools are not available anywhere else. Includes a fast, easy
4 hexillion color combo picker, PageJumper web page forwarder,
EScrambler to scramble your email addresses and hide them from spamcrawlers, plus some excellent articles. Easy to use. Runs on any O/S: Windows, Mac, Unix, etc. License: GNU GPL.
Web Design - Reference & Tutorials, On January 23, 2008 updated, downloaded 59 times, file size is 370Kb.
Spread your blog around the world. Free tool..
Blogspreading is a small free utility, which automatically appends a link to the latest post in your blog to your e-mail signature. This will easily catch the recipients` interest and convert them to the readers of your blog. All
e-mail clients allow automatic adding of a signature to outgoing message. The signature is stored in an external text file. Blogspreading processes this file in such a way that it always contains link to the latest post.
Computer Networking - Other Mail Tools, On September 14, 2009 updated, downloaded 32 times, file size is 578Kb.
Powerful creator of DHTML tree menu!.
It creates
tree menu easily, with NO JS experience required. Its high compatibility supports most browsers, including Firefox 2.0 and Opera 9. It supports Windows Vista (SP1). It works well with Dreamweaver, Expression Web, FrontPage and Golive. It creates search-engine-friendly sitemaps and Site Navigation Structure Generator will generate menu based on your site. You can control expanding or collapsing the sub tree in web page.
Web Design - Java & JavaScript, On April 27, 2009 updated, downloaded 29 times, file size is 4404Kb.
Powerful creator of DHTML tree menu!.
It creates
tree menu easily, with NO JS experience required. Its high compatibility supports most browsers, including Firefox 2.0 and Opera 9. It supports Windows Vista (SP1). It works well with Dreamweaver, Expression Web, FrontPage and Golive. It creates search-engine-friendly sitemaps and Site Navigation Structure Generator will generate menu based on your site. You can control expanding or collapsing the sub tree in web page.
Web Design - Java & JavaScript, On April 28, 2009 updated, downloaded 29 times, file size is 4404Kb.
A powerful creator to build DHTML menu easily.
Let your creation of
JavaScript menus simple! The generated JavaScript menus can be compatible with most browsers. Template is provided to start menu without designing; image library is offered to use the image resource from the program. The search engine will find the menu apps contents and its link easily by Search Engine Friendly Code Maker. It integrates with Dreamweaver and FrontPage seamlessly; you can edit the menu in web editor directly!
Web Design - Java & JavaScript, On April 26, 2009 updated, downloaded 24 times, file size is 10486Kb.
A powerful creator to build DHTML menu easily.
Let your creation of
JavaScript menus simple! The generated JavaScript menus can be compatible with most browsers. Template is provided to start menu without designing; image library is offered to use the image resource from the program. The search engine will find the menu apps contents and its link easily by Search Engine Friendly Code Maker. It integrates with Dreamweaver and FrontPage seamlessly; you can edit the menu in web editor directly!
Web Design - Java & JavaScript, On April 17, 2009 updated, downloaded 44 times, file size is 10492Kb.
Run your own file upload site like Rapidshare.
Run your own file upload site like Rapidshare or MegaUpload with XFileSharing script. XFileSharing script is an advanced solution for creating free
file hosting websites. It does not require mysql database and can be installed on any virtual/shared or dedicated hosting running Perl (most servers do). You can customize look and feel of your site with just editing HTML files and can place banners, adsense or other type advertisement on its pages.
Computer Networking - File Sharing Programs, On February 4, 2008 updated, downloaded 62 times, file size is 81Kb.