Live briefing
Everything about WebCrawler
Web search engine
WebCrawler is a search engine, and one of the oldest surviving search engines on the web today. For many years, it operated as a metasearch engine. WebCrawler was the first web search engine to provide full-text search. Wikipedia →
🧭 Start here: a 6-step reading path
- Read the overview: WebCrawlerA 5-minute orientation
- Pick up a classic book: Foundations of World Wide Web programming with HTML & CGIThe most-reprinted book on the subject
- Read the landmark paper: Application of WebCrawler in Information Search and Data MiningCited 1 times
- Go sideways: MetaCrawlerA closely related topic
- Go sideways: Zoo.comA closely related topic
🏆 Landmark papers (most cited)
📚 Books worth reading
Foundations of World Wide Web programming with HTML & CGIEd Tittel, Mark Gaither · 1995
Coding for Fun mit PythonLars Heppert · 2010
Ranked by number of editions on Open Library, a rough measure of how lasting a book is.
🔗 Related topics
- MetaCrawler MetaCrawler is a search engine. It is a registered trademark of InfoSpace and was created by Erik Selberg. It was originally a metasearch engine, as its…
- Zoo.com Zoo.com is a metasearch engine, which as of 2006, provided results from search engines and other sources, including Google, Yahoo! and Wikipedia. Also…
- Dogpile Dogpile is a metasearch engine for information on the World Wide Web that fetches results from Google, Yahoo!, Yandex, Bing and other popular search engines…
- System1 System1, Inc. is an American digital advertising and customer acquisition company. Formerly known as OpenMail, it was founded in 2013. It describes itself…
- Excite (web portal) Excite was a web portal providing a list of hyperlinks to other websites online from 1995 to 2026. Founded in 1993, Excite.com was once the world's sixth…
- InfoSpace Infospace, Inc. was an American company that offered private label search engine, online directory, and provider of metadata feeds. The company's flagship…
- Yahoo Japan Yahoo! Japan (ヤフー, Yafū) is a Japanese web portal. It was the most-visited website in Japan in October 2018, and among the top 50 worldwide. In 2020, Yahoo…
- A9.com A9.com was a subsidiary of Amazon that developed search engine and search advertising technology. A9 was based in Palo Alto, California, with teams in…