In today’s scenario, there is an ample amount of data on the internet that can be accessed by everyone. This is the data that can be indexed by search engines. There are softwares named Web Crawlers that explore the WWW in an efficient manner. But there is also a large amount of data that is still out of reach from the access of the conventional search engines. This is known as Deep Web or Invisible Web. Web pages that are hidden created dynamically as a result of queries send to particular web databases. For traditional web crawlers, it is almost impossible to access the content of deep web due to its structure. To retrieve the contents of deep web is a challenge in itself. This paper discusses the methods and tools of crawling the web that is hidden beneath the surface.
Deep web, surface web, search engines, crawling, information retrieval
 Margaret H. Dunham, Data mining –Introductory and Advanced Topics
L. Barbosa and J. Freire., Searching for Hidden-Web Databases. In Proceedings of WebDB, pages 1--6, 2005
 Namrata Bhalerao, Dr. Subhash K. Shinde, Deep Web Crawl For Deep Web Extraction, International Journal of Engineering Research & Technology (IJERT), Vol. 2 Issue 3, March – 2013
 Dilip Kumar Sharma, A.K. Sharma, A Novel Architecture for Deep Web Crawler, International Journal of Information Technology and Web Engineering, Volume 6 Issue 1, January 2011, Pages 25-48
[Smita Agrawal, Kriti Agrawal (2013), Deep Web Crawler: A Review, International Journal of Innovative Research in Computer Science & Technology (IJIRCST), Vol-1, Issue-1, Page No-12-15], (ISSN 2347 - 5552). www.ijircst.org
Assistant Professor, Department of Information Technology, International Institute For Special Education, Lucknow, INDIA (firstname.lastname@example.org).