International Journal of Innovative Research in Computer Science and Technology
Year: 2013, Volume: 1, Issue: 1
First page : ( 12) Last page : ( 15)
Online ISSN : 2347-5552
Article Tools: Print the Abstract | Indexing metadata | How to cite item | Email this article | Post a Comment
Smita Agrawal , Kriti Agrawal
In today’s scenario, there is an ample amount of data on the internet that can be accessed by everyone. This is the data that can be indexed by search engines. There are softwares named Web Crawlers that explore the WWW in an efficient manner. But there is also a large amount of data that is still out of reach from the access of the conventional search engines. This is known as Deep Web or Invisible Web. Web pages that are hidden created dynamically as a result of queries send to particular web databases. For traditional web crawlers, it is almost impossible to access the content of deep web due to its structure. To retrieve the contents of deep web is a challenge in itself. This paper discusses the methods and tools of crawling the web that is hidden beneath the surface.
[1] http://en.wikipedia.org/wiki/
[2] http://www.brandpowder.com/how-deep-is-your-web/
[3] http://papergirls.wordpress.com/2008/10/07/timeline-deep-web/
[4] Bergman, Michael. “The Deep Web: Surfacing Hidden Value.” Journal of Electronic Publishing. 7:1. 2001
[5] List-Handley, C. J. Information literacy and technology. 4th ed. Dubuque, Iowa: Kendall/Hunt, p. 36, 2008
[6] J. Callan, “Distributed information retrieval,” in Advances in Information Retrieval, (W. B. Croft, ed.), pp. 127–150, Kluwer Academic Publishers, 2000
[7] http://code.google.com/p/deep-web-intelligent-miner/
[8] R.Anita, V.Ganga Bharani, N.Nityanandam, Pradeep Kumar Sahoo,Deep iCrawl: An Intelligent Vision Based Deep Web Cralwer, World Academy of Science, Engineering and Technology, Volume 50, 2011
[9] Raghavan and H. Garcia-Molina. Crawling the Hidden Web. In Proc. of VLDB, pages 129–138, 2001
[10]http://websearch.about.com/od/invisibleweb/tp/deep-web-search- engines.htm
[11] http://people.hws.edu/hunter/deepwebgate03.htm
[12] http://www.brightplanet.com/
[13] Margaret H. Dunham, Data mining –Introductory and Advanced Topics
[14] http://www.emeraldinsight.com/
[15] http://www.makeuseof.com/
[16] http://techdeepweb.com/
[17] http://www.completeplanet.com
[18]L. Barbosa and J. Freire., Searching for Hidden-Web Databases. In Proceedings of WebDB, pages 1--6, 2005
[19] Namrata Bhalerao, Dr. Subhash K. Shinde, Deep Web Crawl For Deep Web Extraction, International Journal of Engineering Research & Technology (IJERT), Vol. 2 Issue 3, March – 2013
[20] Dilip Kumar Sharma, A.K. Sharma, A Novel Architecture for Deep Web Crawler, International Journal of Information Technology and Web Engineering, Volume 6 Issue 1, January 2011, Pages 25-48
Assistant Professor, Department of Information Technology, International Institute For Special Education, Lucknow, INDIA (sony.smita2003@gmail.com).
No. of Downloads: 9 | No. of Views: 2065
Manali Shukla, Ishika Goyal, Bhavya Gupta, Jhanvi Sharma.
July 2024 - Vol 12, Issue 4
Dipti Prajapati, Samishtarani Sabat, Sanika Bhilare, Rashmi Vishe, Prof. Suman Bhujbal.
March 2024 - Vol 12, Issue 2
Anu Sharma, Vivek Kumar.
May 2023 - Vol 11, Issue 3
