Concepedia

Search Engine Crawling

Search Engine Crawling is a methodological process in which automated software agents systematically discover, retrieve, and index web content by traversing hyperlinks across the internet to populate and update a search engine’s database for information retrieval.

149

Publications

8.3K

Citations

369

Authors

147

Institutions

Publications per year

2017–2026

14

Parents

Publications

149

Investigating web services on the world wide web

Eyhab Al‐Masri, Qusay H. Mahmoud · 2008 · 614 citations · Full text

, , +12

Focused Crawling Using Context Graphs

Michelangelo Diligenti, Frans Coetzee, Steve Lawrence et al. · 2000 · 522 citations

, , +13

Searching the Web

Arvind Arasu, Junghoo Cho, Héctor García-Molina et al. · ACM Transactions on Internet Technology · 2001 · 506 citations

, , +17

Developing a Framework for Assessing Information Quality on the World Wide Web

Shirlee-ann Knight, Janice M. Burn · Informing Science The International Journal of an Emerging Transdiscipline · 2005 · 353 citations · Full text

, , +17

A large-scale study of the evolution of web pages

Dennis Fetterly, Mark S. Manasse, Marc Najork et al. · 2003 · 347 citations

, , +16

1–5 of 149

Authors

369

  1. CL
    C. Lee Giles

    Pennsylvania State University, United States

    6 publications · 680 citations

    6

    h-index

  2. JC
    Junghoo Cho

    University of California, Los Angeles, United States

    6 publications · 1K citations

    6

    h-index

  3. US
    Uri Schonfeld

    University of California, Los Angeles, United States

    6 publications · 217 citations

    6

    h-index

  4. DM
    Debajyoti Mukhopadhyay

    Indian Institute of Information Technology, Pune, India

    5 publications · 115 citations

    5

    h-index

  5. NC
    Nick Craswell

    Microsoft (United States), United States

    4 publications · 130 citations

    4

    h-index

1–5 of 369

Institutions

147

  1. Microsoft (United States)

    Redmond, United States

    8 h-index

    20 publications

    1.9K citations

  2. Pennsylvania State University

    State College, United States

    6 h-index

    20 publications

    525 citations

  3. University of California, Los Angeles

    Los Angeles, United States

    5 h-index

    6 publications

    405 citations

  4. Commonwealth Scientific and Industrial Research Organisation

    Canberra, Australia

    4 h-index

    9 publications

    269 citations

  5. Technion – Israel Institute of Technology

    Haifa, Israel

    3 h-index

    6 publications

    294 citations

  6. J.C. Bose University of Science & Technology, YMCA

    Faridabad, India

    3 h-index

    6 publications

    110 citations

  7. Yahoo (United Kingdom)

    London, United Kingdom

    3 h-index

    8 publications

    193 citations

  8. Techno India Group (India)

    Kolkata, India

    3 h-index

    9 publications

    264 citations

1–8 of 147

Venues

  1. 4

    h-index

  2. Proceedings of the VLDB Endowment

    PVLDB · 3 publications · 404 citations

    3

    h-index

  3. 2

    h-index

  4. Very Large Data Bases

    Conference · 2 publications · 56 citations

    2

    h-index

  5. arXiv (Cornell University)

    Repository · 2 publications · 27 citations

    2

    h-index

1–5