Can search engines be used as tools for web‐link analysis? A critical view

TLDR

Commercial search engines’ shortcomings are primarily market‑driven rather than inherent to web technology, and improved functionalities are technically feasible for the research community. The study examines the challenges of using commercial search engines for web‑link analysis and seeks to clarify the nature of those challenges. The research shows that commercial search engines yield highly variable, limited, and opaque results that change over time, warranting caution in drawing conclusions, though they provide modest support for linking web links to citation analogues.

Abstract

The paper investigates the problems of using commercial search engines for web‐link research and attempts to clarify the nature of the problems involved in the use of these engines. The research finds that search engines are highly variable in the results they produce, are limited in the search functions they offer, have poorly and/or incorrectly documented functions, use search logics that are opaque, and change the search functions they offer over time. The limitations which are inherent in commercial search engines should cause researchers to have reservations about any conclusions that rely on these tools as primary data‐gathering instruments. The short‐comings are market‐driven rather than inherent properties of the web or of web‐searching technologies. Improved functionalities are within the technical capabilities of search engine programmers and could be made available to the research community. The findings also offer mild support for the validity of the connection between web links and citations as analogues of intellectual linkage.