Publication | Closed Access

An investigation of web crawler behavior: characterization and metrics

Computational Social ScienceSearch Engine OptimizationEngineeringInformation RetrievalData ScienceWeb Crawler BehaviorWebometricsComputer ScienceSearch Engine Design