2024 · 20 citations · 10 references
ComputingComputer ScienceInformation TechnologyData ManagementData StructuresDatabasesData Structure AlgorithmsInformation ExtractionQuery ProcessingTree VisualizationWeb MiningXml DatabasesInformation Extraction From Structured DocumentsStructured Data ExtractionWeb Information ExtractionWeb Structure MiningXml Data Management
In today’s digital workspace, users are routinely able to access diverse information from numerous websites, which is a common practice for them to obtain multiple analyses, statistics, and factual content. To obtain specific information, including word definitions or executive summaries, people turn to internet searches or specific websites. Several existing systems use web scraping methodologies to extract targeted information from websites as part of this pursuit. The Beautiful Soup and Request Python libraries, which are well-known tools in this field, were utilized in this study. Beautiful Soup uses parser techniques to efficiently navigate web pages, allowing users to extract and gather the content they desire. Xtree model can be an efficient way to gather data, but it’s important to follow ethical conventions, maintain rules, and respect website regulations.
10
Web scraping technologies in an API world
Daniel Glez‐Peña, Anália Lourenço, Hugo López-Fernández et al. · Briefings in Bioinformatics · 2013 · 201 citations · Full text
Web Scraping for Data Analytics: A BeautifulSoup Implementation
Ayat Abodayeh, Reem Hejazi, Ward Najjar et al. · 2023 · 40 citations