Search Results - Web Data Extraction and Crawling Techniques

A New Framework for Domain-Specific Hidden Web Crawling Based on Data Extraction Techniques by El-Desouky, A.I., Ali, H.A., El-Ghamrawy, S.M.

“…% of the content on the Web, this portion of Web called Hidden Web (HW), they are "Hidden" in databases behind search interfaces…”
Get full text

Scrimmo: A Real-Time Web Scraper Monitoring the Belgian Real Estate Market by Barzin, Felix, Yernaux, Gonzague, Vanhoof, Wim

“…Web scraping (or Web crawling), a technique for automated data extraction from websites, has emerged as a valuable tool for scientific research and data analysis…”
Get full text

Enabling maps/location searches on mobile devices: constructing a POI database via focused crawling and information extraction by Chuang, Hsiu-Min, Chang, Chia-Hui, Kao, Ting-Yao, Cheng, Chung-Ting, Huang, Ya-Yun, Cheong, Kuo-Pin

“… However, manual annotation is costly and limited in current POI search services. With the abundance of information on the Web, many store POIs can be extracted from the Web…”
Get full text

Swarm-intelligence-based extraction and manifold crawling along the Large-Scale Structure by Awad, Petra, Peletier, Reynier, Canducci, Marco, Smith, Rory, Taghribi, Abolfazl, Mohammadi, Mohammad, Shin, Jihye, Tiňo, Peter, Bunte, Kerstin

“…) on N-body cosmological simulation data of the Cosmic Web. The 1-DREAM toolbox consists of five Machine Learning methods, whose aim is the extraction and modelling…”
Get full text

Web Scraping or Web Crawling: State of Art, Techniques, Approaches and Application by Khder, Moaiad

“…Web scraping or web crawling refers to the procedure of automatic extraction of data from websites using software…”
Get full text

Developing an automated framework for eco-label information categorization using web crawling and Natural Language Processing techniques by Nguyen, Ho Anh Thu, Pham, Duy Hoang, Kim, Byeol, Ahn, Yonghan, Kwon, Nahyun

“… This study explores the application of web crawling techniques, Natural Language Processing (NLP…”
Get full text

Keyword weight optimization using gradient strategies in event focused web crawling by Rajiv, S, Navaneethan, C

“…•A web crawling system for obtaining the set of web data regarding key events is essential…”
Get full text

An ontology-driven multimedia focused crawler based on linked open data and deep learning techniques by Capuano, Andrea, Rinaldi, Antonio M., Russo, Cristiano

“… In this article we propose a novel approach to focused crawling based on the use of both textual and multimedia web page content…”
Get full text

Web crawling based context aware recommender system using optimized deep recurrent neural network by Boppana, Venugopal, Sandhya, P.

“… Majorly, content and collaborative filtering techniques are employed in typical recommendation systems to find user preferences and provide final recommendations…”
Get full text

Deep Web crawling: a survey by Hernández, Inma, Rivero, Carlos R., Ruiz, David

“…Deep Web crawling refers to the problem of traversing the collection of pages in a deep Web site, which are dynamically generated in response to a particular query that is submitted using a search form…”
Get full text

Collecting data on textiles from the internet using web crawling and web scraping tools by Muehlethaler, Cyril, Albert, René

“… It has become more affordable for researchers who can now devote most of their time to extracting meaningful information from the structured data…”
Get full text

Bot crawler to retrieve data from Facebook based on the selection of posts and the extraction of user profiles by Sánchez Paipilla, Ariel Guillermo, Durán Vaca, Mónica Katherine, Ballesteros Ricaurte, Javier Antonio, González Amarillo, Angela María, López, Pedro Nel

“…— The main objective of this work is to development of a Bot Crawler, which allows extracting information from Facebook without access restrictions, or request for credentials, based on web crawling and scraping techniques…”
Get full text

Piecing together the puzzle: Improving event content coverage for real-time sub-event detection using adaptive microblog crawling by Tokarchuk, Laurissa, Wang, Xinyue, Poslad, Stefan

“… Existing Twitter event monitoring systems for sub-event detection and summarization currently typically analyse events based on partial data as conventional data collection methodologies are unable…”
Get full text

Aplikasi Deteksi Motif dan Crawling Produk Batik Banyuwangi Berbasis Web by Hakim, Lutfi, Novitasari, Nurul Hidayati, Kristanto, Sepyan Purnama, Yusuf, Dianni

“… Therefore, in this study, an application was developed that can detect via web devices and also extract information related to Batik Banyuwangi products in the marketplace…”
Get full text

xCrawl: a high-recall crawling method for Web mining by Shchekotykhin, Kostyantyn, Jannach, Dietmar, Friedrich, Gerhard

“…Web mining systems exploit the redundancy of data published on the Web to automatically extract information from existing Web documents…”
Get full text

Towards extracting event-centric collections from Web archives by Gossen, Gerhard, Risse, Thomas, Demidova, Elena

“…Web archives constitute an increasingly important source of information for computer scientists, humanities researchers and journalists interested in studying past events…”
Get full text

A Textual Content Analysis Model for Aligning Job Market Demands and University Curricula through Data Mining Techniques by Januzaj, Ylber A., Sylqa, Driton, Luma, Artan, Gashi, Luan

“… Specifically, the integration of data mining techniques is employed for the automated extraction of relevant information from both labor market demands and university curricula…”
Get full text

SiSOB data extraction and codification: A tool to analyze scientific careers by Geuna, Aldo, Kataishi, Rodrigo, Toselli, Manuel, Guzmán, Eduardo, Lawson, Cornelia, Fernandez-Zubieta, Ana, Barros, Beatriz

“…•The software provides data crawling and data mining techniques used to transform webpage-based information and CV information into a relational database…”
Get full text

NLP-based techniques for Cyber Threat Intelligence by Arazzi, Marco, R. Arikkat, Dincy, Nicolazzo, Serena, Nocera, Antonino, Rehiman K.A., Rafidha, P., Vinod, Conti, Mauro

“…In the digital era, threat actors employ sophisticated techniques for which, often, digital traces in the form of textual data are available…”
Get full text

Predicting customer profitability during acquisition: Finding the optimal combination of data source and data mining technique by D’Haen, Jeroen, Van den Poel, Dirk, Thorleuchter, Dirk

“… ► Commercially-available data is augmented by web data. ► Combining both web data and commercial data leads to the best predictive results for lead qualification…”
Get full text