GeoWeb Crawler: An extensible and scalable web crawling framework for discovering geospatial web resources

NCUIR > Research Center > Center for Space and Remote Sensing Research > journal & Dissertation > Item 987654321/101679

Please use this identifier to cite or link to this item: https://ir.lib.ncu.edu.tw/handle/987654321/101679

Title:	GeoWeb Crawler: An extensible and scalable web crawling framework for discovering geospatial web resources
Authors:	黃智遠;Huang, Chih-Yuan;Chang, Hao
Contributors:	太空及遙測研究中心
Keywords:	computer software;Consortia;data collection;Data management;Extensibility;Geospatial Web;information management;Internet;Management;Open Geospatial Consortium;Performance indices;Research facilities;research institutions;resource discovery;Search engines;shapefile;Web crawler;Web services;World Wide Web
Date:	2016-08-01
Issue Date:	2026-04-21 14:40:41 (UTC+8)
Publisher:	MDPI AG;Basel: MDPI AG
Abstract:	摘要： With the advance of the World-Wide Web (WWW) technology, people can easily share content on the Web, including geospatial data and web services. Thus, the “big geospatial data management” issues start attracting attention. Among the big geospatial data issues, this research focuses on discovering distributed geospatial resources. As resources are scattered on the WWW, users cannot find resources of their interests efficiently. While the WWW has Web search engines addressing web resource discovery issues, we envision that the geospatial Web (i.e., GeoWeb) also requires GeoWeb search engines. To realize a GeoWeb search engine, one of the first steps is to proactively discover GeoWeb resources on the WWW. Hence, in this study, we propose the GeoWeb Crawler, an extensible Web crawling framework that can find various types of GeoWeb resources, such as Open Geospatial Consortium (OGC) web services, Keyhole Markup Language (KML) and Environmental Systems Research Institute, Inc (ESRI) Shapefiles. In addition, we apply the distributed computing concept to promote the performance of the GeoWeb Crawler. The result shows that for 10 targeted resources types, the GeoWeb Crawler discovered 7351 geospatial services and 194,003 datasets. As a result, the proposed GeoWeb Crawler framework is proven to be extensible and scalable to provide a comprehensive index of GeoWeb. 出版者： Basel: MDPI AG 出版日期： 2016-08-05 出處： ISPRS International Journal of Geo-Information, 2016-08, Vol.5 (8), p.136--136 資源來源： ProQuest 版權： Copyright MDPI AG 2016 識別號： ISSN: 2220-9964 識別號： EISSN: 2220-9964 識別號： DOI: 10.3390/ijgi5080136
Appears in Collections:	[Center for Space and Remote Sensing Research ] journal & Dissertation

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	40	View/Open

社群 sharing

Loading...