摘要(英) |
The Internet of Things (IoT) is composed of various embedded devices that generate a large amount of sensor observation data. These observations are usually heterogeneous because they follow different data models or service agreements, which brings difficulties to data integration. To solve this problem, it is necessary to follow open standards specifically designed for IoT, such as the Open Geospatial Consortium (OGC) SensorThings API (STA). STA not only defines an IoT data model to capture the complexity of attributes and their relationships, but also provides a RESTful service interface to access IoT data. In order to manage the relationship between the properties of the Internet of Things, many STA implementations use relational database (RDB) solutions, such as FROST Server, GOST and Mozilla STA. However, RDB faces serious performance problems when managing large amounts of multi-dimensional data. Therefore, this research proposes a scalable and efficient data management solution for multi-dimensional IoT data query on STA services. Specifically, we use MongoDB as a data storage system, which is a distributed document-based database that supports table-join operators similar to RDB. In order to improve the performance of querying large amount of multi-dimensional IoT data, we apply the previously proposed Adaptive Multi-Attribute Indexing Framework (AMAIF) solution. In the experiment, we compare the proposed STA implementation with FROST Server. The experiment results show that in the multi-dimensional data query, the proposed system can effectively improve the speed of query response. And in terms of the data scalability, a large amount of data can be inserted quickly and can be easily divided and expanded in KVS stores. |
參考文獻 |
[1] Kazmi, A., Jan, Z., Zappa, A., & Serrano, M. (2016, November). Overcoming the heterogeneity in the internet of things for smart cities. In International workshop on interoperability and open-source solutions (pp. 20-35). Springer, Cham.
[2] Liang, S., Huang, C. Y., & Khalafbeigi, T. (2016). OGC SensorThings API Part 1: Sensing, Version 1.0.
[3] Huang, C.Y. and Chang, Y.J., 2021. An Adaptively Multi-Attribute Index Framework for Big IoT Data, Computers and Geosciences. 155, 104841.
[4] Eldawy, A., & Mokbel, M. F. (2015, April). Spatialhadoop: A mapreduce framework for spatial data. In 2015 IEEE 31st international conference on Data Engineering (pp. 1352-1363). IEEE.
[5] Chang, F., Dean, J., Ghemawat, S., Hsieh, W. C., Wallach, D. A., Burrows, M., ... & Gruber, R. E. (2008). Bigtable: A distributed storage system for structured data. ACM Transactions on Computer Systems (TOCS), 26(2), 1-26.
[6] Nishimura, S., Das, S., Agrawal, D., & El Abbadi, A. (2011, June). Md-hbase: A scalable multi-dimensional data infrastructure for location aware services. In 2011 IEEE 12th International Conference on Mobile Data Management (Vol. 1, pp. 7-16). IEEE.
[7] Watari, Y., Keyaki, A., Miyazaki, J., & Nakamura, M. (2018, September). Efficient Aggregation Query Processing for Large-Scale Multidimensional Data by Combining RDB and KVS. In International Conference on Database and Expert Systems Applications (pp. 134-149). Springer, Cham.
[8] Makris, A., Tserpes, K., Spiliopoulos, G., & Anagnostopoulos, D. (2019, March). Performance Evaluation of MongoDB and PostgreSQL for Spatio-temporal Data. In EDBT/ICDT Workshops.
[9] Jung, M. G., Youn, S. A., Bae, J., & Choi, Y. L. (2015, November). A study on data input and output performance comparison of mongodb and postgresql in the big data environment. In 2015 8th International Conference on Database Theory and Application (DTA) (pp. 14-17). IEEE.
[10] Naheman, W., & Wei, J. (2013, December). Review of NoSQL databases and performance testing on HBase. In Proceedings 2013 International Conference on Mechatronic Sciences, Electric Engineering and Computer (MEC) (pp. 2304-2309). IEEE.
[11] Sahatqija, K., Ajdari, J., Zenuni, X., Raufi, B., & Ismaili, F. (2018, May). Comparison between relational and NOSQL databases. In 2018 41st international convention on information and communication technology, electronics and microelectronics (MIPRO) (pp. 0216-0221). IEEE.
[12] Parker, Z., Poe, S., & Vrbsky, S. V. (2013, April). Comparing nosql mongodb to an sql db. In Proceedings of the 51st ACM Southeast Conference (pp. 1-6). |