Evaluating fidelity of lossy compression on spatiotemporal data from an IoT enabled smart farm

•Major sensor data collected from IoT weather stations show spatiotemporal data patterns.•Transform-based lossy compressions can significantly reduce the volume of agricultural IoT data.•Agricultural IoT data exhibit a strong correlation between energy compaction and data fidelity.•Sensor sampling g...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Computers and electronics in agriculture Ročník 154; s. 304 - 313
Hlavní autoři: Moon, Aekyeung, Kim, Jaeyoung, Zhang, Jialing, Son, Seung Woo
Médium: Journal Article
Jazyk:angličtina
Vydáno: Amsterdam Elsevier B.V 01.11.2018
Elsevier BV
Témata:
Agricultural management
Algorithms
Analytics
Big Data
Classification
Compression ratio
Compression tests
Data analysis
Data compression
Data fidelity
Data management
data quality
energy
Farms
information management
Internet of Things
IoT
Lossy compression
prediction
Sampling
Signal processing
Smart farm
Smart sensors
Spatiotemporal data
weather
Weather stations
Lossy compression
Data fidelity
Signal processing
Smart farm
IoT
ISSN:0168-1699, 1872-7107
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:•Major sensor data collected from IoT weather stations show spatiotemporal data patterns.•Transform-based lossy compressions can significantly reduce the volume of agricultural IoT data.•Agricultural IoT data exhibit a strong correlation between energy compaction and data fidelity.•Sensor sampling granularities have a significant impact on the data fidelity. As the volume of data collected by various IoT sensors used in smart farm applications increases, the storing and processing of big data for agricultural applications become a huge challenge. The insight of this paper is that lossy compression can unleash the power of compression to IoT because, as compared with its counterpart (a lossless one), it can significantly reduce the data volume when the spatiotemporal characteristics of IoT sensor data are properly exploited. However, lossy compression faces the challenge of compressing too much data thus losing data fidelity, which might affect the quality of the data and potential analytics outcomes. To understand the impact of lossy compression on IoT data management and analytics, we evaluated four classification algorithms with reconstructed agricultural sensor data based on various energy concentration. Specifically, we applied three transformation-based lossy compression mechanisms to five real-world weather datasets collected at different sampling granularities from IoT weather stations. Our experimental results indicate that there is a strong positive correlation between the concentrated energy of the transformed coefficients and the compression ratio as well as the data quality. While we observed a general trend where much higher compression ratios can be achieved at the cost of a decrease in quality, we also observed that the impact on the classification accuracy varies among the data sets and algorithms we evaluated. Lastly, we show that the sampling granularity also influences the data fidelity in terms of the prediction performance and compression ratio.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
ISSN:0168-1699
1872-7107
DOI:10.1016/j.compag.2018.08.045