Extraction of Special Time Periods from Automated Monitoring Big Data Based on Statistical Analysis: Differential Analysis and Algorithm Research for Data Across Different Monitoring Periods

Guangzhou Institute of Geological Survey, Guangzhou, China

^* Corresponding author: songzi0829@126.com

Abstract

Automated monitoring systems significantly impact modern industries and daily life. Currently, most commercially available automated monitoring systems identify the maximum or minimum monitoring values by comparing data points at specific time instances, rather than comparing the average values of one time period against others. To identify time periods within automated monitoring big data that exhibit significant anomalies compared to others—or to detect such periods within each cycle—this study groups the collected big data by time periods or aggregates monitoring data from identical periods across multiple cycles into datasets. Differential analysis is then performed on these datasets (or data groups). The results demonstrate the feasibility of the research objective in algorithm design, which necessitates the application of mathematical tools such as variance analysis, least squares algorithms, iterative methods, and combinatorial theory.