Towards Intelligent Backend Operations via Unified Temporal Representation and Prediction Modeling
Main Article Content
Abstract
This study proposes a unified modeling approach for long- and short-term temporal dependencies to address the challenges of complex metric structures, dynamic distribution changes, and intertwined multidimensional dependencies in backend systems, aiming to achieve high-accuracy and high-robustness system state prediction. The method first performs structured preprocessing and normalization on multi-source monitoring data, extracts multidimensional temporal features through a feature encoding module, and constructs a dual-channel architecture for short-term dynamic modeling and long-term context capture to fully characterize temporal properties of local fluctuations and global trends. On this basis, a multi-scale fusion mechanism is introduced to enable adaptive interaction and integration of features across different temporal granularities, enhancing the model's ability to represent non-stationary signals, sudden load changes, and cross-dimensional dependencies. In addition, residual calibration and dynamic aggregation strategies are designed to mitigate feature shifts in high-noise environments, ensuring stable prediction performance and strong generalization under complex operating conditions. Validation across various dynamic scenarios shows that the proposed method outperforms existing baseline models on key metrics such as MSE, MAE, MAPE, and RMSE, while exhibiting strong adaptability to data disturbances, environmental changes, and sampling granularity variations. The results demonstrate that the proposed approach effectively captures multi-level dependencies in complex time series, providing strong technical support for state modeling, performance prediction, and anomaly detection in backend systems, and laying a methodological foundation for building high-precision intelligent operations and maintenance systems.
Article Details
Issue
Section
References
[1]Liu M, Zeng A, Chen M, et al. Scinet: Time series modeling and forecasting with sample convolution and interaction[J]. Advances in Neural Information Processing Systems, 2022, 35: 5816-5828.
[2]Alkilane K, He Y, Lee D H. MixMamba: Time series modeling with adaptive expertise[J]. Information Fusion, 2024, 112: 102589.
[3]Zhang W, Yin C, Liu H, et al. Irregular multivariate time series forecasting: A transformable patching graph neural networks approach[C]//Forty-first International Conference on Machine Learning. 2024.
[4]I. Kaufman and O. Azencot, "Analyzing deep transformer models for time series forecasting via manifold learning,"arXiv preprint arXiv:2410.13792, 2024.
[5]Y. Wang, H. Wu, J. Dong, G. Qin, H. Zhang, Y. Liu, et al., "Timexer: Empowering transformers for time series forecasting with exogenous variables,"Advances in Neural Information Processing Systems, vol. 37, pp. 469-498, 2024.
[6]X. Yang, "Trend-Fluctuation Decomposition with Deep Residual Networks for System Forecasting," 2024.
[7]Z. Qiu, "A Multi-Scale Deep Learning and Uncertainty Estimation Framework for Comprehensive Anomaly Detection in Cloud Environments," 2023.
[8]A. Zeng, M. Chen, L. Zhang, and Q. Xu, "Are transformers effective for time series forecasting?,"in Proc. AAAI Conf. Artificial Intelligence, vol. 37, no. 9, pp. 11121-11128, Jun. 2023.
[9]F. Chen, "AI-Augmented Anomaly Detection via Generative Distribution Modeling and Uncertainty Quantification in Cloud Systems," 2024.
[10]X. Sun, Y. Yao, X. Wang, P. Li and X. Li, "AI-driven health monitoring of distributed computing architecture: Insights from XGBoost and SHAP," 2024 4th International Conference on Communication Technology and Information Technology (ICCTIT), pp. 480-484, Dec. 2024.
[11]Y. Wang, "Semantic-Driven Large Model Scheduling for Distributed Systems via Unified Representation and Policy Generation," 2024.
[12]R. Ilbert, A. Odonnat, V. Feofanov, A. Virmaux, G. Paolo, T. Palpanas, and I. Redko, "Samformer: Unlocking the potential of transformers in time series forecasting with sharpness-aware minimization and channel-wise attention,"arXiv preprint arXiv:2402.10198, 2024.
[13]Zhang Y, Yan J. Crossformer: Transformer utilizing cross-dimension dependency for multivariate time series forecasting[C]//The eleventh international conference on learning representations. 2023.
[14]Han L, Chen X Y, Ye H J, et al. Softs: Efficient multivariate time series forecasting with series-core fusion[J]. Advances in Neural Information Processing Systems, 2024, 37: 64145-64175.
[15]R. Cristian, P. Harsha, C. Ocejo, G. Perakis, B. Quanz, I. Spantidakis, and H. Zerhouni, "Inter-series transformer: Attending to products in time series forecasting,"arXiv preprint arXiv:2408.03872, 2024.
[16]Ma A, Luo D, Sha M. MMFNet: Multi-Scale Frequency Masking Neural Network for Multivariate Time Series Forecasting[J]. arXiv preprint arXiv:2410.02070, 2024. .