Self-supervised short-term traffic flow prediction based on diffusion autoregressive Transformer
DOI:
https://doi.org/10.54097/fbn0d652Keywords:
Short-term Traffic Flow, Diffusion Autoregressive Transformer, Dynamic Sensory Field, Denoising, Saito-temporal Coupling.Abstract
With rapid urbanization and motorization, traffic congestion restricts urban sustainable development, yet existing short-term traffic flow prediction methods have flaws: Linear Regression fails to adapt to nonlinear features like peak tidal changes; SVM has soaring kernel cost in large-scale data and poor long-term dependency capture; LSTM lags in extreme loads and has high error fluctuation in special events. This study proposes the STD-ARformer, integrating diffusion denoising and autoregressive mechanism. It uses three core designs: dynamic receptive field (adjusts attention window for mutations), traffic flow conservation constraint (ensures physical compliance), and hierarchical denoising (enhances multi-scale robustness).Experiments show STD-ARformer outperforms Linear Regression, SVM, and LSTM in key indicators, alleviates extreme load lag, reduces special event error fluctuation, and lowers medium-flow discreteness. It provides a high-performance solution, supporting traffic management and urban sustainable development.
Downloads
References
[1] WANG L, ZHANG H. Spatio-Temporal Patterns of Urban Traffic Congestion in First-Tier Cities, 2015-2023[J]. Journal of Transportation Engineering, 2024, 41(2): 1-12.
[2] MÜLLER A, et al. Machine Learning-Based Traffic Emission Modeling: CO₂ Hotspots and Mitigation Potential in Berlin[J]. Frontiers in Environmental Science, 2024, 12: 1461656.
[3] WANG W, ZHANG H, LI T, et al. An Interpretable Model for Short-Term Traffic Flow Prediction[J]. Mathematics and Computers in Simulation, 2020, 171: 264-278. DOI: https://doi.org/10.1016/j.matcom.2019.12.013
[4] CUI J, YAO J, ZHAO B. A Review of Short-Term Traffic Flow Prediction Methods Based on Deep Learning[J]. Journal of Traffic and Transportation Engineering, 2024, 24(2): 50-64.
[5] CHANG A, JI Y, BIE Y. Transformer-Based Short-Term Traffic Forecasting Model Considering Traffic Spatiotemporal Correlation[C]//2025 International Conference on Intelligent Transportation Systems (ITSC). Seattle, WA, USA: IEEE, 2025: 1527-1534. DOI: https://doi.org/10.3389/fnbot.2025.1527908
[6] FU Q, BA B, HUANG C. Dynamic Spatiotemporal Graph Convolutional Network for Short-Term Traffic Flow Prediction[J]. Journal of Hunan University of Science and Technology (Natural Science Edition), 2024, 39(1): 70-79.
[7] BOLSHINSKY E. Traffic Flow Forecast Survey[R]. Technion-Israel Institute of Technology, 2012.
[8] SUN S, ZHANG C, ZHANG Y. Traffic Flow Forecasting Using a Spatio-Temporal Bayesian Network Predictor[C]//Proceedings of the International Conference on Artificial Neural Networks (ICANN 2005). Warsaw, Poland: Springer, 2005: 273-278. DOI: https://doi.org/10.1007/11550907_43
[9] ZHANG H, LI M, ZHOU J. Diffusion Drive: Truncated Diffusion Model for End-to-End Traffic Flow Prediction[C]//2025 IEEE International Conference on Robotics and Automation (ICRA). London, UK: IEEE, 2025: 7823-7829.
[10] LI J, ZHANG Y, WANG Q. STDEN: Towards Physics-Guided Neural Networks for Traffic Flow Prediction[J]. IEEE Transactions on Intelligent Transportation Systems, 2023, 24(5): 5210-5221.
[11] CHEN L, LIU X, YANG Z. Dynamic Receptive Field Attention for Traffic Anomaly Prediction[C]//2024 IEEE International Conference on Intelligent Transportation Systems (ITSC). Suzhou, China: IEEE, 2024: 3489-3495.
[12] WANG Y, ZHAO L, SUN D. Hierarchical Denoising for Multi-Scale Traffic Flow Forecasting[J]. IEEE Transactions on Knowledge and Data Engineering, 2024, 36(2): 789-802.
[13] BONET C, VAUTHIER T, KORBA A. Flowing Datasets with Wasserstein Over Wasserstein Gradient Flows[C]//Proceedings of the 42nd International Conference on Machine Learning (ICML 2025). Honolulu, HI, USA: PMLR, 2025: 2156-2165.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Highlights in Science, Engineering and Technology

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.







