AIPrimer.AI
  • 🚦AI Primer In Transportation
  • CHAPTER 1 - INTRODUCTION TO MACHINE LEARNING
    • Machine Learning in Transportation
    • What is Machine Learning?
    • Types of Machine Learning
      • Supervised Learning
      • Unsupervised Learning
      • Semi-supervised Learning
      • Reinforced Learning
    • Fundamental concepts of machine learning
      • Model Training and Testing
      • Evaluating the Model’s Prediction Accuracy
      • The Underfitting and Overfitting Problems
      • Bias-Variance Tradeoff in Overfitting
      • Model Validation Techniques
      • Hyperparameter Tuning
      • Model Regularization
      • The Curse of Ddimensionality
    • Machine Learning versus Statistics
  • CHAPTER 2 - SUPERVISED METHODS
    • Supervised Learning_Complete Draft
    • K-Nearest Neighbor (KNN) Algorithm
    • Tree-Based Methods
    • Boosting
    • Support Vector Machines (SVMs)
  • CHAPTER 3 - UNSUPERVISED LEARNING
    • Principal Component Analysis
      • How Does It Work?
      • Interpretation of PCA result
      • Applications in Transportation
    • CLUSTERING
      • K-MEANS
      • SPECTRAL CLUSTERING
      • Hierarchical Clustering
    • REFERENCE
  • CHAPTER 4 - NEURAL NETWORK
    • The Basic Paradigm: Multilayer Perceptron
    • Regression and Classification Problems with Neural Networks
    • Advanced Topologies
      • Modular Network
      • Coactive Neuro–Fuzzy Inference System
      • Recurrent Neural Networks
      • Jordan-Elman Network
      • Time-Lagged Feed-Forward Network
      • Deep Neural Networks
  • CHAPTER 5 - DEEP LEARNING
    • Convolutional Neural Networks
      • Introduction
      • Convolution Operation
      • Typical Layer Structure
      • Parameters and Hyperparameters
      • Summary of Key Features
      • Training of CNN
      • Transfer Learning
    • Recurrent Neural Networks
      • Introduction
      • Long Short-Term Memory Neural Network
      • Application in transportation
    • Recent Development
      • AlexNet, ZFNet, VggNet, and GoogLeNet
      • ResNet
      • U-Net: Full Convolutional Network
      • R-CNN, Fast R-CNN, and Faster R-CNN
      • Mask R-CNN
      • SSD and YOLO
      • RetinaNet
      • MobileNets
      • Deformable Convolution Networks
      • CenterNet
      • Exemplar Applications in Transportation
    • Reference
  • CHAPTER 6 - REINFORCEMENT LEARNING
    • Introduction
    • Reinforcement Learning Algorithms
    • Model-free v.s. Model-based Reinforcement Learning
    • Applications of Reinforcement Learning to Transportation and Traffic Engineering
    • REFERENCE
  • CHAPTER 7 - IMPLEMENTING ML AND COMPUTATIONAL REQUIREMENTS
    • Data Pipeline for Machine Learning
      • Introduction
      • Problem Definition
      • Data Ingestion
      • Data Preparation
      • Data Segregation
      • Model Training
      • Model Deployment
      • Performance Monitoring
    • Implementation Tools: The Machine Learning Ecosystem
      • Machine Learning Framework
      • Data Ingestion tools
      • Databases
      • Programming Languages
      • Visualization Tools
    • Cloud Computing
      • Types and Services
    • High-Performance Computing
      • Deployment on-premise vs on-cloud
      • Case Study: Data-driven approach for the implementation of Variable Speed Limit
      • Conclusion
  • CHAPTER 8 - RESOURCES
    • Mathematics and Statistics
    • Programming, languages, and software
    • Machine learning environments
    • Tools of the Trade
    • Online Learning Sites
    • Key Math Concepts
  • REFERENCES
  • IMPROVEMENT BACKLOG
Powered by GitBook
On this page
  1. CHAPTER 6 - REINFORCEMENT LEARNING

REFERENCE

Arel, I, C Liu, T Urbanik, and A G Kohls. 2010. “Reinforcement Learning-Based Multi-Agent System for Network Traffic Signal Control.” Intelligent Transport Systems, IET 4 (2): 128–35.

Aslani, Mohammad, Mohammad Saadi Mesgari, and Marco Wiering. 2017. “Adaptive Traffic Signal Control with Actor-Critic Methods in a Real-World Traffic Network with Different Traffic Disruption Events.” Transportation Research Part C: Emerging Technologies 85 (November): 732–52. https://doi.org/10.1016/j.trc.2017.09.020.

Aziz, H.M.A., F. Zhu, and S.V. Ukkusuri. 2017. “Learning-Based Traffic Signal Control Algorithms with Neighborhood Information Sharing: An Application for Sustainable Mobility.” Journal of Intelligent Transportation Systems: Technology, Planning, and Operations. https://doi.org/10.1080/15472450.2017.1387546.

Balaji, P G, X German, and D Srinivasan. 2010. “Urban Traffic Signal Control Using Reinforcement Learning Agents.” Intelligent Transport Systems, IET 4 (3): 177–88.

Bazzan, Ana L.C. 2009. “Opportunities for Multiagent Systems and Multiagent Reinforcement Learning in Traffic Control.” Autonomous Agents and Multi-Agent Systems 18 (3): 342–75. https://doi.org/10.1007/s10458-008-9062-9.

Bazzan, Ana L.C., and Ricardo Grunitzki. 2016. “A Multiagent Reinforcement Learning Approach to En-Route Trip Building.” Proceedings of the International Joint Conference on Neural Networks 2016-Octob: 5288–95. https://doi.org/10.1109/IJCNN.2016.7727899.

Bazzan, Ana L.C., Denise de Oliveira, and Bruno C. da Silva. 2010. “Learning in Groups of Traffic Signals.” Engineering Applications of Artificial Intelligence 23 (4): 560–68. http://dx.doi.org/10.1016/j.engappai.2009.11.009.

Bazzan, Ana L C. 2005. “A Distributed Approach for Coordination of Traffic Signal Agents.” Autonomous Agents and Multi-Agent Systems 10 (2): 131–64.

———. 2017. “Synergies Between Evolutionary Computation and Multiagent Reinforcement Learning : The Benefits of Exchanging Solutions.” Proceedings of the Genetic and Evolutionary Computation Conference Companion. ACM, 201–2.

Cai, Chen, Chi Kwong Wong, and Benjamin G. Heydecker. 2009. “Adaptive Traffic Signal Control Using Approximate Dynamic Programming.” Transportation Research Part C: Emerging Technologies 17 (5): 456–74. https://doi.org/10.1016/j.trc.2009.04.005.

Desjardins, C, and B Chaib-draa. 2011. “Cooperative Adaptive Cruise Control: A Reinforcement Learning Approach.” Intelligent Transportation Systems, IEEE Transactions On 12 (4): 1248–60.

Dusparic, Ivana, and Vinny Cahill. 2010. “Multi-Policy Optimization in Self-Organizing Systems.” Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 6090 LNCS: 101–26. https://doi.org/10.1007/978-3-642-14412-7_6.

El-Tantawy, Samah, Baher Abdulhai, and Hossam Abdelgawad. 2013. “Multiagent Reinforcement Learning for Integrated Network of Adaptive Traffic Signal Controllers (MARLIN-ATSC): Methodology and Large-Scale Application on Downtown Toronto.” IEEE Transactions on Intelligent Transportation Systems 14 (3): 1140–50.

Gao, Juntao, Yulong Shen, Jia Liu, Minoru Ito, and Norio Shiratori. 2017. “Adaptive Traffic Signal Control: Deep Reinforcement Learning Algorithm with Experience Replay and Target Network,” 1–10. http://arxiv.org/abs/1705.02755.

Grunitzki, Ricardo, Gabriel De O Ramos, and Ana L C Bazzan. 2014. “Individual Versus Difference Rewards on Reinforcement Learning for Route Choice.” Proceedings of the 2014 Brazilian Conference on Intelligent Systems (BRACIS 14).

Hensher, D, and W Greene. 2001. “The Mixed Logit Model: The State of Practice and Warnings for the Unwary,” 39. https://doi.org/10.1.1.195.1039.

Houli, Duan, Li Zhiheng, and Zhang Yi. 2010. “Multiobjective Reinforcement Learning for Traffic Signal Control Using Vehicular Ad Hoc Network.” EURASIP Journal on Advances in Signal Processing 2010 (1): 724035. http://dl.acm.org/citation.cfm?id=1928488.1957878.

Islam, S M A Bin Al, H M A Aziz, H Wang, and S E Young. 2018. “Minimizing Energy Consumption from Connected Signalized Intersections by Reinforcement Learning.” In 2018 21st International Conference on Intelligent Transportation Systems (ITSC), 1870–75. https://doi.org/10.1109/ITSC.2018.8569891.

Khamis, Mohamed A., and Walid Gomaa. 2014. “Adaptive Multi-Objective Reinforcement Learning with Hybrid Exploration for Traffic Signal Control Based on Cooperative Multi-Agent Framework.” Engineering Applications of Artificial Intelligence 29: 134–51. https://doi.org/10.1016/j.engappai.2014.01.007.

Kok, Jelle R, and Nikos Vlassis. 2006. “Collaborative Multiagent Reinforcement Learning by Payoff Propagation.” The Journal of Machine Learning Research 7 (December): 1789–1828.

Kuyer, Lior, Shimon Whiteson, Bram Bakker, and Nikos Vlassis. 2008. “Multiagent Reinforcement Learning for Urban Traffic Control Using Coordination Graphs.” Proceedings of the 2008 European Conference on Machine Learning and Knowledge Discovery in Databases - Part I. Antwerp, Belgium: Springer-Verlag. https://doi.org/10.1007/978-3-540-87479-9_61.

Le, Tuyen P., Ngo Anh Vien, and Taechoong Chung. 2018. “A Deep Hierarchical Reinforcement Learning Algorithm in Partially Observable Markov Decision Processes.” IEEE Access 6: 49089–102. https://doi.org/10.1109/ACCESS.2018.2854283.

Liang, Xiaoyuan, Xunsheng Du, Guiling Wang, and Zhu Han. 2019. “A Deep Reinforcement Learning Network for Traffic Light Cycle Control.” IEEE Transactions on Vehicular Technology 68 (2): 1243–53. https://doi.org/10.1109/TVT.2018.2890726.

Liu, Teng, Xiaosong Hu, Shengbo Eben Li, and Dongpu Cao. 2017. “Reinforcement Learning Optimized Look-Ahead Energy Management of a Parallel Hybrid Electric Vehicle.” IEEE/ASME Transactions on Mechatronics 22 (4): 1497–1507. https://doi.org/10.1109/TMECH.2017.2707338.

Mannion, Patrick, Jim Duggan, and Enda Howley. 2016. “An Experimental Review of Reinforcement Learning Algorithms for Adaptive Traffic Signal Control.” Autonomic Road Transport Support Systems, 47–66. https://doi.org/10.1007/978-3-319-25808-9_4.

Medina, J C, and R F Benekohal. 2012a. “Traffic Signal Control Using Reinforcement Learning and the Max-plus Algorithm as a Coordinating Strategy.” Intelligent Transportation Systems (ITSC), 2012 15th International IEEE Conference On, 596–601.

———. 2012b. “Traffic Signal Control Using Reinforcement Learning and the Max-plus Algorithm as a Coordinating Strategy.” Intelligent Transportation Systems (ITSC), 2012 15th International IEEE Conference On, 596–601. https://doi.org/10.1109/ITSC.2012.6338911.

Moffaert, Kristof Van, Ann Nowé, Peter Auer, Marcus Hutter, and Laurent Orseau. 2014. “Multi-Objective Reinforcement Learning Using Sets of Pareto Dominating Policies.” Journal of Machine Learning Research 15: 3483–3512.

Mousa, Saleh R, Ragab Mousa, and Sherif Ishak. 2018. “A Deep-Reinforcement Learning Algorithm for Eco-Driving Control at Signalized Intersections with Prioritized Experience Replay, Target Network, and Double Learning.”

Ngai, D C K, and N H C Yung. 2011. “A Multiple-Goal Reinforcement Learning Method for Complex Vehicle Overtaking Maneuvers.” Intelligent Transportation Systems, IEEE Transactions On 12 (2): 509–22.

Prashanth, L A, and S Bhatnagar. 2011. “Reinforcement Learning With Function Approximation for Traffic Signal Control.” Intelligent Transportation Systems, IEEE Transactions On 12 (2): 412–21.

Qi, Xuewei, Yadan Luo, Guoyuan Wu, Kanok Boriboonsomsin, and Matthew Barth. 2019. “Deep Reinforcement Learning Enabled Self-Learning Control for Energy Efficient Driving.” Transportation Research Part C: Emerging Technologies 99 (January): 67–81. https://doi.org/10.1016/j.trc.2018.12.018.

Qi, Xuewei, Guoyuan Wu, Kanok Boriboonsomsin, Matthew J. Barth, and Jeffrey Gonder. 2016. “Data-Driven Reinforcement Learning-Based Real-Time Energy Management System for Plug-in Hybrid Electric Vehicles.” Transportation Research Record 2572: 1–8. https://doi.org/10.3141/2572-01.

Sunehag, Peter, Guy Lever, Audrunas Gruslys, Wojciech Marian Czarnecki, Vinicius Zambaldi, Max Jaderberg, Marc Lanctot, et al. 2017. “Value-Decomposition Networks For Cooperative Multi-Agent Learning.” In Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS, 2085–87. http://arxiv.org/abs/1706.05296.

Tan, Tian, Feng Bao, Yue Deng, Alex Jin, Qionghai Dai, and Jie Wang. 2019. “Cooperative Deep Reinforcement Learning for Large-Scale Traffic Grid Signal Control.” IEEE Transactions on Cybernetics PP: 1–14. https://doi.org/10.1109/tcyb.2019.2904742.

Wen, Jian, Jinhua Zhao, and Patrick Jaillet. 2018. “Rebalancing Shared Mobility-on-Demand Systems: A Reinforcement Learning Approach.” IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC 2018-March: 220–25. https://doi.org/10.1109/ITSC.2017.8317908.

Wiering, M A. 2000. “Multi-Agent Reinforcement Learning for Traffic Light Control.” In Machine Learning: Proceedings of the Seventeenth International Conference (ICML’2000), 1151–58.

Yu, C.-H., and R Nagpal. 2011. “A Self-Adaptive Framework for Modular Robots in a Dynamic Environment: Theory and Applications.” The International Journal of Robotics Research 30: 1015–36. https://doi.org/10.1177/0278364910384753.

Zhao, Yun, Qingwei Chen, and Weili Hu. 2010. “Multi-Objective Reinforcement Learning Algorithm for MOSDMP in Unknown Environment.” Proceedings of the World Congress on Intelligent Control and Automation (WCICA), 3190–94. https://doi.org/10.1109/WCICA.2010.5553980.

Zhu, Feng, H M Abdul Aziz, Xinwu Qian, and Satish V Ukkusuri. 2015. “A Junction-Tree Based Learning Algorithm to Optimize Network Wide Traffic Control : A Coordinated Multi-Agent Framework.” Transportation Research Part C: Emerging Technologies http://dx.: 1–15. https://doi.org/10.1016/j.trc.2014.12.009.

Zhu, Feng, and Satish V. Ukkusuri. 2014. “Accounting for Dynamic Speed Limit Control in a Stochastic Traffic Environment: A Reinforcement Learning Approach.” Transportation Research Part C: Emerging Technologies 41: 30–47. https://doi.org/10.1016/j.trc.2014.01.014.

PreviousApplications of Reinforcement Learning to Transportation and Traffic EngineeringNextCHAPTER 7 - IMPLEMENTING ML AND COMPUTATIONAL REQUIREMENTS

Last updated 1 year ago