👋 Greetings! I am Zhuoren Li. I’m a Ph.D. student at Tongji University, affiliated with the Institute of Intelligent Vehicles(TJU-IIV). I’m directly pursuing my Ph.D. degree under the supervision of Prof. Lu Xiong after obtaining my bachelor’s degree in Engineering Mechanics from Tongji University. I am also privileged to be co-advised by Prof. Jia Hu, Prof. Nan Li and Assoc. Prof. Bo Leng.

🚀 Since 2021, I have been serving as the Student Director of the Intelligent Decision Research Group at TJU-IIV. I lead the team in research on safe reinforcement learning, interactive decision-making, optimization-based motion planning and trajectory planning on unstructured roads. Additionally, I have participated in 4 engineering projects, 7 government projects, and I have also written more than 8 funding/grant proposals as a key participant.

📈 My current research interest includes Safe Reinforcement Learning for Motion Planning of Autonomous Vehicles, Interactive Decision-Making, and Smooth Motion Planning, etc.

I plan to complete my Ph.D. in Dec. 2025, and I’m looking for a post-doctoral position.

🔥 News

📝 Research Experiences

Risk-Aware Safe RL for Autonomous Driving

Enhancing the safety performance of RL-based motion planning by prior-knowledge designed safety constraints. (From Sept 2022 to now)

LLM enhanced RL for Autonomous Driving

Enhancing scenario understanding ablility for RL agent using LLM while suppressing the hallucinatory problems. (From Dec. 2024 to now)

Control Granularity Research of RL-based Motion Planning

using skill primitive and parameterized action with sufficient control granularity for flexible and smooth driving. (From Dec 2023 to now)

Optimization-based Motion Planning

Smooth, stable and fast motion planning based on optimization-based approaches. (From Sept 2021 to Jun 2023)

Parking Path Planning

Simple and effective parking path planning based on geometric curve and MPC optimization. (From Feb 2021 to Aug 2021)

📖 Publications

Journal & Conference Publications:

• Ran Yu, Zhuoren Li*, Lu Xiong, et al. “Uncertainty-Aware Safety-Critical Decision and Control for Autonomous Vehicles at Unsignalized Intersections,” IEEE Intell. Transp. Syst. Conf. (ITSC), 2025. PDF arXiv.

• Ruolin Yang, Zhuoren Li, Bo Leng, Lu Xiong and Xin Xia, “Convergent Harmonious Decision: Lane Changing in a more Traffic Friendly Way,” IEEE Trans. Intell. Transp. Syst., early access. PDF, DOI

• Bo Leng, Lu Xiong, Zhuoren Li*, et.al. “Multi-mode Evasion Assistance Control Method for Intelligent Distributed-drive Electric Vehicle Considering Human Driver’s Reaction,” Chin. J. Mech. Eng. 2025, 38: 102. PDF, DOI.

• Lu Xiong, Zhuoren Li, Danyang Zhong, et al. “Rule-Guidance Reinforcement Learning for Lane Change Decision-making: A Risk Assessment Approach,” Chin. J. Mech. Eng. 2025, 38:30. PDF, DOI.

• Zhuoren Li, Jia Hu, Bo Leng, Lu Xiong and Zhiqiang Fu, “An Integrated of Decision Making and Motion Planning Framework for Enhanced Oscillation-Free Capability,” IEEE Trans. Intell. Transp. Syst., vol. 25, no. 6, pp. 5718-5732, June 2024. PDF, DOI.

• Zhuoren Li, Guizhe Jin, Ran Yu, Bo Leng and Lu Xiong, “Interaction-Aware Deep Reinforcement Learning Approach Based on Hybrid Parameterized Action Space for Autonomous Driving,” SAE Intell. Connected Veh. Symposium (SAE ICVS), 2024. PDF, DOI.

• Guizhe Jin, Zhuoren Li, Bo Leng, Wie Han and Lu Xiong, “Stability Enhanced Hierarchical Reinforcement Learning for Autonomous Driving with Parameterized Trajectory Action,” IEEE Intell. Transp. Syst. Conf. (ITSC), 2024, pp. 3020-3026. PDF, DOI.

• Zhuoren Li, Lu Xiong, Bo Leng et al., “Safe Reinforcement Learning of Lane Change Decision Making with Risk-Fused Constraint,” in Proc. IEEE Intell. Transp. Syst. Conf. (ITSC), 2023, pp. 1313-1319. PDF, DOI.

• Lu Xiong, Yizhuo Guan, Bo Leng, Zhuoren Li, A Probabilistic Method for Behavior Prediction of Intelligent and Connected Vehicles in Freeway, Autom. Mach. Learn., vol. 4, no. 3, 2023. PDF, DOI.

• Zhuoren Li, Lu Xiong Bo Leng, “A Unified Trajectory Planning and Tracking Control Framework for Autonomous Overtaking Based on Hierarchical MPC,” in Proc. IEEE Intell. Transp. Syst. Conf. (ITSC), 2022, pp. 937-944. PDF, DOI.

• Zhuoren Li, Bo Leng, Chagen Luo, et al., “A Real-time Path Planner based on Improved Tentacle algorithm for Autonomous Vehicles,” in Proc. IEEE Int. Conf. Big Data, Artificial Intelligence and Internet of Things Engineering (ICBAIE), 2022, pp. 629-634. PDF, DOI.

• Zhuoren Li, Lu Xiong, Bo Leng, et al., “Path Planning Method for Perpendicular Parking Based on Vehicle Kinematics Model Using MPC Optimization,” SAE Technical Papers, 2022-01-0085, 2022. PDF, DOI.

• Zhuoren Li, Lu Xiong, Dequan Zeng, et al., “Real-time Local Path Planning for Intelligent Vehicle combining Tentacle Algorithm and B-spline Curve,” IFAC-PapersOnLine, 2021, 54(10): 51-58. PDF, DOI.

• Dequan Zeng, Zhuoping Yu, Lu Xiong, Zhigiang Fu, Zhuoren Li, et al.,”HFO-LADRC lateral motion controller for autonomous road sweeper,” Sensors, 20(8), 2274. PDF, DOI.

More publications can be found on my Google Scholar profile.

Submitted & Work in Progress:

• Zhiwen Chen, Bo Leng, Zhuoren Li, et al., “HCRMP: A LLM-Hinted Contextual Reinforcement Learning Framework for Autonomous Driving”. arXiv

• Zhuoren Li, Guizhe Jin, Ran Yu, Zhiwen Chen, Wei Han, Nan Li, Lu Xiong, Bo Leng, Jia Hu, Ilya Kolmanovsky and Dimitar Filev, “A Survey of Reinforcement Learning-based Motion planning for Autonomous Driving: Lessons Learned from a Driving Task Perspective.” IEEE Trans. Neural Netw. Learn. Sys. (under review). PDF, arXiv.

• Guizhe Jin, Zhuoren Li, Bo Leng, Wei Han, Lu Xiong and Chen Sun, “Hybrid Action Based Reinforcement Learning for Multi-Objective Compatible Autonomous Driving,” IEEE Trans. Neural Netw. Learn. Sys. (under review, R2). PDF, arXiv.

• Bo Leng, Ran Yu, Zhuoren Li*, Wei Han, Bo Leng, Lu Xiong and Hailong Huang, “Risk-Aware Reinforcement Learning for Autonomous Driving: Improving Safety When Driving through Intersection,” Eng. Appl. Artif. Intel (under review, R2) PDF, arXiv.

• Zhuoren Li, Jia Hu, Bo Leng, Lu Xiong, et.al., “Safety Enhanced Reinforcement Learning for Autonomous Driving: Dare to Make Mistakes to Learn Faster and Better,” IEEE Trans. Intell. Transp. Syst. (under review)

• Bo Leng, Ran Yu, Zhuoren Li*, et.al, “Seamless Overtaking Maneuvers for Automated Driving: Integrated Motion Planning Based on Hybrid Model Predictive Control,” IEEE Trans. Ind. Electron. (under review)

• Guizhe Jin, Zhuoren Li, Bo Leng, et al., “Multi-Timescale Hierarchical Reinforcement Learning for Unified Behavior and Control of Autonomous Driving,” IEEE Robot. Autom. Lett. (under review) arXiv

🚗 Project Experiences

🎙 Interactive Learning-based Decision Control for Intelligent Vehicles with Roadside Information Enhancement

Chongqing Changan Automobile Co., Ltd., Apr. 2025 – Present, - Role: Student Technical Director

Responsibilities include:

• Comprehensive task management.
• Designed an Interaction-aware RL motion planning algorithm combining with game theory guidance

🎙 High-Mobility Motion Planning and Control Research for Chassis-by-wire All-terrain Unmanned Vehicle with Hybrid-steering

National Natural Science Foundation of China, Jan. 2024 – Present, - Role: Student Technical Director

Responsibilities include:

• Comprehensive task management.
• Designed an environmental risk characterization algorithm considering negative obstacles.
• Led the Development of a motion planning approach combining hybrid A* and optimization-based methods

🎙 Key Technology of Perception and Control in Cooperative Vehicle-Infrastructure System for Urban Public Transportation

National Key Research and Development Program of China, Jan. 2023 – Mar 2025, - Role: Core Participant

Responsibilities include:

• Developed the decision-making and motion planning algorithms for cruise driving and lane change functions in vehicle side, based on the recommended speed from the road side.

🎙 Development of Evasion Assistance Algorithm for Emergency Collision Avoidance based on Steer-by-Wire System

Shanghai Automotive Industry Science and Technology Development Foundation, Jul. 2022 – Jul. 2024, - Role: Student Technical Director

Responsibilities include:

• Comprehensive task management.
• Led the development of a motion control algorithm for emergency collision avoidance.
• Led the simulation validation in Carmaker/Simulink, steer-by-wire system modification on the real vehicle and ground test based on Audesse ECU.

🎙 Binary Mixed Traffic Behavior Characteristics and Collaborative Paradigm

Science and Technology Commission of Shanghai, Aug. 2021 – Jul. 2024, - Role: Core Participant

Responsibilities include:

• Motion planning and control of connected automated vehicle according to the road-side guidance.

🎙 Research on Vehicle-Road Cooperative Control for Intelligent Public Transportation System

Shanghai Research Institute for Intelligent Autonomous Systems, Sept. 2021 – Aug. 2022, - Role: Student Technical Director

Responsibilities include:

• Comprehensive task management.
• Led the development of a signal control algorithm and a vehicle speed optimization algorithm.

🎙 Autonomous Valet Parking (AVP) System Development

Nanchang Automotive Institute of Intelligence & New Energy, Sep. 2021 – Mar. 2023, - Role: Student Technical Director

Responsibilities include:

• Comprehensive task management.
• Led the development of a parking slot allocation algorithm.
• Developed parking path planning and tracking control algorithms.

🎙 Development and Application of Automatic Valet Parking System

Nanchang Automotive Institute of Intelligence & New Energy, Feb. 2020 – Mar. 2021, - Role: Student Technical Director

Responsibilities include:

• Comprehensive task management.
• Developed an integrated module for hardware and software communication.
• Developed a parking path planning algorithm based on geometric configuration.
• Developed a Stanley-based path tracking algorithm and a feedforward PID-based speed tracking algorithm.

🎙 China Future Challenge of Intelligent Vehicles

Institute of Intelligent Vehicles, Tongji University, Mar. 2020 – Nov. 2020, - Role: Major developer

Responsibilities include:

• Developed a system integration framework inspired by the Baidu Apollo.
• Developed a search-based path planning algorithm for static obstacle avoidance.
• Developed a parking path planning algorithm based on hybrid A*.

🎙 Funding/Grant Proposal Writing

Jan. 2020 – Mar. 2025

• National Natural Science Foundation of China (NSFC), Excellent Young Scholars Fund, 2025; Key Program, 2024; General Program, 2023; Distinguished Young Scholars Fund, 2022; Young Scholars Grant, 2020.
• Shanghai Municipal People’s Government (SMPG), Oriental Excellence Program Youth Project, 2024; Shanghai Science and Technology Progress First Award, 2022;
• Ministry of Science and Technology, PRC, National Key Research and Development Program of China, 2021;
• National Development and Reform Commission, The Breakthrough and Industrialization of Key Technologies for Intelligent Chassis, 2020;

🎖 Honors and Awards

• SAE International Outstanding Technical Paper Award, SAE ICVS 2024. (TOP5)

• High-Level Academic Poster Award, China SAE Doctoral Student Academic Forum, 2024. (TOP10%)

• Outstanding Doctoral Student Scholarship, Tongji University, 2024. (TOP5%)

• Vehicle-road-cloud Integrated Autonomous Driving Challenge, Third Prize, 2024.

• Outstanding Individual Award, Institute of Intelligent Vehicles, Tongji University, 2022, 2023, 2024. (TOP5%)

• World Artificial Intelligence Conference AI Driving Simulation Competition, Third Prize in the University Challenge Competition, 2022.

📚 Academic Services

Reviewer

• Journal Reviewer: IEEE Transactions on Intelligent Transportation Systems (TITS), IEEE Transactions on Vehicular Technology (TVT), IEEE Transactions on Intelligent Vehicles (TIV), IEEE Transactions on Transportation Electrification (TTE), IEEE Robotics and Automation Letters (RAL), Journal of Intelligent Transportation Systems (JITS), IET Intelligent Transport Systems, Journal of Field Robotics.

• Conference Reviewer: IV, ITSC, CVCI

Mentoring

I have been serving as the Student Director of the Intelligent Decision Research Group at TJU-IIV. I lead the team in studies on safe reinforcement learning, interactive behavior decision-making, and unstructured trajectory planning. To date, I have mentored 4 Ph.D. students, 13 master’s students, and several undergraduate students.

Ph.D. Students:

• 2025-present: Weiqi Zhang, focusing on E2E RL racing.

• 2023-present: Zhiwen Chen, focusing on LLM-enhanced RL for AD.

• 2022-present: Peiyuan Fang, focusing on Motion Planning under Off-road Environment; Xinrui Zhang, focusing on Cloud-Vehicle Cooperative Planning.

Master Students:

• 2024-present: Ran Yu, Trajectory Prediction and Safe-RL; Zhizhao Ni, LfD-based RL for Merging in Congested Traffic.

• 2023-present: Guizhe Jin, Multi-objective Compatible RL; Zhou Sun, Motion Planning under Off-road Environment.

• 2022-present: Yuqin Qi, Learning-based MPC for Adaptive Motion Control; Yu Che, Cloud-Vehicle Cooperative Tracking Control.

• 2021-2024: Ruolin Yang, Harmony-enchaned RL; Encheng Tu, Hybrid MPC Motion Planning for Autonomous Overtaking; Yizhuo Guan, Prediction and Control for Emergency Evasion.

• 2020-2023: Gesong Shi, Cooperative Control for Transit Priority.

• 2019-2022: Puhang Xu, Safe-RL Decision-Making; Hongyu Xiao, POMDP Motion Planning; Zixuan Qian, SMPC Motion Planning; Jie Gao: Global Planning.

🎓 Education

Ph.D. Student in Vehicle Engineering, Tongji University, 2019-now.

B.E. in Engineering Mechanics, Tongji University, 2014-2019.

German Enhancement Class in School of Foreign Studies, Tongji University, 2017-2018.