Website | Paper | Video

We are currently in the process of organizing our code and preparing it for release.

Stay tuned for our upcoming open-source project on GitHub!

---

CurricuVLM: Towards Safe Autonomous Driving via Personalized Safety-Critical Curriculum Learning with Vision-Language Models

Zihao Sheng^1,*, Zilin Huang^1,*, Yansong Qu², Yue Leng³, Sruthi Bhavanam³, Sikai Chen^1,✉

¹University of Wisconsin-Madison, ²Purdue University, ³Google

^*Equally Contributing First Authors, ^✉Corresponding Author

💡 Highlights

🔥 To the best of our knowledge, CurricuVLM is the first work to utilize VLMs for dynamic curriculum generation in closed-loop autonomous driving training.

🏁 CurricuVLM outperforms state-of-the-art baselines, across both regular and safety-critical scenarios, achieving superior performance in terms of navigation success, driving efficiency, and safety metrics..

Before training with CurricuVLM

Case 1	Case 2	Case 3	Case 4	Case 5

After training with CurricuVLM

Case 1	Case 2	Case 3	Case 4	Case 5