TransCurriculum: Multi-Dimensional Curriculum Learning for Fast & Stable Locomotion


Abstract

High-speed legged locomotion struggles with stability and transfer losses at higher command velocities during deployment. One reason is that most curricula vary difficulty along a single axis, for example increasing the range of command velocities, terrain difficulty, or domain parameters (e.g. friction or payload mass) using either fixed update rules or instantaneous rewards while ignoring how the history of robot training has evolved. We propose TransCurriculum, a transformer-based multi-dimensional curriculum learning approach for agile quadrupedal locomotion. TransCurriculum adapts to 3 axes: velocity command targets, terrain difficulty, and domain randomization parameters (friction and payload mass). Rather than feeding task reward history directly into the low-level control policy, our formulation exploits it at the curriculum level. A transformer-based teacher retrieves the sequence of rewards and uses it to predict future rewards, success rate, and learning progress to guide expansion of this multidimensional curriculum towards high performing task bins. We validate our approach on the Unitree Go1 robot in simulation (Isaac Gym) and deploy it zero-shot on Go1 hardware. Our TransCurriculum policy achieves a maximum velocity of 6.3 m/s in simulation and 4.1 m/s on hardware, while reducing sim-to-real transfer loss from 27% to 18%.

Paper

TransCurriculum: Multi-Dimensional Curriculum Learning for Fast & Stable Locomotion.
Prakhar Mishra, Amir Hossain Raj, Xuesu Xiao, and Dinesh Manocha

Project page

https://prakharmishra27.github.io/TransCurriculum/