Open Robot Parkour Project Enables DIY Quadrupeds to Leap and Climb

NVIDIA Senior AI Scientist Jim Fan share a open-sourced Robot Parkour project on X, researchers at Stanford AI Lab Zipeng Fu and NVIDIA have open-sourced software enabling agile robotic movement like leaping over obstacles and climbing stairs. The project provides an accessible foundation for robotics tinkerers to experiment with advanced locomotive behaviors.

Dubbed “Open Robot Parkour”, the project is detailed in a new paper from the Stanford Artificial Intelligence Laboratory. It allows quadruped robots to dynamically traverse obstacles using only onboard vision and computing.

As described in a tweet from NVIDIA senior AI scientist Jim Fan, the researchers leveraged two of the company’s core technologies:

IsaacGym – A virtual training environment where robot behaviors can be simulated at 10,000x real-time speed on NVIDIA GPUs. This enabled rapid iteration.
NVIDIA Jetson NX – Provided the onboard compute for visual perception and locomotion on actual robots after training in simulation.
According to the paper, the training methodology involved two key phases:

First, an easy simulated environment enabled the quadruped bot to get a “sketch” of the needed movement skills.
Then a hard mode applied dynamics constraints and refined the skills before distilling them into a final policy reliant only on realistic vision and proprioception.
This workflow resulted in performant policies that transferred to physical robot platforms like the low-cost Unitree A1. The real-world bots displayed dynamic movements like stepping over obstacles, crossing gaps, crawling under barriers, and squeezing through slits.

By open-sourcing both the software and training methodology, the researchers aim to provide a springboard for further innovation in agile robotics. Interested tinkerers can experiment with the tools using their own hardware.

The project showcases the power of modern AI and simulation techniques to unlock capabilities previously requiring expensive hardware innovations. It provides an exciting glimpse into a future where robot mobility reaches new heights thanks to accessible software advancements.

Open Robot Parkour project team

This project is led by @ziwenzhuang_leo and @zipengfu
Advised by @chelseabfinn and @zhaohang0124

Website: https://robot-parkour.github.io
Paper: https://arxiv.org/abs/2309.05665

Latest

NVIDIA Project DIGITS: Desktop Supercomputer Personal AI Development, 1 Petaflop Power

NVIDIA aims to change that paradigm with Project DIGITS...

Microsoft Unveils AI Features for Copilot+ PCs: Transforming PC Experience

Microsoft is pushing the boundaries of AI integration in...

Meta ORION AI-Powered Glasses: The Next Big Tech Revolution is in Sight

The tech industry is on the brink of a...

Intel Strategic Shift: New Partnerships and Restructuring Pave the Way for Future Growth

Intel, the semiconductor giant, is making waves with a...

Newsletter

Don't miss

NVIDIA Project DIGITS: Desktop Supercomputer Personal AI Development, 1 Petaflop Power

NVIDIA aims to change that paradigm with Project DIGITS...

Microsoft Unveils AI Features for Copilot+ PCs: Transforming PC Experience

Microsoft is pushing the boundaries of AI integration in...

Meta ORION AI-Powered Glasses: The Next Big Tech Revolution is in Sight

The tech industry is on the brink of a...

Intel Strategic Shift: New Partnerships and Restructuring Pave the Way for Future Growth

Intel, the semiconductor giant, is making waves with a...

DJI NEO: The Pocket-Sized Drone That’s Changing Aerial Photography

DJI has thrown its hat into the ring with...
Tony Lee
Tony Leehttps://www.gizmoweek.com/
A geek fans #geek review #smartphones like new China tech company the xiaomi, oneplus, huawei.

NVIDIA Project DIGITS: Desktop Supercomputer Personal AI Development, 1 Petaflop Power

NVIDIA aims to change that paradigm with Project DIGITS - a compact yet powerful AI supercomputer that fits right on your desk. NVIDIA's latest innovation...

Microsoft Unveils AI Features for Copilot+ PCs: Transforming PC Experience

Microsoft is pushing the boundaries of AI integration in personal computing with its latest announcement of new features for Copilot+ PCs and Windows 11....

Meta ORION AI-Powered Glasses: The Next Big Tech Revolution is in Sight

The tech industry is on the brink of a paradigm shift, with AI-powered glasses poised to become the next disruptive form factor. With a...