OPEN MODELS/IMITATION LEARNING/OCTO
INTERMEDIATEIMITATION LEARNINGFEATURED

Octo

Generalist robot policy trained on 800K trajectories

WHAT DOES THIS ACTUALLY DO?

Octo was trained by watching 800,000 robot movements across dozens of different robots. It learned patterns that apply broadly — like how to approach an object, grip it, and release it. You can then teach it your specific task with just a few examples.

PARAMETERS
93M
RELEASED
2024-05
LICENSE
MIT
ARCHITECTURE
Transformer...
CAN I ACTUALLY RUN THIS?
7
Intermediate
OUT OF 10

Relatively accessible — runs on a mid-range GPU and has solid documentation. You'll need some Python and ML knowledge, but it's one of the easier research models to get running.

DOWNLOAD WEIGHTS
View on GitHub
2GB disk space required
OVERVIEW

Transformer-based diffusion policy trained on 800K robot trajectories from Open X-Embodiment. Designed as a generalist policy that can be fine-tuned for new tasks with minimal data.

TRAINED ON

Open X-Embodiment (800K trajectories, multiple robot types)

ARCHITECTURE
Transformer + Diffusion Policy
CAPABILITIES
Language-conditioned control
Goal-image conditioning
Multi-robot support
Efficient fine-tuning
Action chunking
REAL ROBOTICS USE CASES
RESEARCH

Standard baseline for manipulation papers

WAREHOUSE

Bin-picking with minimal fine-tuning data

EDUCATION

Teaching robots from human demonstrations

HARDWARE REQUIREMENTS
MIN VRAM
8GB
REC VRAM
16GB
MIN RAM
16GB
DISK SPACE
2GB
JETSON
Compatible
CPU ONLY
GPU Required
TESTED GPUs
RTX 3080RTX 4080A100M2 Mac (MPS)
DEPLOYMENT PATHS
Local PC
8GB VRAM sufficientSUPPORTED
Docker
SUPPORTED
ROS2
Community integrations availableSUPPORTED
Jetson AGX Orin
With TensorRT conversionSUPPORTED
Cloud
SUPPORTED
Isaac Sim
NOT SUPPORTED
RELATED PAPERS
Octo: An Open-Source Generalist Robot Policy
Open X-Embodiment
READ ON ARXIV →
RELATED ORGANIZATIONS
UC BerkeleyGoogle DeepMind
ORGANIZATIONS
UC BerkeleyStanfordCMU
DIFFICULTY
INTERMEDIATE

Requires some ML and Python experience

COMPUTE6/10
SETUP5/10
BEGINNER-FRIENDLY6/10
EDGE DEPLOYMENT
Jetson Compatible
CPU-only Not Available
Community →

Seeded and planned prompts — not live forum activity yet.