ManiSkill2: Manipulation Benchmark Demonstrations

GPU-accelerated manipulation benchmark with 20+ tasks and expert demonstrations. Apache 2.0 licensed.

Apache 2.0 -- Open HDF5 Simulation

Key Stats

MetricValue
Tasks20+ environments (peg insertion, cube stacking, cabinet, drawer, etc.)
RobotsFranka Panda, xArm (simulated)
Size~5 GB demonstrations
FormatHDF5
ModalitiesRGB, depth, point cloud, joint state, actions
LicenseApache 2.0
Related datasets99 ManiSkill-related datasets on HuggingFace

What is ManiSkill2?

ManiSkill2 is a GPU-accelerated manipulation simulation benchmark from UCSD's HAO Lab (Hao Su group). It provides a diverse set of manipulation environments with standardized evaluation protocols, plus expert demonstrations that serve as training data for imitation learning research.

Key advantages include GPU parallelization (thousands of environments in parallel on a single GPU), rich observation spaces (RGB + depth + point cloud), and a growing ecosystem of 99 related datasets on HuggingFace. ManiSkill3, the latest iteration, further improves simulation speed and adds soft-body manipulation tasks.

Related datasets

From sim to real

Use ManiSkill2 for pretraining, then fine-tune with real-world data from our collection service.