Touch and Go: Paired Vision-Tactile Dataset
Touch and Go: paired visual and tactile data for learning cross-modal representations. Research-only license. Useful for tactile-augmented robot manipulation.
Paired visual and tactile data for cross-modal robot perception. Learn to predict touch from sight and sight from touch.
Research Only Vision + Tactile
Overview
Touch and Go provides synchronized visual images and tactile sensor readings from interactions with diverse objects and surfaces. The dataset is designed for training cross-modal representations -- models that can predict what something feels like from its appearance, and vice versa. This capability is essential for robots that need to plan grasps and manipulation strategies based on visual input but execute them with tactile feedback.
The dataset covers a variety of materials, textures, and object shapes, providing a foundation for material recognition, hardness estimation, and slip detection from visual cues alone.
Access
Note: This dataset is released for research use only. Commercial use is not permitted.