Research context

Using sensors to label physical events

Related research uses sensors to label what happened and when. Those labels provide references for testing a model's predictions.

• RH20T pairs robot video with synchronized force, torque, action and other sensor readings. Each event test defines which sensor change to use as its timing reference.
• REASSEMBLE combines force and torque readings with video from several cameras during assembly and disassembly. It also labels task actions. The start of an action and the start of a force change are different events.
• RoboLens annotation describes labeling contact and slip using touch sensors and gripper readings, with a status for source review.

Annotation work supplies labels. OnsetBench scores predictions from standard video against those labels for a defined event and set of recordings.