onsetbench
Menu

Detailed results

Model scores, event counts and comparison checks.

Loading onset

REASSEMBLE · 83 recordings · 3,898 events · ±200 ms.

Swipe to see all columns.

REASSEMBLE · 83 recordings · sorted by F1
Rank / ModelF1PrecisionRecallMedian timing error, ms
1. Haptera40.58%33.94%50.44%80.39
2. Gemini 3.1 Pro Preview21.30%15.36%34.71%56.97
3. Open V-JEPA212.09%42.24%7.05%87.31
4. Open DINOv24.15%23.00%2.28%119.98

1. Haptera

F1
40.58%
Precision
33.94%
Recall
50.44%
Median timing error, ms
80.39

2. Gemini 3.1 Pro Preview

F1
21.30%
Precision
15.36%
Recall
34.71%
Median timing error, ms
56.97

3. Open V-JEPA2

F1
12.09%
Precision
42.24%
Recall
7.05%
Median timing error, ms
87.31

4. Open DINOv2

F1
4.15%
Precision
23.00%
Recall
2.28%
Median timing error, ms
119.98

Contact state

REASSEMBLE · the same 83 recordings.

Swipe to see all columns.

REASSEMBLE · 83 recordings · sorted by contact recall
ModelContact precisionNo-contact precisionContact recallCoverage
Haptera92.74%99.72%51.82%76.25%
Gemini 3.1 Pro Preview24.62%79.55%22.93%99.88%

Haptera

Contact precision
92.74%
No-contact precision
99.72%
Contact recall
51.82%
Coverage
76.25%

Gemini 3.1 Pro Preview

Contact precision
24.62%
No-contact precision
79.55%
Contact recall
22.93%
Coverage
99.88%

RH20T timing

F1 at ±200 ms across three robot setups.

Swipe to see all columns.

RH20T · F1 at ±200 ms · sorted by mean F1
ModelF1 (mean)Setup 2Setup 6Setup 7
Haptera2.26%1.12%3.24%2.42%
Open DINOv20.85%0.67%0.90%0.98%
Open V-JEPA20.27%0.20%0.23%0.39%

Haptera

F1 (mean)
2.26%
Setup 2
1.12%
Setup 6
3.24%
Setup 7
2.42%

Open DINOv2

F1 (mean)
0.85%
Setup 2
0.67%
Setup 6
0.90%
Setup 7
0.98%

Open V-JEPA2

F1 (mean)
0.27%
Setup 2
0.20%
Setup 6
0.23%
Setup 7
0.39%

False alarms

False detections during periods when the sensor reference reports no event.

Swipe to see all columns.

Sensor-defined quiet intervals
ModelFalse detectionsFalse detections/quiet hour95% intervalRecall @±200 msF1 @±200 ms
Haptera330139.80[108.09, 174.35]50.44%40.58%
Gemini 3.1 Pro Preview2,168918.44[844.90, 987.39]34.71%21.30%
Open V-JEPA23213.56[9.18, 18.08]7.05%12.09%
Open DINOv23414.40[9.89, 18.92]2.28%4.15%
Timing thresholds and event counts

Swipe to see all columns.

Loading onset · both timing tolerances
ModelAllowed timing errorPredicted eventsEvents foundFalse detectionsEvents missedPrecisionRecallF1Median timing error, ms
Haptera±200 ms5,7921,9663,8261,93233.94%50.44%40.58%80.39
Gemini 3.1 Pro Preview±200 ms8,8091,3537,4562,54515.36%34.71%21.30%56.97
Open V-JEPA2±200 ms6512753763,62342.24%7.05%12.09%87.31
Open DINOv2±200 ms387892983,80923.00%2.28%4.15%119.98
Haptera±100 ms5,7921,1854,6072,71320.46%30.40%24.46%47.96
Gemini 3.1 Pro Preview±100 ms8,8099777,8322,92111.09%25.06%15.38%35.96
Open V-JEPA2±100 ms6511515003,74723.20%3.87%6.64%44.87
Open DINOv2±100 ms387313563,8678.01%0.80%1.45%47.21
Midpoint and shifted-time controls

Compare the saved predictions with guesses at the middle of each time block and with shifted prediction times.

Swipe to see all columns.

Midpoint and shifted-time controls
ModelAllowed timing errorF1Midpoint F1Mean shifted F1
Haptera±200 ms40.58%38.14%6.88%
Haptera±100 ms24.46%22.27%3.48%
Gemini 3.1 Pro Preview±200 ms21.30%20.96%6.73%
Gemini 3.1 Pro Preview±100 ms15.38%11.21%3.54%

Events found and missed

FoundMissed
Allowed timing error

Haptera

1,966 found / 1,932 missed
Share found 50.44%False detections 3,826

Gemini 3.1 Pro Preview

1,353 found / 2,545 missed
Share found 34.71%False detections 7,456

Haptera

1,185 found / 2,713 missed
Share found 30.40%False detections 4,607

Gemini 3.1 Pro Preview

977 found / 2,921 missed
Share found 25.06%False detections 7,832

3,898 reference events across 83 recordings.