Benchmark code
Evaluator, model adapter, public labels and examples.
319.6 KB · ZIP
Download codeRun your model on standard video and score its event predictions.
Evaluator, model adapter, public labels and examples.
319.6 KB · ZIP
Download code40 original wrist-camera recordings with frame timestamps.
749 MB · ZIP
Download videosModel scores, controls, scoring rules and prompt sheet.
9.4 KB · ZIP
Download reportThe 40 public recordings are for development. Published results use separate evaluation sets.
onsetbench directory and install the evaluator.cd onsetbench
python -m pip install .
python -m onsetbench run --dataset data/reassemble_public40.json --inputs ../inputs/inputs.json --predictor my_adapter:predict --name "My model" --out my-runThe runner saves predictions and scores to my-run.