# Perceptron — Perceptron EgoHome: A new benchmark for dense, sub-second egocentric understanding

- Company: Perceptron (perceptron.inc)
- Announced: 2026-11-04
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://www.perceptron.inc/blog/egohome
- Record: https://forck.live/items/34107-perceptron-egohome-a-new-benchmark-for-dense-sub-second-egocentric-understanding
- Subject: Perceptron Isaac / Perceptron Mk1

Perceptron is releasing and open-sourcing EgoHome, a benchmark of densely human-annotated egocentric video, alongside its Perceptron Egocentric 1.0 announcement. The benchmark contains 137 clips of people doing household tasks, two hours in total, and is the first to combine four annotation types on every video. Those types are hand location bounding boxes, subtask annotations, left and right hand actions drawn from Ego4D's closed-vocab schema, and left and right hand captions. Perceptron says the release includes raw annotations and code for evaluation metrics, including a new LLM-as-judge measure it calls permissible subsegment Jaccard. That metric allows ground truth and predicted segments to match many-to-many, because annotators may divide the same video into one task or many smaller segments. The annotations are temporally fine-grained: 3,371 segments under 1 s and 773 under 0.5 s. Hand boxes are annotated at 10 fps and smoothed up to 30 fps, and the Ego4D action schema offers 118 actions, of which 47 occur in the release.

## Evidence

Verbatim from https://www.perceptron.inc/blog/egohome:

> As part of our announcement of Perceptron Egocentric 1.0 , we are releasing and open-sourcing EgoHome, a new benchmark of densely human-annotated egocentric video: 137 clips of people performing household tasks, 2 hours in total.
> 
> Washing dishes Scrubbing the drain mat and basin with a sponge, then rinsing the mat under the tap.
> 
> The annotations span four different categories:
> 
> Hand location bounding boxes
> 
> Subtask annotations
> 
> Left and right hand actions (from Ego4D’s closed-vocab schema)
> 
> Left and right hand captions.
> 
> We release the raw annotations as well as code for evaluation metrics , which we believe better capture the inherent subjectivity of open vocabulary video description.
> 
> A new standard for Egocentric annotations
> 
> Recent work has established that high volumes of diverse pretraining data are essential for reliable control: Physical Intelligence has shown that compositional generalization can emerge from diverse multimodal data and conditioning [ 1 ], Generalist has shown that task-specific mastery can be achieved by scaling high-fidelity physical-interaction data [ 2 ], and Dyna that scaling egocentric data is one viable path to human-level control [ 3 ].

---

Record: https://forck.live/items/34107-perceptron-egohome-a-new-benchmark-for-dense-sub-second-egocentric-understanding
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md
