allenai/eval_molmoact_candy_sorting_in-distribution
Scanned in 51 ms50 episodes · 59,645 frames · Videos: metadata only10 warnings
What leCop reported at this revision, not a verdict. Report a wrong finding
clipped_dimension8About this check
A signal sits at its minimum or maximum for many frames.
datasetaction: dimension 0 is at its minimum (-0.8353087306022644) in 15.3% of the frames
+ 7 more
datasetaction: dimension 1 is at its maximum (2.448659896850586) in 23.5% of the frames
datasetaction: dimension 2 is at its minimum (0.004582792986184359) in 11.9% of the frames
datasetaction: dimension 3 is at its minimum (-0.9696626663208008) in 7.7% of the frames
datasetaction: dimension 8 is at its minimum (0.0025724871084094048) in 49.0% of the frames
datasetaction: dimension 9 is at its minimum (0.007276484277099371) in 48.0% of the frames
datasetaction: dimension 12 is at its minimum (0.007783941924571991) in 20.9% of the frames
datasetaction: dimension 13 is at its maximum (1) in 15.6% of the frames
distribution_shift2About this check
The signal's mean in the last quarter of the episodes is far from the first quarter's.
datasetaction: dimension 8 of the last quarter of the episodes is 232.8 standard deviations from the first quarter
+ 1 more
datasetobservation.state: dimension 9 of the last quarter of the episodes is 527.0 standard deviations from the first quarter
Reproduce
hf download allenai/eval_molmoact_candy_sorting_in-distribution \ --repo-type dataset --revision b68b2df889134d23751ee09f3abc00b2cb94be71 \ --local-dir allenai__eval_molmoact_candy_sorting_in-distribution lecop validate allenai__eval_molmoact_candy_sorting_in-distribution