Files
cloud-worker/bench/4000/validation.jsonl
T
Hanashi a293d0a2c4 reliability: failure-stats + output-validation tooling; persistent output dir
- bench/failures.py: per-GPU success rates and error-class breakdown by config
- bench/validate_outputs.py: ffprobe every recorded output via /view
- finding: 24GB cards fail on multi-ref (TE vision OOM), not duration/size;
  100% of successful runs produce valid videos
- outputs now written to /workspace (survives pod resets)

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-08-06 14:41:00 -04:00

7 lines
1.4 KiB
JSON

{"label": "g4000_smoke_t2v_b", "file": "g4000_smoke_t2v_b_00001_.mp4", "valid": true, "bytes": 619210, "video_codec": "h264", "audio_codec": "aac", "width": 608, "height": 352, "duration": 5.17, "expected_duration": 5.17}
{"label": "g4000_pi8_key_t2v_5s_r0", "file": "g4000_pi8_key_t2v_5s_r0_00001_.mp4", "valid": true, "bytes": 898728, "video_codec": "h264", "audio_codec": "aac", "width": 864, "height": 480, "duration": 5.17, "expected_duration": 5.17}
{"label": "g4000_pi8_key_t2v_5s_r1", "file": "g4000_pi8_key_t2v_5s_r1_00001_.mp4", "valid": true, "bytes": 861789, "video_codec": "h264", "audio_codec": "aac", "width": 864, "height": 480, "duration": 5.17, "expected_duration": 5.17}
{"label": "g4000_pi8_key_t2v_5s_r2", "file": "g4000_pi8_key_t2v_5s_r2_00001_.mp4", "valid": true, "bytes": 1325124, "video_codec": "h264", "audio_codec": "aac", "width": 864, "height": 480, "duration": 5.17, "expected_duration": 5.17}
{"label": "g4000_pi8_key_ref2v_1ref_r0", "file": "g4000_pi8_key_ref2v_1ref_r0_00001_.mp4", "valid": true, "bytes": 985435, "video_codec": "h264", "audio_codec": "aac", "width": 864, "height": 480, "duration": 5.17, "expected_duration": 5.17}
{"label": "g4000_pi8_key_ref2v_1ref_r1", "file": "g4000_pi8_key_ref2v_1ref_r1_00001_.mp4", "valid": true, "bytes": 974798, "video_codec": "h264", "audio_codec": "aac", "width": 864, "height": 480, "duration": 5.17, "expected_duration": 5.17}