storytold/cloud-worker
2
0
Fork 0
mirror of https://github.com/storytold/cloud-worker.git synced 2026-10-09 00:09:43 +00:00
Code Issues Packages Projects Releases Wiki Activity

reliability: failure-stats + output-validation tooling; persistent output dir

Browse Source 
- bench/failures.py: per-GPU success rates and error-class breakdown by config
- bench/validate_outputs.py: ffprobe every recorded output via /view
- finding: 24GB cards fail on multi-ref (TE vision OOM), not duration/size;
  100% of successful runs produce valid videos
- outputs now written to /workspace (survives pod resets)

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
Hanashi
2026-08-06 14:41:00 -04:00
parent fbc68bb749
commit a293d0a2c4
13 changed files with 308 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
bench/validation.jsonl
+12
View File
@@ -0,0 +1,12 @@
{"label": "smoke_t2v", "file": "smoke_t2v_00001_.mp4", "valid": false, "error": "HTTP Error 404: Not Found"}
{"label": "prunedint8_sweep_t2v_864x480_15s", "file": "prunedint8_sweep_t2v_864x480_15s_00001_.mp4", "valid": false, "error": "HTTP Error 404: Not Found"}
{"label": "prunedint8_sweep_ref2v_864x480_5s", "file": "prunedint8_sweep_ref2v_864x480_5s_00001_.mp4", "valid": false, "error": "HTTP Error 404: Not Found"}
{"label": "prunedint8_refheavy_4ref_match", "file": "prunedint8_refheavy_4ref_match_00001_.mp4", "valid": true, "bytes": 687266, "video_codec": "h264", "audio_codec": "aac", "width": 864, "height": 480, "duration": 5.17, "expected_duration": 5.17}
{"label": "pi8_key_ref2v_1ref_r0", "file": "pi8_key_ref2v_1ref_r0_00001_.mp4", "valid": true, "bytes": 826358, "video_codec": "h264", "audio_codec": "aac", "width": 864, "height": 480, "duration": 5.17, "expected_duration": 5.17}
{"label": "pi8_key_ref2v_8ref_max", "file": "pi8_key_ref2v_8ref_max_00001_.mp4", "valid": true, "bytes": 1007718, "video_codec": "h264", "audio_codec": "aac", "width": 864, "height": 480, "duration": 5.17, "expected_duration": 5.17}
{"label": "i8_key_t2v_5s_r1", "file": "i8_key_t2v_5s_r1_00001_.mp4", "valid": true, "bytes": 858674, "video_codec": "h264", "audio_codec": "aac", "width": 864, "height": 480, "duration": 5.17, "expected_duration": 5.17}
{"label": "i8_key_t2v_15s", "file": "i8_key_t2v_15s_00001_.mp4", "valid": true, "bytes": 3295798, "video_codec": "h264", "audio_codec": "aac", "width": 864, "height": 480, "duration": 15.08, "expected_duration": 15.08}
{"label": "i8_refheavy_8ref_match_1344", "file": "i8_refheavy_8ref_match_1344_00001_.mp4", "valid": true, "bytes": 1523680, "video_codec": "h264", "audio_codec": "aac", "width": 1344, "height": 768, "duration": 5.17, "expected_duration": 5.17}
{"label": "b16_key_ref2v_8ref_r1", "file": "b16_key_ref2v_8ref_r1_00001_.mp4", "valid": true, "bytes": 1117762, "video_codec": "h264", "audio_codec": "aac", "width": 864, "height": 480, "duration": 5.17, "expected_duration": 5.17}
{"label": "b16_refheavy_4ref_max", "file": "b16_refheavy_4ref_max_00001_.mp4", "valid": true, "bytes": 763758, "video_codec": "h264", "audio_codec": "aac", "width": 864, "height": 480, "duration": 5.17, "expected_duration": 5.17}
{"label": "pi8v2_key_ref2v_8ref_r2", "file": "pi8v2_key_ref2v_8ref_r2_00001_.mp4", "valid": true, "bytes": 1355173, "video_codec": "h264", "audio_codec": "aac", "width": 864, "height": 480, "duration": 5.17, "expected_duration": 5.17}