storytold/cloud-worker
2
0
Fork 0
mirror of https://github.com/storytold/cloud-worker.git synced 2026-10-17 00:23:49 +00:00
Code Issues Packages Projects Releases Wiki Activity

reliability: failure-stats + output-validation tooling; persistent output dir

Browse Source 
- bench/failures.py: per-GPU success rates and error-class breakdown by config
- bench/validate_outputs.py: ffprobe every recorded output via /view
- finding: 24GB cards fail on multi-ref (TE vision OOM), not duration/size;
  100% of successful runs produce valid videos
- outputs now written to /workspace (survives pod resets)

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
Hanashi
2026-08-06 14:41:00 -04:00
parent fbc68bb749
commit a293d0a2c4
13 changed files with 308 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
bench/4090/results.csv
+16
View File
@@ -26,3 +26,19 @@ ts,label,task,model_file,width,height,seconds,length,steps,sampler,scheduler,ref
2026-08-06T07:30:59Z,g4090_pi8_refheavy_8ref_match,ref2v,minimax_h3_ref2va_pruned_int8_convrot.safetensors,864,480,5,124,20,res_multistep,simple,match,8,True,False,20.8,18.7,21.8,,"{""status_str"": ""error"", ""completed"": false, ""messages"": [[""execution_start"", {""prompt_id"": ""91e186ad-65df-47f6-be72-9501dfc1e9f1"", ""timestamp"": 1786001438642}], [""execution_cached"", {""nodes"": [""1"", ""2"", ""3"", ""4"", ""6"", ""7"", ""8"", ""9"", ""20"", ""21"", ""22"", ""23"", ""24"", ""25"", ""26"", ""27"", ""5""], ""prompt_id"": ""91e186ad-65df-47f6-be72-9501dfc1e9f1"", ""timestamp"": 1786001438852}], [""execution_error"", {""prompt_id"": ""91e186ad-65df-47f6-be72-9501dfc1e9f1"", ""node_id"": ""11"", ""node_type"": ""SamplerCustomAdvanced"", ""executed"": [], ""exception_message"": ""Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number."", ""exception_type"": ""torch.OutOfMemoryError"", ""traceback"": ["" File \""/ComfyUI/execution.py\"", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n"", "" File \""/ComfyUI/execution.py\"", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^"
2026-08-06T07:31:17Z,g4090_pi8_refheavy_4ref_max,ref2v,minimax_h3_ref2va_pruned_int8_convrot.safetensors,864,480,5,124,20,res_multistep,simple,max,4,True,False,18.7,18.0,22.4,,"{""status_str"": ""error"", ""completed"": false, ""messages"": [[""execution_start"", {""prompt_id"": ""c79b27c2-09cc-4ce1-b078-6a5234b74d88"", ""timestamp"": 1786001459467}], [""execution_cached"", {""nodes"": [""1"", ""2"", ""3"", ""4"", ""6"", ""7"", ""8"", ""20"", ""21"", ""22"", ""23""], ""prompt_id"": ""c79b27c2-09cc-4ce1-b078-6a5234b74d88"", ""timestamp"": 1786001459474}], [""execution_error"", {""prompt_id"": ""c79b27c2-09cc-4ce1-b078-6a5234b74d88"", ""node_id"": ""5"", ""node_type"": ""MiniMaxH3ReferenceToVideo"", ""executed"": [], ""exception_message"": ""Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number."", ""exception_type"": ""torch.OutOfMemoryError"", ""traceback"": ["" File \""/ComfyUI/execution.py\"", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n"", "" File \""/ComfyUI/execution.py\"", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n"", "" File \""/ComfyUI/c"
2026-08-06T07:40:29Z,g4090_oomcheck_t2v_864,t2v,minimax_h3_fl2va_pruned_int8_convrot.safetensors,864,480,5.0,124,20,res_multistep,simple,match,1,True,True,393.1,390.7,21.4,g4090_oomcheck_t2v_864_00001_.mp4,
2026-08-06T17:52:41Z,g4090_pi8_key_t2v_5s_r0,t2v,minimax_h3_fl2va_pruned_int8_convrot.safetensors,864,480,5,124,20,res_multistep,simple,match,1,False,True,224.3,222.5,21.1,g4090_pi8_key_t2v_5s_r0_00001_.mp4,
2026-08-06T17:56:26Z,g4090_pi8_key_t2v_5s_r1,t2v,minimax_h3_fl2va_pruned_int8_convrot.safetensors,864,480,5,124,20,res_multistep,simple,match,1,True,True,225.0,222.4,22.2,g4090_pi8_key_t2v_5s_r1_00001_.mp4,
2026-08-06T18:00:10Z,g4090_pi8_key_t2v_5s_r2,t2v,minimax_h3_fl2va_pruned_int8_convrot.safetensors,864,480,5,124,20,res_multistep,simple,match,1,True,True,224.0,222.4,21.1,g4090_pi8_key_t2v_5s_r2_00001_.mp4,
2026-08-06T18:05:49Z,g4090_pi8_key_ref2v_1ref_r0,ref2v,minimax_h3_ref2va_pruned_int8_convrot.safetensors,864,480,5,124,20,res_multistep,simple,match,1,False,True,339.8,338.9,21.1,g4090_pi8_key_ref2v_1ref_r0_00001_.mp4,
2026-08-06T18:09:51Z,g4090_pi8_key_ref2v_1ref_r1,ref2v,minimax_h3_ref2va_pruned_int8_convrot.safetensors,864,480,5,124,20,res_multistep,simple,match,1,True,True,241.2,235.4,21.2,g4090_pi8_key_ref2v_1ref_r1_00001_.mp4,
2026-08-06T18:10:17Z,g4090_pi8_key_ref2v_1ref_r2,ref2v,minimax_h3_ref2va_pruned_int8_convrot.safetensors,864,480,5,124,20,res_multistep,simple,match,1,True,False,26.2,24.5,20.8,,"{""status_str"": ""error"", ""completed"": false, ""messages"": [[""execution_start"", {""prompt_id"": ""d1f56b69-02e0-473a-b974-9d0ffd52a1ee"", ""timestamp"": 1786039791534}], [""execution_cached"", {""nodes"": [""1"", ""2"", ""3"", ""4"", ""6"", ""7"", ""8"", ""9"", ""10"", ""5""], ""prompt_id"": ""d1f56b69-02e0-473a-b974-9d0ffd52a1ee"", ""timestamp"": 1786039791537}], [""execution_error"", {""prompt_id"": ""d1f56b69-02e0-473a-b974-9d0ffd52a1ee"", ""node_id"": ""11"", ""node_type"": ""SamplerCustomAdvanced"", ""executed"": [], ""exception_message"": ""Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number."", ""exception_type"": ""torch.OutOfMemoryError"", ""traceback"": ["" File \""/ComfyUI/execution.py\"", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n"", "" File \""/ComfyUI/execution.py\"", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n"", "" File \""/ComfyUI/comfy_api/in"
2026-08-06T18:14:23Z,g4090_pi8_key_ref2v_8ref_r0,ref2v,minimax_h3_ref2va_pruned_int8_convrot.safetensors,864,480,5,124,20,res_multistep,simple,match,8,True,False,246.0,244.5,21.0,,"{""status_str"": ""error"", ""completed"": false, ""messages"": [[""execution_start"", {""prompt_id"": ""3b5e5c37-0f7b-4458-b832-38ecfcc4c9eb"", ""timestamp"": 1786039817789}], [""execution_cached"", {""nodes"": [""1"", ""2"", ""3"", ""4"", ""6"", ""7"", ""8"", ""20""], ""prompt_id"": ""3b5e5c37-0f7b-4458-b832-38ecfcc4c9eb"", ""timestamp"": 1786039818251}], [""execution_error"", {""prompt_id"": ""3b5e5c37-0f7b-4458-b832-38ecfcc4c9eb"", ""node_id"": ""11"", ""node_type"": ""SamplerCustomAdvanced"", ""executed"": [""21"", ""27"", ""22"", ""9"", ""24"", ""26"", ""5"", ""25"", ""23""], ""exception_message"": ""Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number."", ""exception_type"": ""torch.OutOfMemoryError"", ""traceback"": ["" File \""/ComfyUI/execution.py\"", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n"", "" File \""/ComfyUI/execution.py\"", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^^^"
2026-08-06T18:14:42Z,g4090_pi8_key_ref2v_8ref_r1,ref2v,minimax_h3_ref2va_pruned_int8_convrot.safetensors,864,480,5,124,20,res_multistep,simple,match,8,True,False,18.7,17.1,18.6,,"{""status_str"": ""error"", ""completed"": false, ""messages"": [[""execution_start"", {""prompt_id"": ""ab3f9b09-ddb7-41e7-8c39-27ae36b468ec"", ""timestamp"": 1786040063740}], [""execution_cached"", {""nodes"": [""1"", ""2"", ""3"", ""4"", ""6"", ""7"", ""8"", ""9"", ""20"", ""21"", ""22"", ""23"", ""24"", ""25"", ""26"", ""27"", ""5""], ""prompt_id"": ""ab3f9b09-ddb7-41e7-8c39-27ae36b468ec"", ""timestamp"": 1786040063964}], [""execution_error"", {""prompt_id"": ""ab3f9b09-ddb7-41e7-8c39-27ae36b468ec"", ""node_id"": ""11"", ""node_type"": ""SamplerCustomAdvanced"", ""executed"": [], ""exception_message"": ""Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number."", ""exception_type"": ""torch.OutOfMemoryError"", ""traceback"": ["" File \""/ComfyUI/execution.py\"", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n"", "" File \""/ComfyUI/execution.py\"", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^"
2026-08-06T18:15:00Z,g4090_pi8_key_ref2v_8ref_r2,ref2v,minimax_h3_ref2va_pruned_int8_convrot.safetensors,864,480,5,124,20,res_multistep,simple,match,8,True,False,18.5,17.0,18.6,,"{""status_str"": ""error"", ""completed"": false, ""messages"": [[""execution_start"", {""prompt_id"": ""4742272b-2d38-4dc9-a8e2-09d8dc6c8edc"", ""timestamp"": 1786040082480}], [""execution_cached"", {""nodes"": [""1"", ""2"", ""3"", ""4"", ""6"", ""7"", ""8"", ""9"", ""20"", ""21"", ""22"", ""23"", ""24"", ""25"", ""26"", ""27"", ""5""], ""prompt_id"": ""4742272b-2d38-4dc9-a8e2-09d8dc6c8edc"", ""timestamp"": 1786040082696}], [""execution_error"", {""prompt_id"": ""4742272b-2d38-4dc9-a8e2-09d8dc6c8edc"", ""node_id"": ""11"", ""node_type"": ""SamplerCustomAdvanced"", ""executed"": [], ""exception_message"": ""Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number."", ""exception_type"": ""torch.OutOfMemoryError"", ""traceback"": ["" File \""/ComfyUI/execution.py\"", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n"", "" File \""/ComfyUI/execution.py\"", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^"
2026-08-06T18:17:17Z,g4090_pi8_key_t2v_15s,t2v,minimax_h3_fl2va_pruned_int8_convrot.safetensors,864,480,15,362,20,res_multistep,simple,match,1,True,False,136.5,,16.8,,server unreachable while polling: [Errno 104] Connection reset by peer
2026-08-06T18:25:24Z,g4090b_pi8_refheavy_1ref_match,ref2v,minimax_h3_ref2va_pruned_int8_convrot.safetensors,864,480,5,124,20,res_multistep,simple,match,1,True,True,396.2,391.9,21.9,g4090b_pi8_refheavy_1ref_match_00001_.mp4,
2026-08-06T18:28:34Z,g4090b_pi8_refheavy_4ref_match,ref2v,minimax_h3_ref2va_pruned_int8_convrot.safetensors,864,480,5,124,20,res_multistep,simple,match,4,True,False,189.6,187.3,22.9,,"{""status_str"": ""error"", ""completed"": false, ""messages"": [[""execution_start"", {""prompt_id"": ""db8eaf8e-a68e-40f5-ad1d-be3496225da9"", ""timestamp"": 1786040725094}], [""execution_cached"", {""nodes"": [], ""prompt_id"": ""db8eaf8e-a68e-40f5-ad1d-be3496225da9"", ""timestamp"": 1786040725094}], [""execution_error"", {""prompt_id"": ""db8eaf8e-a68e-40f5-ad1d-be3496225da9"", ""node_id"": ""11"", ""node_type"": ""SamplerCustomAdvanced"", ""executed"": [""7"", ""9"", ""23"", ""3"", ""6"", ""22"", ""2"", ""21"", ""5"", ""1"", ""8"", ""20"", ""4""], ""exception_message"": ""Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number."", ""exception_type"": ""torch.OutOfMemoryError"", ""traceback"": ["" File \""/ComfyUI/execution.py\"", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n"", "" File \""/ComfyUI/execution.py\"", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n"", "" File \""/Co"
2026-08-06T18:31:48Z,g4090b_pi8_refheavy_8ref_match,ref2v,minimax_h3_ref2va_pruned_int8_convrot.safetensors,864,480,5,124,20,res_multistep,simple,match,8,True,False,193.8,189.7,21.1,,"{""status_str"": ""error"", ""completed"": false, ""messages"": [[""execution_start"", {""prompt_id"": ""71dbdb62-fc28-41cd-be08-d92700592811"", ""timestamp"": 1786040915845}], [""execution_cached"", {""nodes"": [], ""prompt_id"": ""71dbdb62-fc28-41cd-be08-d92700592811"", ""timestamp"": 1786040915845}], [""execution_error"", {""prompt_id"": ""71dbdb62-fc28-41cd-be08-d92700592811"", ""node_id"": ""11"", ""node_type"": ""SamplerCustomAdvanced"", ""executed"": [""7"", ""24"", ""23"", ""3"", ""6"", ""9"", ""22"", ""26"", ""21"", ""2"", ""5"", ""1"", ""8"", ""25"", ""20"", ""27"", ""4""], ""exception_message"": ""Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number."", ""exception_type"": ""torch.OutOfMemoryError"", ""traceback"": ["" File \""/ComfyUI/execution.py\"", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n"", "" File \""/ComfyUI/execution.py\"", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^"
2026-08-06T18:35:01Z,g4090b_pi8_refheavy_4ref_max,ref2v,minimax_h3_ref2va_pruned_int8_convrot.safetensors,864,480,5,124,20,res_multistep,simple,max,4,True,False,193.0,190.2,22.4,,"{""status_str"": ""error"", ""completed"": false, ""messages"": [[""execution_start"", {""prompt_id"": ""db8d48a6-7ce1-441e-b99b-28fac3921c14"", ""timestamp"": 1786041108847}], [""execution_cached"", {""nodes"": [], ""prompt_id"": ""db8d48a6-7ce1-441e-b99b-28fac3921c14"", ""timestamp"": 1786041108847}], [""execution_error"", {""prompt_id"": ""db8d48a6-7ce1-441e-b99b-28fac3921c14"", ""node_id"": ""11"", ""node_type"": ""SamplerCustomAdvanced"", ""executed"": [""7"", ""9"", ""23"", ""3"", ""6"", ""22"", ""2"", ""21"", ""5"", ""1"", ""8"", ""20"", ""4""], ""exception_message"": ""Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number."", ""exception_type"": ""torch.OutOfMemoryError"", ""traceback"": ["" File \""/ComfyUI/execution.py\"", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n"", "" File \""/ComfyUI/execution.py\"", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n"", "" File \""/Co"
2026-08-06T18:37:33Z,g4090b_pi8_refheavy_8ref_max,ref2v,minimax_h3_ref2va_pruned_int8_convrot.safetensors,864,480,5,124,20,res_multistep,simple,max,8,True,False,152.0,148.9,23.1,,"{""status_str"": ""error"", ""completed"": false, ""messages"": [[""execution_start"", {""prompt_id"": ""c0da6de3-a983-435a-b0fa-db9f6e95bd1e"", ""timestamp"": 1786041302473}], [""execution_cached"", {""nodes"": [], ""prompt_id"": ""c0da6de3-a983-435a-b0fa-db9f6e95bd1e"", ""timestamp"": 1786041302473}], [""execution_error"", {""prompt_id"": ""c0da6de3-a983-435a-b0fa-db9f6e95bd1e"", ""node_id"": ""5"", ""node_type"": ""MiniMaxH3ReferenceToVideo"", ""executed"": [""24"", ""23"", ""3"", ""22"", ""26"", ""21"", ""2"", ""25"", ""20"", ""27"", ""4""], ""exception_message"": ""Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number."", ""exception_type"": ""torch.OutOfMemoryError"", ""traceback"": ["" File \""/ComfyUI/execution.py\"", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n"", "" File \""/ComfyUI/execution.py\"", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n"", "" File \""/Comfy"
2026-08-06T18:39:35Z,g4090b_pi8_refheavy_8ref_match_1344,ref2v,minimax_h3_ref2va_pruned_int8_convrot.safetensors,1344,768,5,124,20,res_multistep,simple,match,8,True,False,122.4,120.8,20.4,,"{""status_str"": ""error"", ""completed"": false, ""messages"": [[""execution_start"", {""prompt_id"": ""3cca3ccb-12d6-422f-8ad6-3f7b58e731df"", ""timestamp"": 1786041453629}], [""execution_cached"", {""nodes"": [], ""prompt_id"": ""3cca3ccb-12d6-422f-8ad6-3f7b58e731df"", ""timestamp"": 1786041453629}], [""execution_error"", {""prompt_id"": ""3cca3ccb-12d6-422f-8ad6-3f7b58e731df"", ""node_id"": ""5"", ""node_type"": ""MiniMaxH3ReferenceToVideo"", ""executed"": [""24"", ""23"", ""3"", ""22"", ""26"", ""21"", ""2"", ""25"", ""20"", ""27"", ""4""], ""exception_message"": ""Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number."", ""exception_type"": ""torch.OutOfMemoryError"", ""traceback"": ["" File \""/ComfyUI/execution.py\"", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"", "" File \""/ComfyUI/execution.py\"", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n"", "" File \""/ComfyUI/execution.py\"", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n"", "" File \""/Comfy"
1 ts label task model_file width height seconds length steps sampler scheduler ref_image_size ref_count warm ok wall_s exec_s peak_vram_gb outputs error
26 2026-08-06T07:30:59Z g4090_pi8_refheavy_8ref_match ref2v minimax_h3_ref2va_pruned_int8_convrot.safetensors 864 480 5 124 20 res_multistep simple match 8 True False 20.8 18.7 21.8 {"status_str": "error", "completed": false, "messages": [["execution_start", {"prompt_id": "91e186ad-65df-47f6-be72-9501dfc1e9f1", "timestamp": 1786001438642}], ["execution_cached", {"nodes": ["1", "2", "3", "4", "6", "7", "8", "9", "20", "21", "22", "23", "24", "25", "26", "27", "5"], "prompt_id": "91e186ad-65df-47f6-be72-9501dfc1e9f1", "timestamp": 1786001438852}], ["execution_error", {"prompt_id": "91e186ad-65df-47f6-be72-9501dfc1e9f1", "node_id": "11", "node_type": "SamplerCustomAdvanced", "executed": [], "exception_message": "Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number.", "exception_type": "torch.OutOfMemoryError", "traceback": [" File \"/ComfyUI/execution.py\", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n", " File \"/ComfyUI/execution.py\", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^
27 2026-08-06T07:31:17Z g4090_pi8_refheavy_4ref_max ref2v minimax_h3_ref2va_pruned_int8_convrot.safetensors 864 480 5 124 20 res_multistep simple max 4 True False 18.7 18.0 22.4 {"status_str": "error", "completed": false, "messages": [["execution_start", {"prompt_id": "c79b27c2-09cc-4ce1-b078-6a5234b74d88", "timestamp": 1786001459467}], ["execution_cached", {"nodes": ["1", "2", "3", "4", "6", "7", "8", "20", "21", "22", "23"], "prompt_id": "c79b27c2-09cc-4ce1-b078-6a5234b74d88", "timestamp": 1786001459474}], ["execution_error", {"prompt_id": "c79b27c2-09cc-4ce1-b078-6a5234b74d88", "node_id": "5", "node_type": "MiniMaxH3ReferenceToVideo", "executed": [], "exception_message": "Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number.", "exception_type": "torch.OutOfMemoryError", "traceback": [" File \"/ComfyUI/execution.py\", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n", " File \"/ComfyUI/execution.py\", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n", " File \"/ComfyUI/c
28 2026-08-06T07:40:29Z g4090_oomcheck_t2v_864 t2v minimax_h3_fl2va_pruned_int8_convrot.safetensors 864 480 5.0 124 20 res_multistep simple match 1 True True 393.1 390.7 21.4 g4090_oomcheck_t2v_864_00001_.mp4
29 2026-08-06T17:52:41Z g4090_pi8_key_t2v_5s_r0 t2v minimax_h3_fl2va_pruned_int8_convrot.safetensors 864 480 5 124 20 res_multistep simple match 1 False True 224.3 222.5 21.1 g4090_pi8_key_t2v_5s_r0_00001_.mp4
30 2026-08-06T17:56:26Z g4090_pi8_key_t2v_5s_r1 t2v minimax_h3_fl2va_pruned_int8_convrot.safetensors 864 480 5 124 20 res_multistep simple match 1 True True 225.0 222.4 22.2 g4090_pi8_key_t2v_5s_r1_00001_.mp4
31 2026-08-06T18:00:10Z g4090_pi8_key_t2v_5s_r2 t2v minimax_h3_fl2va_pruned_int8_convrot.safetensors 864 480 5 124 20 res_multistep simple match 1 True True 224.0 222.4 21.1 g4090_pi8_key_t2v_5s_r2_00001_.mp4
32 2026-08-06T18:05:49Z g4090_pi8_key_ref2v_1ref_r0 ref2v minimax_h3_ref2va_pruned_int8_convrot.safetensors 864 480 5 124 20 res_multistep simple match 1 False True 339.8 338.9 21.1 g4090_pi8_key_ref2v_1ref_r0_00001_.mp4
33 2026-08-06T18:09:51Z g4090_pi8_key_ref2v_1ref_r1 ref2v minimax_h3_ref2va_pruned_int8_convrot.safetensors 864 480 5 124 20 res_multistep simple match 1 True True 241.2 235.4 21.2 g4090_pi8_key_ref2v_1ref_r1_00001_.mp4
34 2026-08-06T18:10:17Z g4090_pi8_key_ref2v_1ref_r2 ref2v minimax_h3_ref2va_pruned_int8_convrot.safetensors 864 480 5 124 20 res_multistep simple match 1 True False 26.2 24.5 20.8 {"status_str": "error", "completed": false, "messages": [["execution_start", {"prompt_id": "d1f56b69-02e0-473a-b974-9d0ffd52a1ee", "timestamp": 1786039791534}], ["execution_cached", {"nodes": ["1", "2", "3", "4", "6", "7", "8", "9", "10", "5"], "prompt_id": "d1f56b69-02e0-473a-b974-9d0ffd52a1ee", "timestamp": 1786039791537}], ["execution_error", {"prompt_id": "d1f56b69-02e0-473a-b974-9d0ffd52a1ee", "node_id": "11", "node_type": "SamplerCustomAdvanced", "executed": [], "exception_message": "Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number.", "exception_type": "torch.OutOfMemoryError", "traceback": [" File \"/ComfyUI/execution.py\", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n", " File \"/ComfyUI/execution.py\", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n", " File \"/ComfyUI/comfy_api/in
35 2026-08-06T18:14:23Z g4090_pi8_key_ref2v_8ref_r0 ref2v minimax_h3_ref2va_pruned_int8_convrot.safetensors 864 480 5 124 20 res_multistep simple match 8 True False 246.0 244.5 21.0 {"status_str": "error", "completed": false, "messages": [["execution_start", {"prompt_id": "3b5e5c37-0f7b-4458-b832-38ecfcc4c9eb", "timestamp": 1786039817789}], ["execution_cached", {"nodes": ["1", "2", "3", "4", "6", "7", "8", "20"], "prompt_id": "3b5e5c37-0f7b-4458-b832-38ecfcc4c9eb", "timestamp": 1786039818251}], ["execution_error", {"prompt_id": "3b5e5c37-0f7b-4458-b832-38ecfcc4c9eb", "node_id": "11", "node_type": "SamplerCustomAdvanced", "executed": ["21", "27", "22", "9", "24", "26", "5", "25", "23"], "exception_message": "Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number.", "exception_type": "torch.OutOfMemoryError", "traceback": [" File \"/ComfyUI/execution.py\", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n", " File \"/ComfyUI/execution.py\", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^^^
36 2026-08-06T18:14:42Z g4090_pi8_key_ref2v_8ref_r1 ref2v minimax_h3_ref2va_pruned_int8_convrot.safetensors 864 480 5 124 20 res_multistep simple match 8 True False 18.7 17.1 18.6 {"status_str": "error", "completed": false, "messages": [["execution_start", {"prompt_id": "ab3f9b09-ddb7-41e7-8c39-27ae36b468ec", "timestamp": 1786040063740}], ["execution_cached", {"nodes": ["1", "2", "3", "4", "6", "7", "8", "9", "20", "21", "22", "23", "24", "25", "26", "27", "5"], "prompt_id": "ab3f9b09-ddb7-41e7-8c39-27ae36b468ec", "timestamp": 1786040063964}], ["execution_error", {"prompt_id": "ab3f9b09-ddb7-41e7-8c39-27ae36b468ec", "node_id": "11", "node_type": "SamplerCustomAdvanced", "executed": [], "exception_message": "Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number.", "exception_type": "torch.OutOfMemoryError", "traceback": [" File \"/ComfyUI/execution.py\", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n", " File \"/ComfyUI/execution.py\", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^
37 2026-08-06T18:15:00Z g4090_pi8_key_ref2v_8ref_r2 ref2v minimax_h3_ref2va_pruned_int8_convrot.safetensors 864 480 5 124 20 res_multistep simple match 8 True False 18.5 17.0 18.6 {"status_str": "error", "completed": false, "messages": [["execution_start", {"prompt_id": "4742272b-2d38-4dc9-a8e2-09d8dc6c8edc", "timestamp": 1786040082480}], ["execution_cached", {"nodes": ["1", "2", "3", "4", "6", "7", "8", "9", "20", "21", "22", "23", "24", "25", "26", "27", "5"], "prompt_id": "4742272b-2d38-4dc9-a8e2-09d8dc6c8edc", "timestamp": 1786040082696}], ["execution_error", {"prompt_id": "4742272b-2d38-4dc9-a8e2-09d8dc6c8edc", "node_id": "11", "node_type": "SamplerCustomAdvanced", "executed": [], "exception_message": "Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number.", "exception_type": "torch.OutOfMemoryError", "traceback": [" File \"/ComfyUI/execution.py\", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n", " File \"/ComfyUI/execution.py\", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^
38 2026-08-06T18:17:17Z g4090_pi8_key_t2v_15s t2v minimax_h3_fl2va_pruned_int8_convrot.safetensors 864 480 15 362 20 res_multistep simple match 1 True False 136.5 16.8 server unreachable while polling: [Errno 104] Connection reset by peer
39 2026-08-06T18:25:24Z g4090b_pi8_refheavy_1ref_match ref2v minimax_h3_ref2va_pruned_int8_convrot.safetensors 864 480 5 124 20 res_multistep simple match 1 True True 396.2 391.9 21.9 g4090b_pi8_refheavy_1ref_match_00001_.mp4
40 2026-08-06T18:28:34Z g4090b_pi8_refheavy_4ref_match ref2v minimax_h3_ref2va_pruned_int8_convrot.safetensors 864 480 5 124 20 res_multistep simple match 4 True False 189.6 187.3 22.9 {"status_str": "error", "completed": false, "messages": [["execution_start", {"prompt_id": "db8eaf8e-a68e-40f5-ad1d-be3496225da9", "timestamp": 1786040725094}], ["execution_cached", {"nodes": [], "prompt_id": "db8eaf8e-a68e-40f5-ad1d-be3496225da9", "timestamp": 1786040725094}], ["execution_error", {"prompt_id": "db8eaf8e-a68e-40f5-ad1d-be3496225da9", "node_id": "11", "node_type": "SamplerCustomAdvanced", "executed": ["7", "9", "23", "3", "6", "22", "2", "21", "5", "1", "8", "20", "4"], "exception_message": "Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number.", "exception_type": "torch.OutOfMemoryError", "traceback": [" File \"/ComfyUI/execution.py\", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n", " File \"/ComfyUI/execution.py\", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n", " File \"/Co
41 2026-08-06T18:31:48Z g4090b_pi8_refheavy_8ref_match ref2v minimax_h3_ref2va_pruned_int8_convrot.safetensors 864 480 5 124 20 res_multistep simple match 8 True False 193.8 189.7 21.1 {"status_str": "error", "completed": false, "messages": [["execution_start", {"prompt_id": "71dbdb62-fc28-41cd-be08-d92700592811", "timestamp": 1786040915845}], ["execution_cached", {"nodes": [], "prompt_id": "71dbdb62-fc28-41cd-be08-d92700592811", "timestamp": 1786040915845}], ["execution_error", {"prompt_id": "71dbdb62-fc28-41cd-be08-d92700592811", "node_id": "11", "node_type": "SamplerCustomAdvanced", "executed": ["7", "24", "23", "3", "6", "9", "22", "26", "21", "2", "5", "1", "8", "25", "20", "27", "4"], "exception_message": "Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number.", "exception_type": "torch.OutOfMemoryError", "traceback": [" File \"/ComfyUI/execution.py\", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n", " File \"/ComfyUI/execution.py\", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^
42 2026-08-06T18:35:01Z g4090b_pi8_refheavy_4ref_max ref2v minimax_h3_ref2va_pruned_int8_convrot.safetensors 864 480 5 124 20 res_multistep simple max 4 True False 193.0 190.2 22.4 {"status_str": "error", "completed": false, "messages": [["execution_start", {"prompt_id": "db8d48a6-7ce1-441e-b99b-28fac3921c14", "timestamp": 1786041108847}], ["execution_cached", {"nodes": [], "prompt_id": "db8d48a6-7ce1-441e-b99b-28fac3921c14", "timestamp": 1786041108847}], ["execution_error", {"prompt_id": "db8d48a6-7ce1-441e-b99b-28fac3921c14", "node_id": "11", "node_type": "SamplerCustomAdvanced", "executed": ["7", "9", "23", "3", "6", "22", "2", "21", "5", "1", "8", "20", "4"], "exception_message": "Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number.", "exception_type": "torch.OutOfMemoryError", "traceback": [" File \"/ComfyUI/execution.py\", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n", " File \"/ComfyUI/execution.py\", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n", " File \"/Co
43 2026-08-06T18:37:33Z g4090b_pi8_refheavy_8ref_max ref2v minimax_h3_ref2va_pruned_int8_convrot.safetensors 864 480 5 124 20 res_multistep simple max 8 True False 152.0 148.9 23.1 {"status_str": "error", "completed": false, "messages": [["execution_start", {"prompt_id": "c0da6de3-a983-435a-b0fa-db9f6e95bd1e", "timestamp": 1786041302473}], ["execution_cached", {"nodes": [], "prompt_id": "c0da6de3-a983-435a-b0fa-db9f6e95bd1e", "timestamp": 1786041302473}], ["execution_error", {"prompt_id": "c0da6de3-a983-435a-b0fa-db9f6e95bd1e", "node_id": "5", "node_type": "MiniMaxH3ReferenceToVideo", "executed": ["24", "23", "3", "22", "26", "21", "2", "25", "20", "27", "4"], "exception_message": "Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number.", "exception_type": "torch.OutOfMemoryError", "traceback": [" File \"/ComfyUI/execution.py\", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n", " File \"/ComfyUI/execution.py\", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n", " File \"/Comfy
44 2026-08-06T18:39:35Z g4090b_pi8_refheavy_8ref_match_1344 ref2v minimax_h3_ref2va_pruned_int8_convrot.safetensors 1344 768 5 124 20 res_multistep simple match 8 True False 122.4 120.8 20.4 {"status_str": "error", "completed": false, "messages": [["execution_start", {"prompt_id": "3cca3ccb-12d6-422f-8ad6-3f7b58e731df", "timestamp": 1786041453629}], ["execution_cached", {"nodes": [], "prompt_id": "3cca3ccb-12d6-422f-8ad6-3f7b58e731df", "timestamp": 1786041453629}], ["execution_error", {"prompt_id": "3cca3ccb-12d6-422f-8ad6-3f7b58e731df", "node_id": "5", "node_type": "MiniMaxH3ReferenceToVideo", "executed": ["24", "23", "3", "22", "26", "21", "2", "25", "20", "27", "4"], "exception_message": "Allocation on device \nThis error means you ran out of memory on your GPU.\n\nTIPS: If the workflow worked before you might have accidentally set the batch_size to a large number.", "exception_type": "torch.OutOfMemoryError", "traceback": [" File \"/ComfyUI/execution.py\", line 545, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 344, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n", " File \"/ComfyUI/execution.py\", line 318, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n", " File \"/ComfyUI/execution.py\", line 306, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n", " File \"/Comfy