Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BatchPromptScheduleLatentInput RuntimeError: torch.cat(): expected a non-empty list of Tensors #6552

Open
Solenyalyl opened this issue Jan 21, 2025 · 2 comments
Labels
Cannot Reproduce Cannot reproduce the bug User Support A user needs help with something, probably not a bug.

Comments

@Solenyalyl
Copy link

Solenyalyl commented Jan 21, 2025

Your question

ComfyUI Error Report

Error Details

  • Node ID: 16
  • Node Type: BatchPromptScheduleLatentInput
  • Exception Type: RuntimeError
  • Exception Message: torch.cat(): expected a non-empty list of Tensors

Stack Trace

  File "C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 327, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)

  File "C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 202, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)

  File "C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 174, in _map_node_over_list
    process_inputs(input_dict, i)

  File "C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 163, in process_inputs
    results.append(getattr(obj, func)(**inputs))

  File "C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_fizznodes\ScheduledNodes.py", line 220, in animate
    return batch_prompt_schedule_latentInput(settings,clip, num_latents)

  File "C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_fizznodes\ScheduleTypes.py", line 66, in batch_prompt_schedule_latentInput
    p = BatchPoolAnimConditioning(pos_cur_prompt, pos_nxt_prompt, weight, clip, settings)

  File "C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_fizznodes\BatchFuncs.py", line 345, in BatchPoolAnimConditioning
    final_pooled_output = torch.cat(pooled_out, dim=0)

System Information

  • ComfyUI Version: 0.3.12
  • Arguments: main.py --force-fp16
  • OS: nt
  • Python Version: 3.10.0 | packaged by conda-forge | (default, Nov 20 2021, 02:18:13) [MSC v.1916 64 bit (AMD64)]
  • Embedded Python: false
  • PyTorch Version: 2.5.1

Devices

  • Name: cuda:0
    • Type: cuda
    • VRAM Total:
    • VRAM Free: 5523928938
    • Torch VRAM Total:
    • Torch VRAM Free: 26244970

Logs

2025-01-21T19:05:57.743660 - [START] Security scan2025-01-21T19:05:57.743660 - 
2025-01-21T19:05:58.433097 - [DONE] Security scan2025-01-21T19:05:58.433097 - 
2025-01-21T19:05:58.519688 - ## ComfyUI-Manager: installing dependencies done.2025-01-21T19:05:58.519688 - 
2025-01-21T19:05:58.519688 - ** ComfyUI startup time:2025-01-21T19:05:58.519688 -  2025-01-21T19:05:58.519688 - 2025-01-21 19:05:58.5192025-01-21T19:05:58.520684 - 
2025-01-21T19:05:58.520684 - ** Platform:2025-01-21T19:05:58.520684 -  2025-01-21T19:05:58.520684 - Windows2025-01-21T19:05:58.520684 - 
2025-01-21T19:05:58.520684 - ** Python version:2025-01-21T19:05:58.520684 -  2025-01-21T19:05:58.521686 - 3.10.0 | packaged by conda-forge | (default, Nov 20 2021, 02:18:13) [MSC v.1916 64 bit (AMD64)]2025-01-21T19:05:58.521686 - 
2025-01-21T19:05:58.521686 - ** Python executable:2025-01-21T19:05:58.521686 -  2025-01-21T19:05:58.521686 - C:\setup\anaconda\anaconda\envs\work_video\python.exe2025-01-21T19:05:58.521686 - 
2025-01-21T19:05:58.521686 - ** ComfyUI Path:2025-01-21T19:05:58.521686 -  2025-01-21T19:05:58.521686 - C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI2025-01-21T19:05:58.521686 - 
2025-01-21T19:05:58.521686 - ** User directory:2025-01-21T19:05:58.522688 -  2025-01-21T19:05:58.522688 - C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\user2025-01-21T19:05:58.522688 - 
2025-01-21T19:05:58.522688 - ** ComfyUI-Manager config path:2025-01-21T19:05:58.522688 -  2025-01-21T19:05:58.522688 - C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\user\default\ComfyUI-Manager\config.ini2025-01-21T19:05:58.522688 - 
2025-01-21T19:05:58.522688 - ** Log path:2025-01-21T19:05:58.522688 -  2025-01-21T19:05:58.522688 - C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\user\comfyui.log2025-01-21T19:05:58.522688 - 
2025-01-21T19:05:59.275750 - 
Prestartup times for custom nodes:
2025-01-21T19:05:59.275750 -    2.0 seconds: C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-manager
2025-01-21T19:05:59.275750 - 
2025-01-21T19:06:00.526139 - Checkpoint files will always be loaded safely.
2025-01-21T19:06:00.637203 - 
2025-01-21T19:06:00.637203 - pytorch version: 2.5.1
2025-01-21T19:06:00.638184 - Forcing FP16.
2025-01-21T19:06:00.638184 - Set vram state to: NORMAL_VRAM
2025-01-21T19:06:00.638184 - Device: cuda:0 
2025-01-21T19:06:01.496709 - Using pytorch attention
2025-01-21T19:06:02.847498 - [Prompt Server] web root: C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\web
2025-01-21T19:06:03.203510 - 
2025-01-21T19:06:03.204506 - pytorch version: 2.5.1
2025-01-21T19:06:03.204506 - Forcing FP16.
2025-01-21T19:06:03.205496 - Set vram state to: NORMAL_VRAM
2025-01-21T19:06:03.205591 - Device: cuda:0
2025-01-21T19:06:03.214712 - ### Loading: ComfyUI-Impact-Pack (V8.4.1)2025-01-21T19:06:03.214712 - 
2025-01-21T19:06:03.269605 - [Impact Pack] Wildcards loading done.2025-01-21T19:06:03.269605 - 
2025-01-21T19:06:03.289382 - ### Loading: ComfyUI-Manager (V3.9.2)
2025-01-21T19:06:03.384419 - ### ComfyUI Revision: 3055 [55add502] *DETACHED | Released on '2025-01-16'
2025-01-21T19:06:03.866515 - �[34mFizzleDorf Custom Nodes: �[92mLoaded�[0m2025-01-21T19:06:03.866515 - 
2025-01-21T19:06:03.867504 - 
Import times for custom nodes:
2025-01-21T19:06:03.867504 -    0.0 seconds: C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\websocket_image_save.py
2025-01-21T19:06:03.867504 -    0.0 seconds: C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-kjnodes
2025-01-21T19:06:03.867504 -    0.0 seconds: C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-various
2025-01-21T19:06:03.867504 -    0.0 seconds: C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-GGUF
2025-01-21T19:06:03.868581 -    0.0 seconds: C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-ic-light
2025-01-21T19:06:03.868581 -    0.0 seconds: C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_essentials
2025-01-21T19:06:03.868581 -    0.0 seconds: C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-animatediff-evolved
2025-01-21T19:06:03.868581 -    0.1 seconds: C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-impact-pack
2025-01-21T19:06:03.868581 -    0.1 seconds: C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-videohelpersuite
2025-01-21T19:06:03.868581 -    0.2 seconds: C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_fizznodes
2025-01-21T19:06:03.868581 -    0.2 seconds: C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-manager
2025-01-21T19:06:03.868581 - 
2025-01-21T19:06:03.875911 - Starting server

2025-01-21T19:06:03.876789 - To see the GUI go to: http://127.0.0.1:8188
2025-01-21T19:06:03.928421 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json
2025-01-21T19:06:03.954947 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json
2025-01-21T19:06:03.983249 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json
2025-01-21T19:06:04.037807 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json
2025-01-21T19:06:04.064242 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json
2025-01-21T19:06:11.338853 - FETCH ComfyRegistry Data: 5/302025-01-21T19:06:11.338853 - 
2025-01-21T19:06:19.312457 - FETCH ComfyRegistry Data: 10/302025-01-21T19:06:19.313165 - 
2025-01-21T19:06:28.302231 - FETCH ComfyRegistry Data: 15/302025-01-21T19:06:28.302989 - 
2025-01-21T19:06:36.542093 - FETCH ComfyRegistry Data: 20/302025-01-21T19:06:36.542817 - 
2025-01-21T19:06:45.061276 - FETCH ComfyRegistry Data: 25/302025-01-21T19:06:45.061961 - 
2025-01-21T19:06:53.627925 - FETCH ComfyRegistry Data: 30/302025-01-21T19:06:53.627925 - 
2025-01-21T19:06:54.143088 - FETCH ComfyRegistry Data [DONE]2025-01-21T19:06:54.143088 - 
2025-01-21T19:06:54.219642 - [ComfyUI-Manager] default cache updated: https://api.comfy.org/nodes
2025-01-21T19:06:54.291627 - nightly_channel: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/remote
2025-01-21T19:06:54.292585 - FETCH DATA from: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json2025-01-21T19:06:54.292585 - 2025-01-21T19:06:55.039873 -  [DONE]2025-01-21T19:06:55.039873 - 
2025-01-21T19:07:33.057208 - FETCH DATA from: C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-manager\extension-node-map.json2025-01-21T19:07:33.058598 - 2025-01-21T19:07:33.065052 - Exception ignored in: 2025-01-21T19:07:33.065052 - <function _ProactorBasePipeTransport.__del__ at 0x0000027B9D95FAC0>2025-01-21T19:07:33.065052 - 
2025-01-21T19:07:33.065664 - Traceback (most recent call last):
2025-01-21T19:07:33.065664 -   File "C:\setup\anaconda\anaconda\envs\work_video\lib\asyncio\proactor_events.py", line 116, in __del__
2025-01-21T19:07:33.066247 -     2025-01-21T19:07:33.066247 - self.close()2025-01-21T19:07:33.066247 - 
2025-01-21T19:07:33.066931 -   File "C:\setup\anaconda\anaconda\envs\work_video\lib\asyncio\proactor_events.py", line 108, in close
2025-01-21T19:07:33.066931 -     2025-01-21T19:07:33.066931 - self._loop.call_soon(self._call_connection_lost, None)2025-01-21T19:07:33.067575 - 
2025-01-21T19:07:33.067575 -   File "C:\setup\anaconda\anaconda\envs\work_video\lib\asyncio\base_events.py", line 745, in call_soon
2025-01-21T19:07:33.068102 -     2025-01-21T19:07:33.068102 - self._check_closed()2025-01-21T19:07:33.068102 - 
2025-01-21T19:07:33.068102 -   File "C:\setup\anaconda\anaconda\envs\work_video\lib\asyncio\base_events.py", line 510, in _check_closed
2025-01-21T19:07:33.068805 -     2025-01-21T19:07:33.068805 - raise RuntimeError('Event loop is closed')2025-01-21T19:07:33.068805 - 
2025-01-21T19:07:33.068805 - RuntimeError2025-01-21T19:07:33.068805 - : 2025-01-21T19:07:33.069647 - Event loop is closed2025-01-21T19:07:33.069647 - 
2025-01-21T19:07:33.073403 -  [DONE]2025-01-21T19:07:33.073403 - 
2025-01-21T19:07:40.751119 - got prompt
2025-01-21T19:07:40.835911 - Using pytorch attention in VAE
2025-01-21T19:07:40.837909 - Using pytorch attention in VAE
2025-01-21T19:07:41.004751 - VAE load device: cuda:0, offload device: cpu, dtype: torch.bfloat16
2025-01-21T19:07:41.126351 - Requested to load AutoencoderKL
2025-01-21T19:07:41.347860 - loaded completely 9.5367431640625e+25 159.55708122253418 True
2025-01-21T19:07:43.467619 - model weight dtype torch.float16, manual cast: None
2025-01-21T19:07:43.468622 - model_type EPS
2025-01-21T19:07:44.444905 - Using pytorch attention in VAE
2025-01-21T19:07:44.446896 - Using pytorch attention in VAE
2025-01-21T19:07:44.621835 - VAE load device: cuda:0, offload device: cpu, dtype: torch.bfloat16
2025-01-21T19:07:44.735866 - CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16
2025-01-21T19:07:44.843943 - loaded diffusion model directly to GPU
2025-01-21T19:07:44.843943 - Requested to load BaseModel
2025-01-21T19:07:44.874067 - loaded completely 9.5367431640625e+25 1639.406135559082 True
2025-01-21T19:07:45.239850 - !!! Exception during processing !!! torch.cat(): expected a non-empty list of Tensors
2025-01-21T19:07:45.241851 - Traceback (most recent call last):
  File "C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 327, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 202, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 174, in _map_node_over_list
    process_inputs(input_dict, i)
  File "C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 163, in process_inputs
    results.append(getattr(obj, func)(**inputs))
  File "C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_fizznodes\ScheduledNodes.py", line 220, in animate
    return batch_prompt_schedule_latentInput(settings,clip, num_latents)
  File "C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_fizznodes\ScheduleTypes.py", line 66, in batch_prompt_schedule_latentInput
    p = BatchPoolAnimConditioning(pos_cur_prompt, pos_nxt_prompt, weight, clip, settings)
  File "C:\setup\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_fizznodes\BatchFuncs.py", line 345, in BatchPoolAnimConditioning
    final_pooled_output = torch.cat(pooled_out, dim=0)
RuntimeError: torch.cat(): expected a non-empty list of Tensors

2025-01-21T19:07:45.242851 - Prompt executed in 4.46 seconds

Attached Workflow

Please make sure that workflow does not contain any sensitive information such as API keys or passwords.

{"last_node_id":44,"last_link_id":71,"nodes":[{"id":1,"type":"LoadImage","pos":[2664.8130074266837,2327.44707674677],"size":{"0":315,"1":315},"flags":{},"order":0,"mode":0,"outputs":[{"name":"IMAGE","type":"IMAGE","links":[1],"slot_index":0,"shape":3,"label":"IMAGE"},{"name":"MASK","type":"MASK","links":null,"shape":3,"label":"MASK"}],"properties":{"Node name for S&R":"LoadImage"},"widgets_values":["face4.png","image"]},{"id":2,"type":"JWImageResizeByLongerSide","pos":[3206.3043876900483,2324.5878947019514],"size":{"0":315,"1":82},"flags":{},"order":9,"mode":0,"inputs":[{"name":"image","type":"IMAGE","link":1,"label":"image"}],"outputs":[{"name":"IMAGE","type":"IMAGE","links":[2,10],"slot_index":0,"shape":3,"label":"IMAGE"}],"properties":{"Node name for S&R":"JWImageResizeByLongerSide"},"widgets_values":[512,"bicubic"]},{"id":3,"type":"GetImageSize+","pos":[3610,2320],"size":{"0":210,"1":46},"flags":{},"order":14,"mode":0,"inputs":[{"name":"image","type":"IMAGE","link":2,"label":"image"}],"outputs":[{"name":"width","type":"INT","links":[3,61],"slot_index":0,"shape":3,"label":"width"},{"name":"height","type":"INT","links":[4,62],"slot_index":1,"shape":3,"label":"height"}],"properties":{"Node name for S&R":"GetImageSize+"}},{"id":4,"type":"EmptyLatentImage","pos":[3905.007977195757,2297.127928302163],"size":{"0":315,"1":105},"flags":{},"order":16,"mode":0,"inputs":[{"name":"width","type":"INT","link":3,"widget":{"name":"width"},"label":"width"},{"name":"height","type":"INT","link":4,"widget":{"name":"height"},"label":"height"},{"name":"batch_size","type":"INT","link":6,"slot_index":2,"widget":{"name":"batch_size"},"label":"batch_size"}],"outputs":[{"name":"LATENT","type":"LATENT","links":[20],"slot_index":0,"shape":3,"label":"LATENT"}],"properties":{"Node name for S&R":"EmptyLatentImage"},"widgets_values":[512,512,48]},{"id":5,"type":"PrimitiveNode","pos":[2185,2700],"size":{"0":210,"1":80},"flags":{},"order":8,"mode":0,"outputs":[{"name":"INT","type":"INT","links":[6,30],"slot_index":0,"widget":{"name":"batch_size"},"label":"INT"}],"title":"batch_size","properties":{"Run widget replace on values":false},"widgets_values":[48,"fixed"]},{"id":6,"type":"ADE_UseEvolvedSampling","pos":[3545,2770],"size":{"0":315,"1":118},"flags":{},"order":24,"mode":0,"inputs":[{"name":"model","type":"MODEL","link":7,"slot_index":0,"label":"model"},{"name":"m_models","type":"M_MODELS","link":8,"slot_index":1,"label":"m_models"},{"name":"context_options","type":"CONTEXT_OPTIONS","link":13,"slot_index":2,"label":"context_options"},{"name":"sample_settings","type":"SAMPLE_SETTINGS","link":14,"slot_index":3,"label":"sample_settings"}],"outputs":[{"name":"MODEL","type":"MODEL","links":[23,34],"slot_index":0,"shape":3,"label":"MODEL"}],"properties":{"Node name for S&R":"ADE_UseEvolvedSampling"},"widgets_values":["autoselect"]},{"id":7,"type":"CheckpointLoaderSimple","pos":[2135,2850],"size":{"0":315,"1":98},"flags":{},"order":1,"mode":0,"outputs":[{"name":"MODEL","type":"MODEL","links":[7,60],"slot_index":0,"shape":3,"label":"MODEL"},{"name":"CLIP","type":"CLIP","links":[19,50,51],"slot_index":1,"shape":3,"label":"CLIP"},{"name":"VAE","type":"VAE","links":null,"slot_index":2,"shape":3,"label":"VAE"}],"properties":{"Node name for S&R":"CheckpointLoaderSimple"},"widgets_values":["awportrait_v10.safetensors"]},{"id":8,"type":"ADE_ApplyAnimateDiffModelWithPIA","pos":[3145,2780],"size":{"0":294,"1":262},"flags":{},"order":21,"mode":0,"inputs":[{"name":"motion_model","type":"MOTION_MODEL_ADE","link":9,"slot_index":0,"label":"motion_model"},{"name":"image","type":"IMAGE","link":10,"slot_index":1,"label":"image"},{"name":"vae","type":"VAE","link":11,"slot_index":2,"label":"vae"},{"name":"pia_input","type":"PIA_INPUT","link":33,"label":"pia_input"},{"name":"motion_lora","type":"MOTION_LORA","link":null,"label":"motion_lora"},{"name":"scale_multival","type":"MULTIVAL","link":null,"label":"scale_multival"},{"name":"effect_multival","type":"MULTIVAL","link":null,"label":"effect_multival"},{"name":"ad_keyframes","type":"AD_KEYFRAMES","link":null,"label":"ad_keyframes"},{"name":"prev_m_models","type":"M_MODELS","link":null,"label":"prev_m_models"},{"name":"per_block","type":"PER_BLOCK","link":null,"label":"per_block"}],"outputs":[{"name":"M_MODELS","type":"M_MODELS","links":[8],"shape":3,"label":"M_MODELS"}],"properties":{"Node name for S&R":"ADE_ApplyAnimateDiffModelWithPIA"},"widgets_values":[0,1,""]},{"id":9,"type":"ADE_LoadAnimateDiffModel","pos":[2660,2745],"size":{"0":315,"1":58},"flags":{},"order":2,"mode":0,"inputs":[{"name":"ad_settings","type":"AD_SETTINGS","link":null,"label":"ad_settings"}],"outputs":[{"name":"MOTION_MODEL","type":"MOTION_MODEL_ADE","links":[9],"shape":3,"label":"MOTION_MODEL"}],"properties":{"Node name for S&R":"ADE_LoadAnimateDiffModel"},"widgets_values":["pia.ckpt"]},{"id":10,"type":"VAELoader","pos":[2095,3020],"size":{"0":315,"1":58},"flags":{},"order":7,"mode":0,"outputs":[{"name":"VAE","type":"VAE","links":[11,28,39,52,56,67,69],"slot_index":0,"shape":3,"label":"VAE"}],"properties":{"Node name for S&R":"VAELoader"},"widgets_values":["vaeFtMse840000Ema_v10.safetensors"]},{"id":11,"type":"ADE_InputPIA_PaperPresets","pos":[2760,2940],"size":{"0":277.20001220703125,"1":106},"flags":{},"order":3,"mode":0,"inputs":[{"name":"mult_multival","type":"MULTIVAL","link":null,"label":"mult_multival"}],"outputs":[{"name":"PIA_INPUT","type":"PIA_INPUT","links":[],"slot_index":0,"shape":3,"label":"PIA_INPUT"}],"properties":{"Node name for S&R":"ADE_InputPIA_PaperPresets"},"widgets_values":["Animation (Small Motion)",0,false,""]},{"id":12,"type":"ADE_StandardStaticContextOptions","pos":[3475,3070],"size":{"0":319.20001220703125,"1":198},"flags":{},"order":4,"mode":0,"inputs":[{"name":"prev_context","type":"CONTEXT_OPTIONS","link":null,"label":"prev_context"},{"name":"view_opts","type":"VIEW_OPTS","link":null,"label":"view_opts"}],"outputs":[{"name":"CONTEXT_OPTS","type":"CONTEXT_OPTIONS","links":[13],"shape":3,"label":"CONTEXT_OPTS"}],"properties":{"Node name for S&R":"ADE_StandardStaticContextOptions"},"widgets_values":[16,4,"pyramid",false,0,1]},{"id":13,"type":"ADE_AnimateDiffSamplingSettings","pos":[3490,3325],"size":{"0":220,"1":258},"flags":{},"order":5,"mode":0,"inputs":[{"name":"noise_layers","type":"NOISE_LAYERS","link":null,"label":"noise_layers"},{"name":"iteration_opts","type":"ITERATION_OPTS","link":null,"label":"iteration_opts"},{"name":"custom_cfg","type":"CUSTOM_CFG","link":null,"label":"custom_cfg"},{"name":"sigma_schedule","type":"SIGMA_SCHEDULE","link":null,"label":"sigma_schedule"},{"name":"image_inject","type":"IMAGE_INJECT","link":null,"label":"image_inject"},{"name":"seed_override","type":"INT","link":null,"widget":{"name":"seed_override"},"label":"seed_override"}],"outputs":[{"name":"settings","type":"SAMPLE_SETTINGS","links":[14],"shape":3,"label":"settings"}],"properties":{"Node name for S&R":"ADE_AnimateDiffSamplingSettings"},"widgets_values":[0,"FreeNoise","comfy",0,0,false,""]},{"id":16,"type":"BatchPromptScheduleLatentInput","pos":[4405,3140],"size":{"0":455,"1":470},"flags":{},"order":19,"mode":0,"inputs":[{"name":"clip","type":"CLIP","link":19,"label":"clip"},{"name":"num_latents","type":"LATENT","link":20,"label":"num_latents"},{"name":"pre_text","type":"STRING","link":22,"slot_index":2,"widget":{"name":"pre_text"},"label":"pre_text"},{"name":"app_text","type":"STRING","link":null,"widget":{"name":"app_text"},"label":"app_text"},{"name":"pw_a","type":"FLOAT","link":null,"widget":{"name":"pw_a"},"label":"pw_a"},{"name":"pw_b","type":"FLOAT","link":null,"widget":{"name":"pw_b"},"label":"pw_b"},{"name":"pw_c","type":"FLOAT","link":null,"widget":{"name":"pw_c"},"label":"pw_c"},{"name":"pw_d","type":"FLOAT","link":null,"widget":{"name":"pw_d"},"label":"pw_d"}],"outputs":[{"name":"POS","type":"CONDITIONING","links":[24,35],"slot_index":0,"shape":3,"label":"POS"},{"name":"NEG","type":"CONDITIONING","links":[25,36],"slot_index":1,"shape":3,"label":"NEG"},{"name":"INPUT_LATENTS","type":"LATENT","links":[26,37],"slot_index":2,"shape":3,"label":"INPUT_LATENTS"}],"properties":{"Node name for S&R":"BatchPromptScheduleLatentInput"},"widgets_values":["\"0\":\"neutral\",\n\"7\":\"(eyes closed:1.3)\",\n\"15\":\"eyes open\",\n\"23\":\"(red hair:1.3)\",\n\"31\":\"(eyes closed:1.3)\",\n\"47\":\"eyes open\"",false,"close up shot,","",0,0,0,0,0,0]},{"id":17,"type":"PrimitiveNode","pos":[3985,3665],"size":{"0":210,"1":75},"flags":{},"order":6,"mode":0,"outputs":[{"name":"STRING","type":"STRING","links":[22],"widget":{"name":"pre_text"},"label":"STRING"}],"title":"pre_text","properties":{"Run widget replace on values":false},"widgets_values":["close up shot,"]},{"id":18,"type":"KSampler","pos":[4985,3175],"size":{"0":315,"1":262},"flags":{},"order":25,"mode":0,"inputs":[{"name":"model","type":"MODEL","link":23,"label":"model"},{"name":"positive","type":"CONDITIONING","link":24,"label":"positive"},{"name":"negative","type":"CONDITIONING","link":25,"label":"negative"},{"name":"latent_image","type":"LATENT","link":26,"label":"latent_image"}],"outputs":[{"name":"LATENT","type":"LATENT","links":[27],"slot_index":0,"shape":3,"label":"LATENT"}],"properties":{"Node name for S&R":"KSampler"},"widgets_values":[7,"fixed",20,7,"dpmpp_2m","karras",1]},{"id":19,"type":"VAEDecode","pos":[5395,3220],"size":{"0":210,"1":46},"flags":{},"order":27,"mode":0,"inputs":[{"name":"samples","type":"LATENT","link":27,"label":"samples"},{"name":"vae","type":"VAE","link":28,"label":"vae"}],"outputs":[{"name":"IMAGE","type":"IMAGE","links":[29,42,53],"slot_index":0,"shape":3,"label":"IMAGE"}],"properties":{"Node name for S&R":"VAEDecode"}},{"id":20,"type":"VHS_VideoCombine","pos":[6410,2245],"size":[315,765],"flags":{},"order":29,"mode":0,"inputs":[{"name":"images","type":"IMAGE","link":29,"label":"images"},{"name":"audio","type":"AUDIO","link":null,"label":"audio"},{"name":"meta_batch","type":"VHS_BatchManager","link":null,"label":"meta_batch"},{"name":"vae","type":"VAE","link":null,"label":"vae"}],"outputs":[{"name":"Filenames","type":"VHS_FILENAMES","links":null,"shape":3,"label":"Filenames"}],"properties":{"Node name for S&R":"VHS_VideoCombine"},"widgets_values":{"frame_rate":8,"loop_count":0,"filename_prefix":"AnimateDiff","format":"video/h264-mp4","pix_fmt":"yuv420p","crf":19,"save_metadata":true,"pingpong":false,"save_output":true,"videopreview":{"hidden":false,"paused":false,"params":{"filename":"AnimateDiff_00726.mp4","subfolder":"","type":"output","format":"video/h264-mp4","frame_rate":8}}}},{"id":21,"type":"BatchValueSchedule","pos":[2670,3150],"size":{"0":385,"1":295},"flags":{},"order":13,"mode":0,"inputs":[{"name":"max_frames","type":"INT","link":30,"widget":{"name":"max_frames"},"label":"max_frames"}],"outputs":[{"name":"FLOAT","type":"FLOAT","links":[31],"slot_index":0,"shape":3,"label":"FLOAT"},{"name":"INT","type":"INT","links":null,"shape":3,"label":"INT"}],"properties":{"Node name for S&R":"BatchValueSchedule"},"widgets_values":["0:(0.9),\n7:(0.8),\n15:(0.9),\n31:(0.7),\n47:(0.9),\n63:(0.7)",48,false]},{"id":22,"type":"ADE_MultivalDynamicFloatInput","pos":[3140,3165],"size":{"0":235.1999969482422,"1":58},"flags":{},"order":15,"mode":0,"inputs":[{"name":"mask_optional","type":"MASK","link":null,"label":"mask_optional"},{"name":"float_val","type":"FLOAT","link":31,"widget":{"name":"float_val"},"label":"float_val"}],"outputs":[{"name":"MULTIVAL","type":"MULTIVAL","links":[32],"slot_index":0,"shape":3,"label":"MULTIVAL"}],"properties":{"Node name for S&R":"ADE_MultivalDynamicFloatInput"},"widgets_values":[1,""]},{"id":23,"type":"ADE_InputPIA_Multival","pos":[3150,3275],"size":{"0":235.1999969482422,"1":26},"flags":{},"order":18,"mode":0,"inputs":[{"name":"multival","type":"MULTIVAL","link":32,"label":"multival"}],"outputs":[{"name":"PIA_INPUT","type":"PIA_INPUT","links":[33],"slot_index":0,"shape":3,"label":"PIA_INPUT"}],"properties":{"Node name for S&R":"ADE_InputPIA_Multival"}},{"id":24,"type":"VHS_VideoCombine","pos":[6200,3130],"size":[315,545],"flags":{},"order":33,"mode":0,"inputs":[{"name":"images","type":"IMAGE","link":43,"label":"images"},{"name":"audio","type":"AUDIO","link":null,"label":"audio"},{"name":"meta_batch","type":"VHS_BatchManager","link":null,"label":"meta_batch"},{"name":"vae","type":"VAE","link":null,"label":"vae"}],"outputs":[{"name":"Filenames","type":"VHS_FILENAMES","links":null,"shape":3,"label":"Filenames"}],"properties":{"Node name for S&R":"VHS_VideoCombine"},"widgets_values":{"frame_rate":8,"loop_count":0,"filename_prefix":"AnimateDiff","format":"video/h264-mp4","pix_fmt":"yuv420p","crf":19,"save_metadata":true,"pingpong":false,"save_output":true,"videopreview":{"hidden":false,"paused":false,"params":{"filename":"AnimateDiff_00727.mp4","subfolder":"","type":"output","format":"video/h264-mp4","frame_rate":8}}}},{"id":25,"type":"KSampler","pos":[4990,3515],"size":{"0":315,"1":262},"flags":{},"order":26,"mode":0,"inputs":[{"name":"model","type":"MODEL","link":34,"label":"model"},{"name":"positive","type":"CONDITIONING","link":35,"label":"positive"},{"name":"negative","type":"CONDITIONING","link":36,"label":"negative"},{"name":"latent_image","type":"LATENT","link":37,"label":"latent_image"}],"outputs":[{"name":"LATENT","type":"LATENT","links":[38],"slot_index":0,"shape":3,"label":"LATENT"}],"properties":{"Node name for S&R":"KSampler"},"widgets_values":[7,"fixed",20,7,"euler","sgm_uniform",1]},{"id":26,"type":"VAEDecode","pos":[5410,3475],"size":{"0":210,"1":46},"flags":{},"order":28,"mode":0,"inputs":[{"name":"samples","type":"LATENT","link":38,"label":"samples"},{"name":"vae","type":"VAE","link":39,"label":"vae"}],"outputs":[{"name":"IMAGE","type":"IMAGE","links":[41],"slot_index":0,"shape":3,"label":"IMAGE"}],"properties":{"Node name for S&R":"VAEDecode"}},{"id":27,"type":"ImageConcatMulti","pos":[5715,3315],"size":{"0":210,"1":150},"flags":{},"order":31,"mode":0,"inputs":[{"name":"image_1","type":"IMAGE","link":42,"label":"image_1"},{"name":"image_2","type":"IMAGE","link":41,"label":"image_2"}],"outputs":[{"name":"images","type":"IMAGE","links":[43],"slot_index":0,"shape":3,"label":"images"}],"properties":{},"widgets_values":[2,"right",false,null]},{"id":31,"type":"ICLightConditioning","pos":[4900,2530],"size":{"0":342.5999755859375,"1":138},"flags":{},"order":34,"mode":0,"inputs":[{"name":"positive","type":"CONDITIONING","link":48,"label":"positive"},{"name":"negative","type":"CONDITIONING","link":49,"label":"negative"},{"name":"vae","type":"VAE","link":52,"label":"vae"},{"name":"foreground","type":"LATENT","link":55,"label":"foreground"},{"name":"opt_background","type":"LATENT","link":null,"label":"opt_background"}],"outputs":[{"name":"positive","type":"CONDITIONING","links":[57],"slot_index":0,"shape":3,"label":"positive"},{"name":"negative","type":"CONDITIONING","links":[58],"slot_index":1,"shape":3,"label":"negative"},{"name":"empty_latent","type":"LATENT","links":null,"shape":3,"label":"empty_latent"}],"properties":{"Node name for S&R":"ICLightConditioning"},"widgets_values":[0.18215]},{"id":32,"type":"CLIPTextEncode","pos":[4385,2305],"size":{"0":400,"1":200},"flags":{},"order":11,"mode":0,"inputs":[{"name":"clip","type":"CLIP","link":50,"label":"clip"}],"outputs":[{"name":"CONDITIONING","type":"CONDITIONING","links":[48],"shape":3,"label":"CONDITIONING"}],"properties":{"Node name for S&R":"CLIPTextEncode"},"widgets_values":["spot light"]},{"id":33,"type":"CLIPTextEncode","pos":[4405,2585],"size":{"0":400,"1":200},"flags":{},"order":12,"mode":0,"inputs":[{"name":"clip","type":"CLIP","link":51,"label":"clip"}],"outputs":[{"name":"CONDITIONING","type":"CONDITIONING","links":[49],"slot_index":0,"shape":3,"label":"CONDITIONING"}],"properties":{"Node name for S&R":"CLIPTextEncode"},"widgets_values":["worst quality,bad quality"]},{"id":34,"type":"ImpactImageBatchToImageList","pos":[4435,2985],"size":{"0":210,"1":26},"flags":{},"order":30,"mode":0,"inputs":[{"name":"image","type":"IMAGE","link":53,"label":"image"}],"outputs":[{"name":"IMAGE","type":"IMAGE","links":[54],"slot_index":0,"shape":6,"label":"IMAGE"}],"properties":{"Node name for S&R":"ImpactImageBatchToImageList"}},{"id":35,"type":"VAEEncode","pos":[4410,2855],"size":{"0":210,"1":46},"flags":{},"order":32,"mode":0,"inputs":[{"name":"pixels","type":"IMAGE","link":54,"label":"pixels"},{"name":"vae","type":"VAE","link":56,"label":"vae"}],"outputs":[{"name":"LATENT","type":"LATENT","links":[55],"slot_index":0,"shape":3,"label":"LATENT"}],"properties":{"Node name for S&R":"VAEEncode"}},{"id":36,"type":"KSampler","pos":[5560,2370],"size":{"0":315,"1":262},"flags":{},"order":35,"mode":0,"inputs":[{"name":"model","type":"MODEL","link":59,"label":"model"},{"name":"positive","type":"CONDITIONING","link":57,"label":"positive"},{"name":"negative","type":"CONDITIONING","link":58,"label":"negative"},{"name":"latent_image","type":"LATENT","link":66,"label":"latent_image"}],"outputs":[{"name":"LATENT","type":"LATENT","links":[68],"slot_index":0,"shape":3,"label":"LATENT"}],"properties":{"Node name for S&R":"KSampler"},"widgets_values":[1111265175486781,"randomize",20,2,"euler","sgm_uniform",0.9]},{"id":37,"type":"LoadAndApplyICLightUnet","pos":[4875,2345],"size":{"0":315,"1":58},"flags":{},"order":10,"mode":0,"inputs":[{"name":"model","type":"MODEL","link":60,"label":"model"}],"outputs":[{"name":"MODEL","type":"MODEL","links":[59],"slot_index":0,"shape":3,"label":"MODEL"}],"properties":{"Node name for S&R":"LoadAndApplyICLightUnet"},"widgets_values":["IC-Light\\iclight_sd15_fc_unet_ldm.safetensors"]},{"id":38,"type":"SolidMask","pos":[4665,2855],"size":{"0":315,"1":105},"flags":{},"order":17,"mode":0,"inputs":[{"name":"width","type":"INT","link":61,"widget":{"name":"width"},"label":"width"},{"name":"height","type":"INT","link":62,"widget":{"name":"height"},"label":"height"}],"outputs":[{"name":"MASK","type":"MASK","links":[63],"slot_index":0,"shape":3,"label":"MASK"}],"properties":{"Node name for S&R":"SolidMask"},"widgets_values":[0.6,512,512]},{"id":39,"type":"MaskToImage","pos":[4935,2725],"size":{"0":210,"1":26},"flags":{},"order":20,"mode":0,"inputs":[{"name":"mask","type":"MASK","link":63,"label":"mask"}],"outputs":[{"name":"IMAGE","type":"IMAGE","links":[64,65],"slot_index":0,"shape":3,"label":"IMAGE"}],"properties":{"Node name for S&R":"MaskToImage"}},{"id":40,"type":"PreviewImage","pos":[5310,2590],"size":{"0":210,"1":245},"flags":{},"order":22,"mode":0,"inputs":[{"name":"images","type":"IMAGE","link":64,"label":"images"}],"properties":{"Node name for S&R":"PreviewImage"}},{"id":41,"type":"VAEEncode","pos":[5295,2435],"size":{"0":210,"1":46},"flags":{},"order":23,"mode":0,"inputs":[{"name":"pixels","type":"IMAGE","link":65,"label":"pixels"},{"name":"vae","type":"VAE","link":67,"label":"vae"}],"outputs":[{"name":"LATENT","type":"LATENT","links":[66],"slot_index":0,"shape":3,"label":"LATENT"}],"properties":{"Node name for S&R":"VAEEncode"}},{"id":42,"type":"VAEDecode","pos":[5620,2700],"size":{"0":210,"1":46},"flags":{},"order":36,"mode":0,"inputs":[{"name":"samples","type":"LATENT","link":68,"label":"samples"},{"name":"vae","type":"VAE","link":69,"label":"vae"}],"outputs":[{"name":"IMAGE","type":"IMAGE","links":[70],"slot_index":0,"shape":3,"label":"IMAGE"}],"properties":{"Node name for S&R":"VAEDecode"}},{"id":43,"type":"ImageListToImageBatch","pos":[5575,2845],"size":{"0":210,"1":26},"flags":{},"order":37,"mode":0,"inputs":[{"name":"images","type":"IMAGE","link":70,"label":"images"}],"outputs":[{"name":"IMAGE","type":"IMAGE","links":[71],"slot_index":0,"shape":3,"label":"IMAGE"}],"properties":{"Node name for S&R":"ImageListToImageBatch"}},{"id":44,"type":"VHS_VideoCombine","pos":[6075,2240],"size":[315,765],"flags":{},"order":38,"mode":0,"inputs":[{"name":"images","type":"IMAGE","link":71,"label":"images"},{"name":"audio","type":"AUDIO","link":null,"label":"audio"},{"name":"meta_batch","type":"VHS_BatchManager","link":null,"label":"meta_batch"},{"name":"vae","type":"VAE","link":null,"label":"vae"}],"outputs":[{"name":"Filenames","type":"VHS_FILENAMES","links":null,"shape":3,"label":"Filenames"}],"properties":{"Node name for S&R":"VHS_VideoCombine"},"widgets_values":{"frame_rate":8,"loop_count":0,"filename_prefix":"AnimateDiff","format":"video/h264-mp4","pix_fmt":"yuv420p","crf":19,"save_metadata":true,"pingpong":false,"save_output":true,"videopreview":{"hidden":false,"paused":false,"params":{"filename":"AnimateDiff_00728.mp4","subfolder":"","type":"output","format":"video/h264-mp4","frame_rate":8}}}}],"links":[[1,1,0,2,0,"IMAGE"],[2,2,0,3,0,"IMAGE"],[3,3,0,4,0,"INT"],[4,3,1,4,1,"INT"],[6,5,0,4,2,"INT"],[7,7,0,6,0,"MODEL"],[8,8,0,6,1,"M_MODELS"],[9,9,0,8,0,"MOTION_MODEL_ADE"],[10,2,0,8,1,"IMAGE"],[11,10,0,8,2,"VAE"],[13,12,0,6,2,"CONTEXT_OPTIONS"],[14,13,0,6,3,"SAMPLE_SETTINGS"],[19,7,1,16,0,"CLIP"],[20,4,0,16,1,"LATENT"],[22,17,0,16,2,"STRING"],[23,6,0,18,0,"MODEL"],[24,16,0,18,1,"CONDITIONING"],[25,16,1,18,2,"CONDITIONING"],[26,16,2,18,3,"LATENT"],[27,18,0,19,0,"LATENT"],[28,10,0,19,1,"VAE"],[29,19,0,20,0,"IMAGE"],[30,5,0,21,0,"INT"],[31,21,0,22,1,"FLOAT"],[32,22,0,23,0,"MULTIVAL"],[33,23,0,8,3,"PIA_INPUT"],[34,6,0,25,0,"MODEL"],[35,16,0,25,1,"CONDITIONING"],[36,16,1,25,2,"CONDITIONING"],[37,16,2,25,3,"LATENT"],[38,25,0,26,0,"LATENT"],[39,10,0,26,1,"VAE"],[41,26,0,27,1,"IMAGE"],[42,19,0,27,0,"IMAGE"],[43,27,0,24,0,"IMAGE"],[48,32,0,31,0,"CONDITIONING"],[49,33,0,31,1,"CONDITIONING"],[50,7,1,32,0,"CLIP"],[51,7,1,33,0,"CLIP"],[52,10,0,31,2,"VAE"],[53,19,0,34,0,"IMAGE"],[54,34,0,35,0,"IMAGE"],[55,35,0,31,3,"LATENT"],[56,10,0,35,1,"VAE"],[57,31,0,36,1,"CONDITIONING"],[58,31,1,36,2,"CONDITIONING"],[59,37,0,36,0,"MODEL"],[60,7,0,37,0,"MODEL"],[61,3,0,38,0,"INT"],[62,3,1,38,1,"INT"],[63,38,0,39,0,"MASK"],[64,39,0,40,0,"IMAGE"],[65,39,0,41,0,"IMAGE"],[66,41,0,36,3,"LATENT"],[67,10,0,41,1,"VAE"],[68,36,0,42,0,"LATENT"],[69,10,0,42,1,"VAE"],[70,42,0,43,0,"IMAGE"],[71,43,0,44,0,"IMAGE"]],"groups":[{"title":"Image","bounding":[2655,2223,1575,429],"color":"#3f789e","font_size":24,"locked":false},{"title":"AnimateDiff-PIA","bounding":[2650,2675,1585,905],"color":"#A88","font_size":24,"locked":false},{"title":"IC-Light","bounding":[4320,2230,1635,820],"color":"#fff8a8","font_size":24,"locked":false}],"config":{},"extra":{},"version":0.4}

Additional Context

(Please add any additional context or steps to reproduce the error here)

Logs

Other

what could be the problem? thanks

@Solenyalyl Solenyalyl added the User Support A user needs help with something, probably not a bug. label Jan 21, 2025
@ltdrdata ltdrdata added the Cannot Reproduce Cannot reproduce the bug label Jan 22, 2025
@ltdrdata
Copy link
Collaborator

Is ComfyUI and all custom nodes up to date?

@Refl-ex
Copy link

Refl-ex commented Jan 23, 2025

Try to switch ComfyUI_FizzNodes to v1.0.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Cannot Reproduce Cannot reproduce the bug User Support A user needs help with something, probably not a bug.
Projects
None yet
Development

No branches or pull requests

3 participants