Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- {
- "id": "c343c592-e2ec-452b-8621-e8861a4e51c6",
- "revision": 0,
- "last_node_id": 122,
- "last_link_id": 197,
- "nodes": [
- {
- "id": 114,
- "type": "Note",
- "pos": [
- 2260,
- -930
- ],
- "size": [
- 490,
- 170
- ],
- "flags": {},
- "order": 0,
- "mode": 0,
- "inputs": [],
- "outputs": [],
- "title": "The MMAudio Sampler",
- "properties": {},
- "widgets_values": [
- "Leave the cfg alone as 4.5 is recommended.\n\n30-50 steps, I just do 50 for the best quality.\n\nWhile I do use the NSFW version of MMAudio, prompting does seem to work. You'll notice a lot of moaning no matter what you do, but it really depends on the seed. You can try different prompt styles and you'll get very different outputs. Highly recommend doing multiple runs until you get the sound you like for your video."
- ],
- "color": "#432",
- "bgcolor": "#653"
- },
- {
- "id": 110,
- "type": "MMAudioFeatureUtilsLoader",
- "pos": [
- 2830,
- -1200
- ],
- "size": [
- 487.2332763671875,
- 154
- ],
- "flags": {},
- "order": 1,
- "mode": 0,
- "inputs": [
- {
- "name": "bigvgan_vocoder_model",
- "shape": 7,
- "type": "VOCODER_MODEL",
- "link": null
- }
- ],
- "outputs": [
- {
- "name": "mmaudio_featureutils",
- "type": "MMAUDIO_FEATUREUTILS",
- "links": [
- 189
- ]
- }
- ],
- "properties": {
- "cnr_id": "comfyui-mmaudio",
- "ver": "841b307095f3cdc448d940a5787bc36706e49f1d",
- "Node name for S&R": "MMAudioFeatureUtilsLoader"
- },
- "widgets_values": [
- "mmaudio_vae_44k_fp16.safetensors",
- "mmaudio_synchformer_fp16.safetensors",
- "apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors",
- "44k",
- "fp16"
- ],
- "color": "#222",
- "bgcolor": "#000"
- },
- {
- "id": 112,
- "type": "VHS_VideoInfo",
- "pos": [
- 2560,
- -1310
- ],
- "size": [
- 260,
- 260
- ],
- "flags": {},
- "order": 11,
- "mode": 0,
- "inputs": [
- {
- "name": "video_info",
- "type": "VHS_VIDEOINFO",
- "link": 196
- }
- ],
- "outputs": [
- {
- "name": "source_fps🟨",
- "type": "FLOAT",
- "links": []
- },
- {
- "name": "source_frame_count🟨",
- "type": "INT",
- "links": []
- },
- {
- "name": "source_duration🟨",
- "type": "FLOAT",
- "links": []
- },
- {
- "name": "source_width🟨",
- "type": "INT",
- "links": []
- },
- {
- "name": "source_height🟨",
- "type": "INT",
- "links": []
- },
- {
- "name": "loaded_fps🟦",
- "type": "FLOAT",
- "slot_index": 5,
- "links": []
- },
- {
- "name": "loaded_frame_count🟦",
- "type": "INT",
- "slot_index": 6,
- "links": []
- },
- {
- "name": "loaded_duration🟦",
- "type": "FLOAT",
- "slot_index": 7,
- "links": [
- 192
- ]
- },
- {
- "name": "loaded_width🟦",
- "type": "INT",
- "links": []
- },
- {
- "name": "loaded_height🟦",
- "type": "INT",
- "links": []
- }
- ],
- "properties": {
- "cnr_id": "comfyui-videohelpersuite",
- "ver": "6e7f63867584bb1fb4944d36172e7f98436da9a1",
- "Node name for S&R": "VHS_VideoInfo"
- },
- "widgets_values": {},
- "color": "#222",
- "bgcolor": "#000"
- },
- {
- "id": 116,
- "type": "Note",
- "pos": [
- 1740,
- -1330
- ],
- "size": [
- 790,
- 290
- ],
- "flags": {},
- "order": 2,
- "mode": 0,
- "inputs": [],
- "outputs": [],
- "title": "Backend Stuff",
- "properties": {},
- "widgets_values": [
- "All of these files should be downloaded to ComfyUI\\models\\mmaudio\n\nLinks for the models are as follows:\n\nMMAudio Model: \nhttps://huggingface.co/phazei/NSFW_MMaudio/resolve/main/mmaudio_large_44k_nsfw_gold_8.5k_final_fp16.safetensors?download=true\n\nMMAudio VAE: \nhttps://huggingface.co/Kijai/MMAudio_safetensors/resolve/5984623e6b436818c6ff287ef6eec93e3e05aa3f/mmaudio_vae_44k_fp16.safetensors\n\nMMAudio Synchformer: \nhttps://huggingface.co/Kijai/MMAudio_safetensors/resolve/main/mmaudio_synchformer_fp16.safetensors\n\nMMAudio CLIP: \nhttps://huggingface.co/Kijai/MMAudio_safetensors/resolve/main/apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors"
- ],
- "color": "#432",
- "bgcolor": "#653"
- },
- {
- "id": 111,
- "type": "MMAudioModelLoader",
- "pos": [
- 2830,
- -1320
- ],
- "size": [
- 490,
- 82
- ],
- "flags": {},
- "order": 3,
- "mode": 0,
- "inputs": [],
- "outputs": [
- {
- "name": "mmaudio_model",
- "type": "MMAUDIO_MODEL",
- "slot_index": 0,
- "links": [
- 190
- ]
- }
- ],
- "properties": {
- "cnr_id": "comfyui-mmaudio",
- "ver": "841b307095f3cdc448d940a5787bc36706e49f1d",
- "Node name for S&R": "MMAudioModelLoader"
- },
- "widgets_values": [
- "mmaudio_large_44k_nsfw_gold_8.5k_final_fp16.safetensors",
- "fp16"
- ],
- "color": "#222",
- "bgcolor": "#000"
- },
- {
- "id": 121,
- "type": "Fast Groups Bypasser (rgthree)",
- "pos": [
- 1490,
- -1540
- ],
- "size": [
- 440,
- 106
- ],
- "flags": {},
- "order": 4,
- "mode": 0,
- "inputs": [],
- "outputs": [
- {
- "name": "OPT_CONNECTION",
- "type": "*",
- "links": null
- }
- ],
- "title": "Enable/Disable As You Need",
- "properties": {
- "matchColors": "",
- "matchTitle": "",
- "showNav": true,
- "showAllGraphs": true,
- "sort": "position",
- "customSortAlphabet": "",
- "toggleRestriction": "default"
- },
- "color": "#322",
- "bgcolor": "#533"
- },
- {
- "id": 122,
- "type": "Note",
- "pos": [
- 870,
- -1340
- ],
- "size": [
- 270,
- 200
- ],
- "flags": {},
- "order": 5,
- "mode": 0,
- "inputs": [],
- "outputs": [],
- "title": "Interpolation",
- "properties": {},
- "widgets_values": [
- "WAN 2.2 videos generate natively at 16fps (or at least that's what I gen at). Your video needs to be interpolated up to 24fps to get audio working through MMAudio. I use the node below because it allows for fractional multiples of fps (16->24 instead of a clean 2x interpolation of 16 -> 32). You can also use other interpolation nodes or Topaz if you'd like."
- ],
- "color": "#432",
- "bgcolor": "#653"
- },
- {
- "id": 113,
- "type": "Note",
- "pos": [
- 1740,
- -930
- ],
- "size": [
- 470,
- 160
- ],
- "flags": {},
- "order": 6,
- "mode": 0,
- "inputs": [],
- "outputs": [],
- "title": "Your Video Input",
- "properties": {},
- "widgets_values": [
- "Feel free to drag-and-drop your input video (the one you just interpolated up to 24fps using RIFE) into this node or click the 'choose video to upload' button at the bottom.\n\nYour video NEEDS TO BE 24fps to work with MMAudio. This is due to how the synchformer/vae/clip work. "
- ],
- "color": "#432",
- "bgcolor": "#653"
- },
- {
- "id": 115,
- "type": "Note",
- "pos": [
- 2800,
- -930
- ],
- "size": [
- 560,
- 170
- ],
- "flags": {},
- "order": 7,
- "mode": 0,
- "inputs": [],
- "outputs": [],
- "title": "Your Video Output",
- "properties": {},
- "widgets_values": [
- "Resulting video will be saved to MMAudio\\MMAudio in your ComfyUI output folder @ 24fps. \n\nFeel free to interpolate to 30fps (using RIFE/FILM/Topaz) if you want, and then your video is done!"
- ],
- "color": "#432",
- "bgcolor": "#653"
- },
- {
- "id": 120,
- "type": "VHS_VideoCombine",
- "pos": [
- 1150,
- -1330
- ],
- "size": [
- 530,
- 334
- ],
- "flags": {},
- "order": 12,
- "mode": 4,
- "inputs": [
- {
- "name": "images",
- "type": "IMAGE",
- "link": 194
- },
- {
- "name": "audio",
- "shape": 7,
- "type": "AUDIO",
- "link": null
- },
- {
- "name": "meta_batch",
- "shape": 7,
- "type": "VHS_BatchManager",
- "link": null
- },
- {
- "name": "vae",
- "shape": 7,
- "type": "VAE",
- "link": null
- }
- ],
- "outputs": [
- {
- "name": "Filenames",
- "type": "VHS_FILENAMES",
- "links": null
- }
- ],
- "properties": {
- "cnr_id": "comfyui-videohelpersuite",
- "ver": "1.7.7",
- "Node name for S&R": "VHS_VideoCombine"
- },
- "widgets_values": {
- "frame_rate": 24,
- "loop_count": 0,
- "filename_prefix": "AnimateDiff",
- "format": "video/h264-mp4",
- "pix_fmt": "yuv420p",
- "crf": 19,
- "save_metadata": true,
- "trim_to_audio": false,
- "pingpong": false,
- "save_output": true,
- "videopreview": {
- "hidden": false,
- "paused": false,
- "params": {}
- }
- }
- },
- {
- "id": 91,
- "type": "VHS_LoadVideo",
- "pos": [
- 1740,
- -590
- ],
- "size": [
- 480,
- 784
- ],
- "flags": {},
- "order": 8,
- "mode": 4,
- "inputs": [
- {
- "name": "meta_batch",
- "shape": 7,
- "type": "VHS_BatchManager",
- "link": null
- },
- {
- "name": "vae",
- "shape": 7,
- "type": "VAE",
- "link": null
- }
- ],
- "outputs": [
- {
- "name": "IMAGE",
- "type": "IMAGE",
- "slot_index": 0,
- "links": []
- },
- {
- "name": "frame_count",
- "type": "INT",
- "links": null
- },
- {
- "name": "audio",
- "type": "AUDIO",
- "links": null
- },
- {
- "name": "video_info",
- "type": "VHS_VIDEOINFO",
- "slot_index": 3,
- "links": []
- }
- ],
- "properties": {
- "cnr_id": "comfyui-videohelpersuite",
- "ver": "6e7f63867584bb1fb4944d36172e7f98436da9a1",
- "Node name for S&R": "VHS_LoadVideo"
- },
- "widgets_values": {
- "video": "ComfyUI_435885332.mp4",
- "force_rate": 24,
- "custom_width": 0,
- "custom_height": 0,
- "frame_load_cap": 0,
- "skip_first_frames": 0,
- "select_every_nth": 1,
- "format": "Wan",
- "choose video to upload": "image",
- "videopreview": {
- "hidden": false,
- "paused": true,
- "params": {
- "frame_load_cap": 0,
- "skip_first_frames": 0,
- "force_rate": 24,
- "filename": "ComfyUI_435885332.mp4",
- "type": "input",
- "format": "video/mp4",
- "select_every_nth": 1
- },
- "muted": false
- }
- },
- "color": "#332922",
- "bgcolor": "#593930"
- },
- {
- "id": 117,
- "type": "VHS_LoadVideo",
- "pos": [
- 350,
- -1330
- ],
- "size": [
- 500,
- 804
- ],
- "flags": {},
- "order": 9,
- "mode": 0,
- "inputs": [
- {
- "name": "meta_batch",
- "shape": 7,
- "type": "VHS_BatchManager",
- "link": null
- },
- {
- "name": "vae",
- "shape": 7,
- "type": "VAE",
- "link": null
- }
- ],
- "outputs": [
- {
- "name": "IMAGE",
- "type": "IMAGE",
- "links": [
- 193
- ]
- },
- {
- "name": "frame_count",
- "type": "INT",
- "links": null
- },
- {
- "name": "audio",
- "type": "AUDIO",
- "links": null
- },
- {
- "name": "video_info",
- "type": "VHS_VIDEOINFO",
- "links": [
- 196
- ]
- }
- ],
- "properties": {
- "cnr_id": "comfyui-videohelpersuite",
- "ver": "1.7.7",
- "Node name for S&R": "VHS_LoadVideo"
- },
- "widgets_values": {
- "video": "ComfyUI_00018.mp4",
- "force_rate": 16,
- "custom_width": 0,
- "custom_height": 0,
- "frame_load_cap": 0,
- "skip_first_frames": 0,
- "select_every_nth": 1,
- "format": "Wan",
- "choose video to upload": "image",
- "videopreview": {
- "hidden": false,
- "paused": false,
- "params": {
- "filename": "ComfyUI_00018.mp4",
- "type": "input",
- "format": "video/mp4",
- "force_rate": 16,
- "custom_width": 0,
- "custom_height": 0,
- "frame_load_cap": 0,
- "skip_first_frames": 0,
- "select_every_nth": 1
- }
- }
- }
- },
- {
- "id": 92,
- "type": "MMAudioSampler",
- "pos": [
- 2270,
- -700
- ],
- "size": [
- 490,
- 350
- ],
- "flags": {},
- "order": 13,
- "mode": 0,
- "inputs": [
- {
- "name": "mmaudio_model",
- "type": "MMAUDIO_MODEL",
- "link": 190
- },
- {
- "name": "feature_utils",
- "type": "MMAUDIO_FEATUREUTILS",
- "link": 189
- },
- {
- "name": "images",
- "shape": 7,
- "type": "IMAGE",
- "link": 195
- },
- {
- "name": "duration",
- "type": "FLOAT",
- "widget": {
- "name": "duration"
- },
- "link": 192
- }
- ],
- "outputs": [
- {
- "name": "audio",
- "type": "AUDIO",
- "slot_index": 0,
- "links": [
- 171
- ]
- }
- ],
- "properties": {
- "cnr_id": "comfyui-mmaudio",
- "ver": "841b307095f3cdc448d940a5787bc36706e49f1d",
- "Node name for S&R": "MMAudioSampler"
- },
- "widgets_values": [
- 3,
- 50,
- 4.5,
- 829856120613600,
- "randomize",
- "",
- "",
- false,
- false
- ],
- "color": "#223",
- "bgcolor": "#335"
- },
- {
- "id": 119,
- "type": "RIFEInterpolation",
- "pos": [
- 1130,
- -840
- ],
- "size": [
- 270,
- 178
- ],
- "flags": {},
- "order": 10,
- "mode": 0,
- "inputs": [
- {
- "name": "images",
- "type": "IMAGE",
- "link": 193
- }
- ],
- "outputs": [
- {
- "name": "images",
- "type": "IMAGE",
- "links": [
- 194,
- 195,
- 197
- ]
- }
- ],
- "properties": {
- "aux_id": "GACLove/ComfyUI-VFI",
- "ver": "6176a430f12cd16003f4664c1e3c6af8e96cc3c6",
- "Node name for S&R": "RIFEInterpolation"
- },
- "widgets_values": [
- 16,
- 24,
- 1,
- "flownet.pkl",
- 8,
- true
- ]
- },
- {
- "id": 97,
- "type": "VHS_VideoCombine",
- "pos": [
- 2800,
- -710
- ],
- "size": [
- 560,
- 888
- ],
- "flags": {},
- "order": 14,
- "mode": 0,
- "inputs": [
- {
- "name": "images",
- "type": "IMAGE",
- "link": 197
- },
- {
- "name": "audio",
- "shape": 7,
- "type": "AUDIO",
- "link": 171
- },
- {
- "name": "meta_batch",
- "shape": 7,
- "type": "VHS_BatchManager",
- "link": null
- },
- {
- "name": "vae",
- "shape": 7,
- "type": "VAE",
- "link": null
- }
- ],
- "outputs": [
- {
- "name": "Filenames",
- "type": "VHS_FILENAMES",
- "links": null
- }
- ],
- "properties": {
- "cnr_id": "comfyui-videohelpersuite",
- "ver": "6e7f63867584bb1fb4944d36172e7f98436da9a1",
- "Node name for S&R": "VHS_VideoCombine"
- },
- "widgets_values": {
- "frame_rate": 24,
- "loop_count": 0,
- "filename_prefix": "MMAudio\\MMAudio",
- "format": "video/h264-mp4",
- "pix_fmt": "yuv420p",
- "crf": 19,
- "save_metadata": true,
- "trim_to_audio": false,
- "pingpong": false,
- "save_output": false,
- "videopreview": {
- "hidden": false,
- "paused": false,
- "params": {
- "filename": "MMAudio_00002-audio.mp4",
- "subfolder": "MMAudio",
- "type": "temp",
- "format": "video/h264-mp4",
- "frame_rate": 24,
- "workflow": "MMAudio_00002.png",
- "fullpath": "C:\\Users\\Max\\ComfyUI\\ComfyUI\\temp\\MMAudio\\MMAudio_00002-audio.mp4"
- },
- "muted": false
- }
- },
- "color": "#232",
- "bgcolor": "#353"
- }
- ],
- "links": [
- [
- 171,
- 92,
- 0,
- 97,
- 1,
- "AUDIO"
- ],
- [
- 189,
- 110,
- 0,
- 92,
- 1,
- "MMAUDIO_FEATUREUTILS"
- ],
- [
- 190,
- 111,
- 0,
- 92,
- 0,
- "MMAUDIO_MODEL"
- ],
- [
- 192,
- 112,
- 7,
- 92,
- 3,
- "FLOAT"
- ],
- [
- 193,
- 117,
- 0,
- 119,
- 0,
- "IMAGE"
- ],
- [
- 194,
- 119,
- 0,
- 120,
- 0,
- "IMAGE"
- ],
- [
- 195,
- 119,
- 0,
- 92,
- 2,
- "IMAGE"
- ],
- [
- 196,
- 117,
- 3,
- 112,
- 0,
- "VHS_VIDEOINFO"
- ],
- [
- 197,
- 119,
- 0,
- 97,
- 0,
- "IMAGE"
- ]
- ],
- "groups": [
- {
- "id": 2,
- "title": "Step 2: MMAudio",
- "bounding": [
- 1720,
- -1410,
- 1670,
- 1620
- ],
- "color": "#3f789e",
- "font_size": 24,
- "flags": {}
- },
- {
- "id": 3,
- "title": "Step 1: RIFE Frame Interpolation",
- "bounding": [
- 340,
- -1410,
- 1360,
- 1120
- ],
- "color": "#3f789e",
- "font_size": 24,
- "flags": {}
- }
- ],
- "config": {},
- "extra": {
- "ds": {
- "scale": 0.6588450000000011,
- "offset": [
- -60.16730451849055,
- 1579.7759182874972
- ]
- },
- "frontendVersion": "1.30.6",
- "VHS_latentpreview": true,
- "VHS_latentpreviewrate": 0,
- "VHS_MetadataImage": true,
- "VHS_KeepIntermediate": true
- },
- "version": 0.4
- }
Add Comment
Please, Sign In to add comment