ControlFoley Video-to-Audio

Tools

• controlfoley_run_controlfoley Generate Foley audio for a video (and/or from text / reference audio). ControlFoley is a unified, controllable video-to-audio model. Depending on which inputs you supply it runs different tasks: - video + prompt -> Text-Video-to-Audio (TV2A) / text-controlled (TC-V2A) - video + reference audio -> Audio-Controlled V2A (AC-V2A, sound-style control) - video only -> Video-to-Audio (V2A) - prompt only -> Text-to-Audio (T2A) If a user passes a file as an input, use the upload_file_to_gradio tool, if present, to upload the file to the gradio app and create a Gradio File Input. Then use the returned path as the input to the tool. Returns: (video_with_audio, audio_file) — an mp4 muxing the input video with the, generated audio (when a video was given), and the standalone audio clip.
• controlfoley_run_controlfoley_1 Generate Foley audio for a video (and/or from text / reference audio). ControlFoley is a unified, controllable video-to-audio model. Depending on which inputs you supply it runs different tasks: - video + prompt -> Text-Video-to-Audio (TV2A) / text-controlled (TC-V2A) - video + reference audio -> Audio-Controlled V2A (AC-V2A, sound-style control) - video only -> Video-to-Audio (V2A) - prompt only -> Text-to-Audio (T2A) If a user passes a file as an input, use the upload_file_to_gradio tool, if present, to upload the file to the gradio app and create a Gradio File Input. Then use the returned path as the input to the tool. Returns: (video_with_audio, audio_file) — an mp4 muxing the input video with the, generated audio (when a video was given), and the standalone audio clip.

No tool matches.

As the server's own listing gives them. We never call a tool.