Sa2VA Simple Demo

Tools

• Sa2VA_simple_demo_image_vision Perform image-based visual question answering and segmentation. This function takes an image and a text prompt (instruction) as input, processes the image with a multimodal model, and returns a textual answer. If the model response includes a segmentation token ("[SEG]"), and segmentation visualization is available, a visual output is also generated. If a user passes a file as an input, use the upload_file_to_gradio tool, if present, to upload the file to the gradio app and create a Gradio File Input. Then use the returned path as the input to the tool. Returns: Tuple[str, Optional[str]]:, - A textual answer generated by the model., - If segmentation is requested (indicated by '[SEG]' in the answer), the path to the segmented image file;, otherwise, returns None.
• Sa2VA_simple_demo_video_vision Perform video-based visual question answering and segmentation. This function analyzes a video file using a multimodal vision-language model. It extracts frames based on a sampling interval, feeds the frames and prompt to the model, and returns a response. If segmentation is requested, it produces two videos: one with overlaid masks, and one with binary masks only. If a user passes a file as an input, use the upload_file_to_gradio tool, if present, to upload the file to the gradio app and create a Gradio File Input. Then use the returned path as the input to the tool. Returns: Tuple[str, Optional[str], Optional[str]]:, - The model-generated textual answer., - If segmentation is requested (contains '[SEG]'), the path to the segmented output video file., - If segmentation is requested, the path to a binary mask-only video; otherwise, None.

No tool matches.

As the server's own listing gives them. We never call a tool.