Hybrid GUI-MCP Computer-Use Agent

by hugging-appsco.huggingface.hugging-apps/hybrid-routing-agent

  • Remote endpoint
  • 1 tool

Tools

  • hybrid_routing_agent_predict Predict the next computer-use action for a desktop screenshot. The hybrid policy chooses between a low-level GUI action (`computer_use`: click / type / scroll / drag / terminate) and a high-level MCP tool call (e.g. `libreoffice_calc.transpose_range`), and the chosen action is drawn on top of the screenshot. If a user passes a file as an input, use the upload_file_to_gradio tool, if present, to upload the file to the gradio app and create a Gradio File Input. Then use the returned path as the input to the tool. Returns: Annotated screenshot, routing summary, raw model output, and the exposed tool list.

As the server's own listing gives them. We never call a tool.