VLArm MCP Server

Example Use Cases

• 1

  Control a robotic arm using natural language commands.

• 2

  Integrate local LLMs with robotic hardware via MCP protocol.

• 3

  A foundation to add vision and audio capabilities to robotic control.

Description

This MCP server allows integration of a locally running Large Language Model (LLM) through Ollama to control a robotic arm (HuggingFace's SO-101) by interpreting language commands. It facilitates autonomous decision-making for the robot in industrial settings, with planned future enhancements to include vision and listening capabilities. The server uses Anthropic's open-source MCP protocol and the ollmcp client for communication between the LLM and the robot.