Isaac Sim MCP Server

Example Use Cases

• 1

  Programmatically create physics-enabled scenes and place objects or obstacles in NVIDIA Isaac Sim using simple natural language commands.

• 2

  Spawn and control robots (franka, jetbot, carter, g1, go1) and perform scripted movement or simulation operations through MCP tools.

• 3

  Generate or import 3D assets (Beaver3D/NVIDIA-supported) and run Omni Kit commands or arbitrary Python code inside Isaac Sim for rapid prototyping.

Description

This repository provides an MCP-compatible server and an Isaac Sim extension that translate conversational inputs into simulation actions (scene creation, robot spawning, physics setup, Omniverse Kit commands, and arbitrary script execution). It integrates with Cursor AI for interactive code preview and supports Beaver3D/NVIDIA model APIs for 3D asset generation. The toolchain targets rapid prototyping and programmatic control of Isaac Sim (requires Isaac Sim 4.2+, Python 3.9+, and uv/mcp tooling).