3D Scene MCP Server

Example Use Cases

• 1

  Query the current 3D scene and objects (scene://current) to understand world state and object properties.

• 2

  Real-time pointer/intersection feedback (pointer://current) to determine what a user or cursor is pointing at in the scene.

• 3

  Programmatically modify the scene by adding, removing, or updating objects using tools like add-object, remove-object, and update-object.

Description

This project runs a Next.js front-end with a Three.js/React Three Fiber 3D scene and a server that provides both WebSocket real-time messaging and an MCP (Model Context Protocol) SSE endpoint for AI agent integration. The server stores current intersection/pointer state per client, logs what the user is pointing at, and exposes resources (scene://current, pointer://current) plus tools to add, remove, and update objects. It is useful for testing and prototyping agent-driven scene inspection and manipulation (e.g., Claude Desktop via MCP or Super Gateway). Everything runs locally and is intended as a developer/demo integration rather than a hosted production service.