awesome Agentic 3D Modeling 🤖🔧

Let's build agentic framework to create 3D assets! 👀🤖🔧

Curated list of high-quality open-source projects and resources for AI-powered 3D modeling, design, and content generation using agentic approaches.

---

🔬 Research & Academic Projects

Agentic 3D Scene Generation

1. SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation - arXiv 2026 | Dynamic 4D scenes, Blender agents, deterministic verification

2. EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AI - arXiv 2026 | Simulation-ready worlds, physics-validated editing, cross-simulator export

3. MUSE: Agentic 3D Scene Authoring via Memory-Grounded Incremental Requirement Satisfaction - arXiv 2026 | Multi-agent scene construction and editing, memory, verification

4. SceneConductor: 3D Scene Generation from Single Image with Multi-Agent Orchestration - arXiv 2026 | Multi-agent scene construction, planner-guided refinement

5. PhysAgent: Automating Physics-Based 4D Synthesis via Trajectory-Grounded Multi-Agent Feedback - arXiv 2026 | Simulator-in-the-loop agents, force-field generation, trajectory feedback

6. SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenes - ICML 2026 Spotlight | Scene generation, interactive environments

7. SAGE: Scalable Agentic for 3D Generation and Editing - CVPR 2026 | Scene generation, interactive environments

8. Agentic World Modeling - Agentic world modeling, multimodal agents, and world-modeling resources

9. Scene-Weaver: Multi-Scene Choreography for Interactable Virtual Worlds - NeurIPS 2025 | Scene generation, interactive environments

10. IDesign: Product Intelligent Design System Powered by Generative AI and Designers - ECCV 2024 | Generative design, human-AI collaboration

11. SceneTeller: Language-to-3D Scene Generation - ECCV 2024 | Language-to-3D scene, spatial reasoning

12. Holodeck: Language-Driven Scene Construction in Virtual Environments - CVPR 2024 | Language-to-3D scene, spatial reasoning

13. LayoutGPT: Analytical Layout Generation by Coupling LLMs with Geometric Optimizers - NeurIPS 2023 | Layout reasoning

Agentic 3D Object Generation

1. CoGen3D: An Agentic Human-AI Co-Design Pipeline for 3D Asset Generation for Virtual Reality - arXiv 2026 | Conversational co-design, image-to-3D, immersive deployment

2. PhysForge: Agentic Physics-Based 3D Object Generation and Simulation - ICML 2026 | Physics-driven generation, agentic workflow

3. PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Image - CVPR 2026 | Image-to-3D, physical modeling, simulation-ready assets

4. PhysX-Omni: Unified Simulation-Ready Physical 3D Generation | Physical 3D generation, rigid/deformable/articulated objects

5. ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understanding - NeurIPS 2025 Spotlight | Multimodal LLM

6. MeshLLM: Empowering Large Language Models to Progressively Understand and Generate 3D Mesh - ICCV2025 | Multimodal LLM

7. Idea23D: Collaborative LMM Agents for 3D Model Generation from Interleaved Multimodal Inputs - COLING 2025 | Collaborative agents, multimodal input

Executable World Models & Physical Reasoning

1. Code World Model: Coding Agent as World Brain - arXiv 2026 | Coding agent, executable persistent world state, spatiotemporal proxy compilation, video-based world realization

2. Code-as-World: Agentic Discovery of Executable World Representations for Physical Reasoning - Technical Report 2026 | Agentic simulation and verification, executable physical representations, counterfactual rollouts

Agentic (3D) Game Generation/Development

1. GameDevBench: Evaluating Agentic Capabilities Through Game Development - ICML2026 | Multimodal LLM, Game Development, Game Engine

2. OpenGame: Open Agentic Coding for Games | Multimodal LLM, Game Development

🎯 3D Agents & Modeling Frameworks

Vision & CAD Integration

1. NVIDIA-Omniverse/content-agents - AI-powered agents for automating 3D content workflows using VLMs. Analyzes 3D assets and automates workfl

2. jingcheng-chen/rhinomcp - RhinoMCP - Connects Rhino 3D to AI Agent through Model Context Protocol (MCP). Enables agents to control CAD workflows.

3. Elianio/Bynce - 3D design agent framework for generative design tasks.

4. huggingface/meshgen - MeshGen - Use AI Agents to control Blender with natural language. Supports multiple LLM backends with optional LLaMA-Mesh and Hyper3D integration.

5. meshy-dev/meshy-3d-agent - Agent skills for Meshy workflows including text/image-to-3D, retexturing, remeshing, rigging, animation, and printability preparation.

CAD & Engineering Design

1. Shpigford/nurb - Agentic CAD for 3D printing using parametric B-rep solids, exact-geometry printability checks, slicer estimates, stress analysis, and print-ready 3MF export.

2. datadrivenconstruction/cad2data-Revit-IFC-DWG-DGN - AI Agent-enabled workflow for automated conversion of CAD files

3. datadrivenconstruction/OpenConstructionEstimate-DDC-CWICR - Open multilingual construction cost database

4. atopile/atopile - Design circuit boards with code! Get software-like design reuse, validation, version control and collaboration in hardware.

5. assalas/pcb-designer-ai-agent - Intelligent AI-powered PCB design automation tool using ML for component placement and routing optimization.

Game Development Framework

10. Yuan-ManX/ai-game-devtools - Your AI Game Dev Hub - Ultimate resource hub for AI-powered game development tools and frameworks.

Unreal Engine Integration

11. prajwalshettydev/UnrealGenAISupport - Unreal Engine plugin for LLM/GenAI models & MCP UE5 server. Supports OpenAI, Deepseek, Claude

---

🛠️ Design & Simulation Tools

3D Agent Environments & Simulation Platforms

1. google-deepmind/lab - DeepMind Lab, a customizable Quake III-based 3D environment with navigation and puzzle tasks for training and evaluating learning agents.

Autonomous Vehicle & Robotics Simulation

12. truevisionai/designer - Truevision Designer - 3D tool to design roads, intersections and environments for testing autonomous vehicles.

13. rovr-network/ROVR-Open-Dataset - Large-scale open 3D dataset designed for autonomous driving, robotics, and 4D perception tasks.

14. Moonlake's 3D Agent: Computer Use Capabilities For World Modeling

💡 Contributing

Have found a new awesome agentic 3D modeling project? Feel free to submit a PR!

Guidelines for contributions:

• Include project name, GitHub link, and dynamic star badge
• Add brief description (1-2 sentences)
• Include conference/venue for research papers
• Categorize appropriately
• Include key technologies used

Format for new entries:

N. [Project Name](link) - Brief description
   <a href="link" title="GitHub Repo">
     <img src="https://img.shields.io/github/stars/owner/repo.svg?style=social" alt="Stars">
   </a>

---

📝 License

This list is licensed under CC0 1.0 Universal.

---

Last updated: 2026-08-28