modly
Desktop app to generate 3D models from images using local AI — runs entirely on your GPU
A self-hosted desktop app that turns photos into 3D models using local GPU-based AI models, with no cloud upload.
Modly is a desktop application that turns photos into 3D models using artificial intelligence — all processed locally on your own GPU, with no cloud service required. If you have an image of an object, a character, or a scene, you can drop it into Modly and get back a 3D mesh you can use in other projects.
The way it works is through an extension system. Modly itself is the shell — a TypeScript desktop app with a Python backend that handles the AI processing. The actual AI models are installed as extensions, each one a separate GitHub repository containing a model file and a configuration. Official extensions are available for several named models, and you install them by pasting a GitHub URL into the app's Models page. Once installed, you download the specific model variant you want and start generating.
The app is open source and self-hosted, meaning everything runs on your own machine — your images never leave your computer. It is available for Windows and Linux, with macOS noted as coming soon in the README.
You would use Modly if you want to generate 3D assets for game development, 3D printing, digital art, or any creative project that starts from a photo. Because it runs locally, it is useful if you have privacy concerns about uploading images to a service, or if you simply want a free, offline tool. The tech stack is TypeScript for the desktop interface and Python for the AI backend.
Where it fits
- Generate a 3D game asset from a single reference photo
- Create a printable 3D model from a picture of an object
- Turn concept art into an explorable 3D scene without uploading images to the cloud