Project Maya

Runs huge open language models like GLM-5.3-Flash on a single gaming GPU, with chat in your browser.

Illustrative image, AI-generated
DifficultyAdvanced
HardwareNVIDIA RTX 20 series or newer (or some AMD cards with ROCm 7) · at least 32 GB RAM, ideally 88 GB+ of RAM and VRAM combined · fast NVMe SSD with 75–470 GB free
LicenseMIT (models have their own licenses)
LinksGitHub

Project Maya cleverly splits very large AI models across your GPU, RAM and SSD. That lets models with hundreds of billions of parameters, like GLM-5.3-Flash, DeepSeek-V4.1-Flash or MiniMax-M3.1-Flash, run on a single RTX card. Setup asks which model you want, downloads it and starts it. After that, you chat in the browser dashboard, get a live hardware readout there, and can connect other programs through an OpenAI- or Anthropic-compatible API.

How to try it

Commands from the official guides – just copy them.

Linux

# Requirements: NVIDIA driver, CUDA 12.x, g++ and Python 3.10+.
# If anything is missing, setup shows you the right command.
# Download the project and start setup (choose model, download, build, launch)
git clone https://github.com/mw00/project-maya.git && cd project-maya
./setup.sh
# Then open in your browser: http://127.0.0.1:8080

# Optional: better PDF reading
sudo apt install poppler-utils

Windows (PowerShell)

# Requirements: NVIDIA driver + CUDA Toolkit 12.8, Visual Studio 2022 Build Tools (C++ desktop),
# Git for Windows and 64-bit Python 3.10+, e.g.:
winget install -e --id Python.Python.3.12 --scope user

# Open a new PowerShell window and download the project
git clone https://github.com/mw00/project-maya.git
cd project-maya
# Check your PC
.\START-MAYA.bat --check
# Setup: specify the drive/folder for the models (adjust the path)
.\START-MAYA.bat --setup --models-dir "D:\Maya-models"
# Start Maya, then open http://127.0.0.1:8080 in your browser
.\START-MAYA.bat

Commands from the official guide. New in the Toolbox since Nov 18, 2026.

Ask the AI assistant

Questions about Project Maya, installation or background? Our assistant knows this page and runs on our own machine, not in someone else's cloud.

Connecting …

The Assistant is an AI (Gemma 4) and can make mistakes – please check important details against the source. Questions are used only to generate an answer and are deleted after one hour. Please don't enter any personal data.

Comments

What do you think? Already tried it? Write it here, no sign-up needed.

  1. Loading comments …

Comments are public. Links aren't allowed, and we delete abusive posts. You can delete your own comment at any time in this browser. Learn more in the Privacy Policy.