77 AI images in 15 seconds: an iPhone 13 generates them fully offline
The QVAC team has reworked its fork of stable-diffusion.cpp so that image generation runs on the iPhone's Neural Engine instead of its GPU. On a 2021 iPhone 13, the developers say this makes it about 20 times faster. The code is open source.

What's going on
Over on Reddit's r/StableDiffusion, the developer team QVAC is showing off how fast an old iPhone can generate AI images. On a 2021 iPhone 13, the developers say, it produces 77 images in 15 seconds. Everything runs on the device itself, with the phone in airplane mode. According to the post, that's about 20 times faster than before. The code is open source and available as a pull request – a proposed change to the source code – in the GitHub repository tetherto/qvac-ext-stable-diffusion.cpp#66. The post is titled "Image generation on iPhone is solved." That's a bold bit of self-promotion and worth taking with a grain of salt (see the bigger picture below).
The comparison: same app, same model, different chip
The team ran the same app with the same model for 15 seconds. The only thing that changed was the chip doing the computation:
| Compute unit | Images in 15 s | Time per image |
|---|---|---|
| GPU (Metal) | 3 | approx. 3.8 s |
| Neural Engine (Core ML) | 77 | approx. 192 ms |
The model was SDXS at a resolution of 512 × 512 pixels. SDXS is a heavily slimmed-down, speed-optimized diffusion model from the Stable Diffusion family. A diffusion model creates an image by gradually carving a subject out of random noise, step by step. SDXS needs very few steps to do this, which makes it a good fit for weak hardware. In terms of image quality, though, it can't compete with large models like SDXL or Flux.
Where the speed boost comes from
iPhones contain several compute units. The GPU is accessed through Apple's Metal API. Alongside it sits the Neural Engine, a dedicated chip built solely for the kinds of math neural networks need. For those workloads it's often much faster and more power-efficient than the GPU. Apps can't access it directly, though – only through Apple's Core ML framework.
The foundation is stable-diffusion.cpp, a lean open-source program that runs Stable Diffusion models without a heavy Python environment. QVAC maintains its own fork of it, meaning a separately developed branch. In this fork, the team moved two components of the model onto the Neural Engine:
- the UNet: the core component that computes the actual image out of the noise,
- the tiny decoder: it converts the compressed internal representation of the image into real pixels.
The text encoder stays on the GPU. It turns the text input (the prompt) into numbers the model can work with. According to the team, no server or network is needed.
The hardware is what makes this notable. The iPhone 13 has just 4 GB of RAM, which the model has to share with the operating system and the app. Newer iPhones have faster Neural Engines and more memory, so things should run even faster there. The post doesn't give any numbers for that, though.
Who's behind QVAC
The GitHub account "tetherto" belongs to Tether, the company behind the USDT stablecoin. Under the QVAC name, Tether builds software for local AI that runs directly on devices without cloud services. It's unusual for a crypto company to be building open-source tools for on-device AI. What matters for users in the end, though, is that the code is open to inspect and free to use.
What it means for users and developers
First and foremost, this is a win for developers. If you build stable-diffusion.cpp into an iOS app, this change lets you offer fast image generation even on older devices. Think sticker generators, sketching tools or live previews as you type. At around 0.2 seconds per image, you can generate images almost in real time while you're still typing the prompt. Because nothing leaves the device, your inputs stay private. There are no server costs, and it works even without a signal.
The post doesn't introduce a finished app for end users. If you want to try it, you'll have to build the code yourself, for example with Xcode.
The bigger picture
The result shows how much performance in smartphones goes untapped when software doesn't use the specialized chips. Switching from the GPU to the Neural Engine alone delivers a 20x gain here. Apple itself released Core ML versions of Stable Diffusion in the past. Bringing this path to a project as widely used as stable-diffusion.cpp makes the technology much more accessible.
Still, calling it "solved" is a stretch. SDXS is a small model for 512 × 512 pixels. In detail, text rendering and prompt understanding, it lags far behind today's large image models. It's also unclear whether the 192 milliseconds cover the full pipeline, including the text encoder, which still runs on the GPU. Nor is it clear whether the numbers hold for larger models or higher resolutions. All figures come from the QVAC team itself. There are no independent measurements yet.
Sources
- Reddit r/StableDiffusion reddit.com
Ask the AI assistant
Questions about this article, installation or background? Our assistant knows this page and runs on our own machine, not in someone else's cloud.
The Assistant is an AI (Gemma 4) and can make mistakes – please check important details against the source. Questions are used only to generate an answer and are deleted after one hour. Please don't enter any personal data.
Comments
What do you think? Already tried it? Write it here, no sign-up needed.
Comments are public. Links aren't allowed, and we delete abusive posts. You can delete your own comment at any time in this browser. Learn more in the Privacy Policy.