Tencent releases Hy4 weights: 770B model, 1M-token context – with a license catch
Tencent has released the weights of its flagship model Hy4: 770 billion parameters, image understanding, computer use and a one-million-token context window. Unlike the preview, though, it doesn't ship under Apache 2.0. Large customers face a custom license that requires Tencent's approval.

What's going on
Chinese tech giant Tencent has released its flagship model Hy4 as an open-weights model, meaning anyone can download the weights. Tencent's Hy team announced the release on X on November 20, 2026. Three variants are available on Hugging Face, ModelScope and GitCode, along with a System Card – a technical companion document covering training, capabilities and safety testing. The model page is at huggingface.co/tencent/Hy4.
Tencent first unveiled Hy4 on November 4, 2026. Back then, the model was only available through an API on Tencent Cloud and via the aggregator OpenRouter. Tencent promised the weights "in the coming days." Sixteen days later, here they are. Don't confuse Hy4 with Hy4 Flash, a smaller 220-billion-parameter model Tencent released on November 18.
The tech: big, multimodal, long memory
Hy4 is a Mixture-of-Experts (MoE) model. Think of it as a team of many specialists, only a few of whom are called on for each word. The model has 770 billion parameters in total, but only 49 billion are active per token. That saves compute, but the whole model still has to fit in memory.
The architecture according to the Model Card:
| Feature | Value |
|---|---|
| Total / active parameters | 770B / 49B |
| Context window | 1,048,576 tokens |
| Layers | 78 (1 dense + 77 MoE layers) |
| Experts per MoE layer | 256 routed + 1 shared |
| Vision encoder | 1.23B parameters, for images and video |
The context window is the amount of text a model can take in at once. At roughly one million tokens, Hy4 matches the largest commercial models – roughly several thick books' worth. New compared with the preview, according to Tencent, is image understanding. Hy4 is supposed to analyze charts, examine images in detail and solve math problems presented as images. Also new is "computer use": the model can operate both command lines and graphical interfaces. Tencent specifically trained it on professional software such as Blender and CAD programs.
What Tencent promises – and how much it holds up
Tencent cites plenty of numbers, almost all from its own testing:
- Base model: Hy4 Base is said to beat DeepSeek-V4-Pro-Base and DeepSeek-V4-flash-Base in most knowledge and reasoning categories.
- Financial analysis: In a blind test with 213 finance professionals and 579 real-world tasks, Hy4 scored 3.04 points according to Tencent, ahead of DeepSeek-V4.1-Flash-1017 (2.97), Kimi K3.1 Pro and GLM-5.3 (2.68 each).
- Less made-up content: The hallucination rate – the share of fabricated facts – reportedly fell from 12.95 to 7.2 percent compared with Hy4 Preview. Errors from unsupported assumptions dropped from 23.1 to 5.6 percent.
- Game development: Hy4 is said to work with Unreal Engine, Unity and Godot and to score 19.1 percent (GameDev) and 9.8 percent (GameLogic) better than the preview.
- Office work: On Tencent's WorkBuddy work platform, Hy4 averages 83.18 points with a 96.15 percent success rate. It leads in nine of twelve scenarios there – though measured only on the Chinese mainland market.
The author of the main source on dev.to calls vendor benchmarks "marketing with numbers" until someone verifies them independently. As of launch day, nobody had. Independent results for the preview version, compiled by the routing portal OrcaRouter, offer a hint. On the evaluation service Vals AI, Hy4 Preview scored 53.21 percent, ranking 23rd out of 33. On Vals' agent test Terminal-Bench 4.0, the preview managed just 8.08 percent. Tencent itself had reported scores around 80 percent, but with a different version of the test and different conditions. OrcaRouter concludes that agent benchmarks depend heavily on the test setup. Tencent admitted weaknesses in the preview itself: the model thinks longer than necessary and double-checks itself excessively. That burns more tokens, which partly eats up the low per-token price. Whether the final Hy4 does better here remains to be seen.
Tencent also says Hy4 is already helping improve future models. Using the Hyra 2.0 tool, it reportedly optimized the training infrastructure for smaller models of the same architecture. Tencent calls this "recursive self-improvement." Two research models were released as well: one for single-cell biology (HyCell) and one for physical fields (HyPDE).
The catch: the license
The preview version, Hy4 Preview, downloadable since August 28, 2026, was released under the permissive Apache 2.0 license, according to OrcaRouter. The final Hy4, by contrast, ships under Tencent's own Tencent Hy License v1.0. The key point: written approval from Tencent is required for providers selling the model as a service with more than $50 million in revenue, and for products with more than 100 million monthly users. Below those thresholds, the license is considerably more generous, according to dev.to.
That's why the dev.to author draws a clear line between "open weights" and open source as defined by the Open Source Initiative. Researchers, startups and hobbyists can use Hy4. But building a large hosted competing service isn't something Tencent allows without further ado. His advice:
"Read the license before you read the model card. That sounds backwards. It isn't."
What you need to try it
Hy4 won't run on regular hardware. The BF16 version, a 16-bit number format, is about 1.55 TB. The FP8 version with 8-bit numbers needs about 0.79 TB. For FP8, Tencent recommends a server with 8 GPUs and tensor parallelism of 8, which splits each compute layer across all eight cards. On paper, that means each card needs well over 100 GB of memory – something only data center GPUs offer. Officially supported serving frameworks are vLLM and SGLang, with ready-made Docker images tagged "hy4".
The community has already published GGUF files for llama.cpp and similar tools. GGUF is a file format for compressed (quantized) models. Even at 4 bits, though, you'll still need roughly 460 GB of memory – an estimate, not an official figure. A gaming PC, a regular Mac or Google Colab won't cut it. On top of that, each BF16 checkpoint takes more than 1.5 TB of disk space. For most people, the API is the sensible route: $0.834 per million input tokens and $2.501 per million output tokens. According to OrcaRouter, that's about 45 percent cheaper than Alibaba's closed Qwen4-Max.
The big picture
A downloadable model with 770 billion parameters, a one-million-token context, image understanding and computer use is rare. The closest comparison is DeepSeek's V4 family, which Tencent is explicitly targeting. Tencent kept its promise and delivered on time, with a System Card, ready-to-use server images and three checkpoints at once. The biggest beneficiaries are research groups, companies that can't let data leave the building, and hosting providers. They can run the model themselves, fine-tune it and offer it cheaply.
Two points deserve scrutiny. The license is a step backward from the Apache 2.0 preview. And the performance numbers almost all come from Tencent itself. Independent results for the preview were mediocre at best. Whether the final Hy4 is significantly better will only become clear through external testing. On safety, Tencent says offensive hacking data was excluded from training and its own safety labs found no significant concerns. That, too, is an in-house assessment. You can put questions to the team in an AMA on r/LocalLLaMA on November 20 from 8 to 10 a.m. Pacific Time.
Related videos
Sources
- dev.to #llm dev.to
- finance.yahoo.com finance.yahoo.com
- orcarouter.ai orcarouter.ai
- tencent.com tencent.com
- Reddit r/LocalLLaMA reddit.com
- Google News (US) news.google.com
- Reddit r/artificial reddit.com
- Google News (TW) news.google.com
- Google News (TW) news.google.com
- Google News (TW) news.google.com
- Reddit r/singularity reddit.com
- Bing News (en-US) remio.ai
- Google News (TW) news.google.com
Try it yourself: Tencent Hy4
Explained step by step, no prior knowledge needed – on your own computer or free in your browser.
What can I do with it?
Hy4 is a very large all-round model that understands text, images and video and responds in text. It can process up to roughly one million tokens at once – entire codebases, long contracts or collections of reports, for example. Tencent trained it especially for programming (including frontend and game logic for Unreal, Unity and Godot), financial analysis, scientific tasks and office work. New is computer use: with the right software, it can operate the command line and graphical programs. According to Tencent, the base model beats DeepSeek-V4-Pro-Base in most knowledge and reasoning tests, but that hasn't been independently verified yet. The preview version performed only middlingly in independent tests and tended to overthink and over-check itself. The biggest limitation is hardware: without data center equipment, you can't run the model locally.
Who is it worth it for?
Hy4 is worth it for research groups, companies with their own GPU cluster that need to keep data in-house or want to fine-tune the model, and hosting providers below the license thresholds. Individuals and small teams without servers packing several hundred GB of VRAM (video memory) should test the model via the API rather than downloading the weights. If you want to run a model locally on a regular PC, you're better off with smaller models.
Ideas: What you can do with it
Feed Hy4 entire contracts, studies or annual reports in one go and have it pull out summaries, risks or contradictions. Thanks to the roughly one-million-token context, you don't have to chop up the texts. You end up with an organized overview that references the original passages.
Upload screenshots of charts, invoices or tables and have Hy4 extract and interpret the numbers. That helps you quickly evaluate presentations or financial documents. Spot-check the extracted values.
Describe a game idea and have Hy4 write code for Godot, Unity or Unreal Engine – a game mechanic with a score counter, for example. Tencent specifically trained the model on game logic. You get a working skeleton you can build on.
Paste in an entire project and have Hy4 explain how the pieces fit together, where bugs or security holes lurk and how you could refactor it. That's useful when you're taking over someone else's code. Always back up its suggestions with tests.
Have Hy4 structure and compare fund reports, securities data or market analyses. According to Tencent, it was trained on thousands of financial work environments. The result is a starting point for your work, not investment advice.
Companies with their own GPU cluster can deploy Hy4-FP8 internally via vLLM or SGLang so confidential data never leaves the building. You can then plug the model into existing tools through an OpenAI-compatible API. Check the license thresholds first.
What your computer needs
There are three checkpoints: Hy4 Instruct in BF16 (about 1.55 TB) for regular chat and agent use, Hy4-FP8 (about 0.79 TB) as the practical server variant for a single node with 8 GPUs and tensor parallelism of 8, and Hy4 Base (about 1.54 TB) for research and fine-tuning. For self-hosting, the source clearly recommends the FP8 version with the official vLLM or SGLang images. Community GGUFs for llama.cpp exist, but even at 4 bits you'll need roughly 460 GB of memory (estimate). If you don't have that hardware, use the API at $0.834 per million input tokens and $2.501 per million output tokens. If you're after a smaller model, Hy4 Flash (220B parameters) is its little sibling.
- The BF16 checkpoints are about 1.55 TB each and won't run on a single GPU or on a workstation with just a few cards.
- According to Tencent, the FP8 version (about 0.79 TB) is meant for a server with 8 GPUs and tensor parallelism of 8. Each card needs well over 100 GB of memory for that.
- Even as a 4-bit GGUF, the model needs roughly 460 GB of memory (estimate), plus extra memory for long contexts.
- The context window of up to 1,048,576 tokens eats a lot of additional memory. If you want to use the full length, you'll need even more headroom.
- Plan for several terabytes of fast disk storage for downloading and running the model.
- Regular gaming PCs, laptops and Google Colab aren't enough. For most people, the API is the realistic option.
Groß (774,4 B parameters, MoE): running entirely on the GPU takes a lot of VRAM (video memory). With MoE offloading, a regular graphics card plus plenty of RAM is enough (see table). Colab Free isn't enough.
How do I find out what my computer has?
- Windows: Press Ctrl + Shift + Esc → Task Manager → Performance tab → click GPU on the left. At the bottom you'll see Dedicated GPU memory (that's your VRAM). You'll find system memory under Memory.
- Mac: Apple menu at the top left → About This Mac. You'll see your chip (e.g. M2) and memory (e.g. 16 GB). On Apple chips, graphics and processor share this memory.
- Linux: Type
nvidia-smiin the terminal (shows your graphics card and its memory) andfree -hfor system memory.
Guide
Google Colab (in your browser, no installation)
Google Colab is a free service from Google. It gives you a computer with a graphics card in your browser for a few hours. All you need is a Google account. For this model: too big for Colab – even the largest Colab GPUs aren't enough.
- Download the notebook. Click the button and save the file.
- Open Colab. Go to colab.research.google.com and sign in with your Google account.
- Upload the notebook. In the window that appears, click Upload on the left (or choose File → Upload notebook at the top) and select the file
colab.ipynb. - Turn on the GPU. In the top menu, go to Runtime → Change runtime type → under Hardware accelerator, select T4 GPU (with Colab Pro: L4 or A100) → Save.
- Start everything. Runtime → Run all (keyboard shortcut Ctrl + F9). If you see the warning “This notebook was not authored by Google,” click Run anyway.
- Wait. The cells run one after another. A green checkmark appears to the left of each cell when it's done. Installation and download take about 160 minutes here.
- Try it out. The result appears below the last cell. To test something else, change the text in the cell and run it again with Shift + Enter. The last cell starts a proper chat with an input field.
- Clean up. When you're done: Runtime → Disconnect and delete runtime. This saves your free quota.
Good to know: The free GPU is limited (usually a few hours per day). After about 90 minutes of inactivity, Colab disconnects, and you'll have to start everything over.
Windows 10 / 11
The easiest way is Ollama, a free program that launches AI models with a single command.
- Update your graphics driver (NVIDIA cards only): Install the NVIDIA app or the latest driver. For AMD cards, use the latest Adrenalin driver.
- Install Ollama. Download the file OllamaSetup.exe from ollama.com/download/windows, double-click it, and choose Install. Afterward, a small llama icon appears in the taskbar at the bottom right.
- Open a terminal window. Press the Windows key, type PowerShell and press Enter. A blue or black window opens.
- Start the model. Copy this command ("Copy" button), paste it into the window with a right-click, and press Enter:
The first time, Ollama downloads the model (467 GB (about 10.4 hr at 100 Mbit/s)). After that, it's instant.ollama run hf.co/AngelSlim/Hy4-preview-GGUF:Q4_K_M - Start typing. Once
>>> Send a messageappears, type your question and press Enter. Type/byeto end the chat.
Prefer automatic? A script that picks the right variant for you
- Download both files into the same folder: try_windows.ps1 demo.py
- Open the folder in File Explorer, right-click an empty spot and choose Open in Terminal.
- Paste this command and press Enter:
powershell -ExecutionPolicy Bypass -File try_windows.ps1
If needed, the script installs Ollama via winget, measures your VRAM (video memory) and downloads the matching variant.
macOS
Macs with an Apple chip (M1 to M5) are ideal. Older Intel Macs are very slow.
- Install Ollama. Download it from ollama.com/download/mac, open the file, and drag Ollama into your Applications folder. Launch Ollama once – a llama appears in the menu bar at the top.
- Open Terminal. Press Cmd + Space, type Terminal, and press Enter.
- Start the model. Paste the command (Cmd + V) and press Enter:
The first time, the model is downloaded (467 GB (about 10.4 hr at 100 Mbit/s)).ollama run hf.co/AngelSlim/Hy4-preview-GGUF:Q4_K_M - Start typing. Type your question and press Enter. Quit with
/bye.
Linux
- Check your GPU.
nvidia-smishould show your card. If it doesn't, install the driver on Ubuntu and restart:sudo ubuntu-drivers install - Install Ollama:
curl -fsSL https://ollama.com/install.sh | sh - Start the model:
Exit withollama run hf.co/AngelSlim/Hy4-preview-GGUF:Q4_K_M/bye. Useollama psto check whether the model is running on the GPU. - Or let it pick the right variant automatically:
bash try_linux.sh # mit Python/transformers statt Ollama: MODE=hf bash try_linux.sh
Try it
Explain in five sentences what a Mixture-of-Experts model is, and give an everyday example.Here's a photo of a bar chart showing quarterly revenue. Read off the values, calculate the growth over the previous quarter and summarize the trend.Write a simple game in Godot (GDScript) where the player collects coins. Include a score counter and a restart button, and explain how it's structured.I'm giving you a company's annual report as a long text. Find every risk it mentions, rank them by importance and quote the relevant passage for each.Analyze this entire codebase (pasted below), find potential security vulnerabilities, suggest concrete fixes and justify each change.
Tips for better results
- Start with the API ($0.834 / $2.501 per million tokens) to check whether Hy4 fits your tasks before you download terabytes and plan hardware.
- The preview version tended to overthink and check itself repeatedly. Measure how many output tokens each task produces, and use a lower reasoning level for simple tasks if available.
- For self-hosting, use the FP8 version with the official Docker images (tag "hy4") for vLLM or SGLang. According to the source, that's the most reliable route.
- Use the long context window deliberately: clear instructions at the start and end of the prompt help when you paste in a lot of material.
- You can ask open questions the Model Card doesn't answer in the Hy team's AMA on r/LocalLLaMA.
If something goes wrong
Read the full Tencent Hy License v1.0 before downloading: model services with more than $50 million in revenue or products with more than 100 million monthly users need written approval from Tencent.
Don't confuse Hy4 with Hy4 Preview (Apache 2.0, text only) or Hy4 Flash (220B parameters). Those are different models with different licenses and capabilities.
Setting it up yourself is a lot of work: your best bet is the official Docker images tagged "hy4" for vLLM or SGLang rather than building everything from scratch.
With downloads of 0.8 to 1.55 TB per checkpoint, a download tool that resumes interrupted transfers is worth it. Check your free disk space first.
Community GGUFs aren't official Tencent files. Check whether your llama.cpp build supports the architecture, and expect quality losses with aggressive quantization.
Benchmark scores come mostly from Tencent itself. Test the model on your own tasks before relying on it.
“out of memory,” a crash, or your computer freezes
The model is too big for your VRAM (video memory). Pick a smaller variant from the table above and close other programs, especially games and browsers with lots of tabs.
It runs, but extremely slowly
Your CPU is probably doing the work instead of your graphics card. In Ollama, the PROCESSOR column of ollama ps shows how much runs on the GPU. If it says "100% CPU", update your graphics driver or pick a smaller variant that fits entirely into VRAM (video memory).
“ollama” or “python” is not found
Close the terminal window and open it again so it recognizes the newly installed program. For Python on Windows: reinstall it and check Add python.exe to PATH.
Windows: "Running scripts is disabled on this system"
Run the script with exactly the command above: powershell -ExecutionPolicy Bypass -File try_windows.ps1. This allows execution for this one time only.
Error message when loading the model (version, "trust_remote_code", unknown architecture)
Brand-new models often need the latest software version. With Ollama: update Ollama. With Python: pip install -U transformers in the activated environment. The Model Card usually lists the exact version.
Tokenstrom generates the scripts and notebook automatically. Please take a quick look before running them – they're plain, readable text. Mind the model's license: custom license (see Model Card).
Ask the AI assistant
Questions about this article, installation or background? Our assistant knows this page and runs on our own machine, not in someone else's cloud.
The Assistant is an AI (Gemma 4) and can make mistakes – please check important details against the source. Questions are used only to generate an answer and are deleted after one hour. Please don't enter any personal data.
Comments
What do you think? Already tried it? Write it here, no sign-up needed.
Comments are public. Links aren't allowed, and we delete abusive posts. You can delete your own comment at any time in this browser. Learn more in the Privacy Policy.