Tencent Hy3
Hy3 is a large-scale Mixture-of-Experts (MoE) language model developed by Tencent.
Our verdict
Who it's for
Cost-effective MoE model for agentic tasks and productivity
Who should look elsewhere
Requires high-memory GPUs for deployment due to large total parameter count.
Pros
- +Outperforms models with many more total parameters on agentic and productivity tasks.
- +Reliability improvements in tool calls and output formats make it production-ready.
- +Open-source weights available on multiple platforms, including Hugging Face and ModelScope.
Cons
- −Requires high-memory GPUs for deployment due to large total parameter count.
- −Quantized model available, but it still demands substantial hardware resources.
Key features
- ✓Mixture-of-Experts (MoE) architecture with 192 experts and 8 activated per token.
- ✓Supports 256K context length and BF16 precision.
- ✓Stable tool call and output format consistency across multiple agent scaffoldings.
- ✓Fine-grained anti-hallucination training to reduce factual errors and logical contradictions.
- ✓Joint optimization of supervised fine-tuning and reinforcement learning for better multi-turn intent tracking.
Pricing
| Plan | Price | Billing | Notes |
|---|---|---|---|
| Pro | $9 | month | Leveling up AI collaboration and compute; Most advanced platform to build AI |
| Team | $20 | month | Leveling up AI collaboration and compute; Most advanced platform to build AI |
| Enterprise | — | month | Support to adopt the HF Hub in your organization |
| Base | $12 | month | Store your AI models, datasets, Spaces, and Buckets; Transparent, volume-based pricing; Egress and CDN included at no extra cost |
| Public repositories | $18 | month | Store your AI models, datasets, Spaces, and Buckets; Transparent, volume-based pricing; Egress and CDN included at no extra cost |
| Public repositories 50TB+ | $10 | month | Store your AI models, datasets, Spaces, and Buckets; Transparent, volume-based pricing; Egress and CDN included at no extra cost |
| Private repositories | $16 | month | Store your AI models, datasets, Spaces, and Buckets; Transparent, volume-based pricing; Egress and CDN included at no extra cost |