Together AI
Together AI is a platform for running open-source LLMs.
Our verdict
Who it's for
Run open-source LLMs with serverless inference and fine-tuning
Who should look elsewhere
Smaller than big providers
Pros
- +Many open models
- +Competitive pricing
- +Fast inference
- +Good for startups
- +Fine-tuning available
Cons
- −Smaller than big providers
- −Model quality varies
- −Support basic
- −Documentation gaps
- −Newer platform
Key features
- ✓LLM inference
- ✓Image generation
- ✓Fine-tuning
- ✓GPU cloud
- ✓Batch processing
- ✓Code execution
- ✓Dedicated endpoints
- ✓Open-source models
- ✓Competitive pricing
- ✓Single-tenant options
Pricing
| Plan | Price | Billing | Notes |
|---|---|---|---|
| Serverless Inference | — | month | Pay per 1M tokens; Llama 3.1 8B: $0.18/1M tokens; Llama 3.1 405B: $3.50/1M tokens |
| Fine-Tuning | — | month | $0.48-2.90/1M tokens (by model size); DeepSeek, GLM, Kimi support; Minimum charges for specialized models |
| GPU Cloud | — | month | Instant Clusters: $2.20-5.50/hr/GPU; Dedicated Endpoints: $2.10-4.99/hr; Single-tenant deployment |