Language models · Phi-3.5 Mini
More answers for your compute budget.
per response.
2.5× as many requests completed per second.
Quality preserved.
How the cost compares
At the same GPU hourly price, the measured speed gain brings the compute cost of the same work from 100% to 40%.
- Before
- 100%
- Optimized
- 40%
This estimates compute cost at the tested load. Your bill also depends on usage and hosting commitments.
