Excited to see what new bottlenecks people complain about next when model inference is ~basically instant 🙃
Divinely discontent!
OpenAI's Ultrafast Astra runs up to 8x faster in Codex
AISummary
OpenAI's Ultrafast mode for Astra runs up to 8x faster than Astra Standard and 4x faster than Astra Fast in Codex. Sherwin Wu says inference now feels nearly instant, shifting the bottleneck to users' next complaints.
Post on XView on X
@sherwinwu
Ultrafast is our fastest way to build with Astra yet: in Codex, it runs up to 8x faster than Astra Standard and 4x faster than Astra Fast. Bring your ideas to life as fast as you can type them.
Source: Sherwin Wu · x.comPublished · added here