The SGLang community was absolutely buzzing at AI Infra Summit! Highlights from our sessions last week in Santa Clara:
💡 Alex Nails (@alxnails, SGLang core contributor) with Vasanthi Jagatha of @SamsungSemiUS on SGLang HiCache + Samsung Cognos for the KV cache bottleneck
💡 Sundara Raman Ramachandran of @LinkedIn on running latency-critical ranking on SGLang at global scale.
Thanks to everyone who stopped by our booth! Excited to see you at our upcoming events: http://sglang.io/events