Amazon's Peter DeSantis on AI hardware's shifting bottlenecks
Original title"One workload is power-bound. The next workload is memory-bandwidth-bound. The next is memory-bound. It's one of the most interesting har...
AISummary
Amazon SVP Peter DeSantis told SemiAnalysis's Dylan Patel at the AI Infra Summit that AI workloads are shifting from being power-bound to memory-bandwidth-bound and then memory-bound. He called designing hardware for these changing constraints one of the most interesting hardware design problems in years.
Source: Amazon Science · x.comPublished · added here