Skip to content
View original post on X: Awni Hannun· 34/100AI score34/100

Apple's WWDC video shows how to run agentic AI locally with MLX

AISummary

Awni Hannun praised a WWDC video by @angeloskath explaining how to set up agentic AI to run locally with MLX in an approachable way. He said the demos work well now, which was impractical less than a year ago before M5 and recent gains in open-weights models.

Post on XView on X
Awni Hannun
@awnihannun

The video from @angeloskath on local agentic AI with MLX is excellent. I also hear it's one of the most viewed videos in WWDC history 👏

Goes through the basics of agentic AI and how to set it all up to run locally in a very approachable and simple way.

The demos are excellent and it's kind of wild that they just work now. None of this was possible or practical < 1 year ago before M5 and the recent quality bump in open weights models. And it's not done improving.

Source: Awni Hannun · x.comPublished · added here

Topics

AI agentsOn-device AIOpen-source ecosystemProduct updatesTutorials & how-to