AI
Pushing AI to the Edge: A Conversation
Story Highlights
The insatiable demand for AI and ML across devices is spawning a new breed of hardware innovation that promises to transform applications. BrainChip’s Nandan Nayampally and Arm’s Ian Bratt discuss.
BrainChip CMO Nandan Nayampally interviews Arm Fellow Ian Bratt about bringing more advanced AI capabilities to edge devices.
They discuss the growing demand for on-device AI to handle privacy, latency, and scalability issues. Ian notes that while state-of-the-art models will continue to get larger, there is also constant work on optimisation and creating smaller, more specialised models that can run efficiently at the edge.
They talk through challenges including enabling no-code development environments and getting enough quality data for training models that will reside on edge devices. Ian also touches on Arm’s efforts like the TOSA specification to help standardise and stabilise the fragmented edge AI ecosystem and where future innovation may be headed.
Click HERE to listen to the podcast.
