Video

Nicole Junkermann on Running AI on Your Own Device


Not all AI lives in distant data centres. Nicole Junkermann looks at how some of it is moving closer to the device in your hand, and why that can mean faster responses and less data movement.

Transcript


Some AI is moving closer to the device in your hand. That can mean faster responses and less data movement. Small, local intelligence is becoming more important.

Three key points


  • Some AI now runs on the device in your hand.
  • Local processing can mean faster responses and less data movement.
  • Small, local intelligence is becoming more important.

Smaller, closer, quicker


For years the assumption was that intelligence lived far away, in large computing centres, and devices simply sent questions and waited. Nicole Junkermann sees that balance shifting. Phones, laptops and other everyday hardware are now capable enough to handle many tasks locally, such as sorting photos, transcribing speech or suggesting the next word. When the work happens on the device, answers arrive faster and less information needs to travel across networks. That is good engineering as well as good manners towards the people using it. The larger systems still have their place, but a great deal of everyday usefulness will come from small models that sit quietly where the person is.

More videos


Find all six clips, the tech notes and the reading list on the Nicole Junkermann homepage.

All six videos → Browse the tech notes →