# 145. The Prius of Artificial Intelligence: Hybrid AI Models

- Show: [The Next Byte Podcast](https://hardwarepodcasts.com/podcast/the-next-byte-podcast)
- Published: 2023-10-24
- Length: 28m
- Page: https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2023-10-24-145-the-prius-of-artificial-intelligence-hybrid-ai-models
- Listen: https://the-next-byte-wevolver.simplecast.com/episodes/145-the-prius-of-artificial-intelligence-hybrid-ai-models-uJ6wRGAv

## Summary

Hosts Daniel and Forbode discuss Qualcomm's proposal for 'hybrid AI,' a model that splits generative AI workloads between edge devices and the cloud to reduce cost, latency, and energy use. They explain how techniques like quantization and pruning allow large models to run locally on hardware like Snapdragon chips, citing examples in autonomous vehicles and mixed reality. The hosts also analyze the implications for hardware design, noting that rapid AI iteration may force faster hardware refresh cycles for consumer devices like iPhones.

## Chapters

- [0:00](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2023-10-24-145-the-prius-of-artificial-intelligence-hybrid-ai-models#t=0) Introduction and Sponsor Read
- [4:21](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2023-10-24-145-the-prius-of-artificial-intelligence-hybrid-ai-models#t=261) The Cloud AI Problem: Cost and Latency
- [6:34](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2023-10-24-145-the-prius-of-artificial-intelligence-hybrid-ai-models#t=394) Qualcomm's Hybrid AI Solution
- [11:44](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2023-10-24-145-the-prius-of-artificial-intelligence-hybrid-ai-models#t=704) Technical Mechanics: Quantization and Pruning
- [18:57](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2023-10-24-145-the-prius-of-artificial-intelligence-hybrid-ai-models#t=1137) Real-World Applications: Autonomous Vehicles and Mixed Reality
- [22:25](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2023-10-24-145-the-prius-of-artificial-intelligence-hybrid-ai-models#t=1345) Impact on Hardware Design and Consumer Devices
- [26:03](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2023-10-24-145-the-prius-of-artificial-intelligence-hybrid-ai-models#t=1563) Episode Summary and Outro

## Topics

- [AI & machine learning](https://hardwarepodcasts.com/topic/ai-and-machine-learning)
- [Microcontrollers & dev platforms](https://hardwarepodcasts.com/topic/microcontrollers-and-platforms)
- [Careers & education](https://hardwarepodcasts.com/topic/engineering-careers-and-education)

## Most relevant to

large enterprises

## Mentioned

- Qualcomm (company)
- TensorFlow Lite (tool)
- ChatGPT (product)
- Snapdragon (chip)
- Stable Diffusion (product)
- OpenAI (company)
- Microsoft Azure (company)
- NVIDIA (company)
- Honda (company)
- Volvo (company)

## Related episodes from other shows

- [Episode 19: The On-Device AI Debate](https://hardwarepodcasts.com/podcast/the-circuit/2023-05-22-episode-19-the-on-device-ai-debate) (The Circuit)
- [AI and Connectivity at the Edge and Endpoint](https://hardwarepodcasts.com/podcast/ee-times-current/2023-10-19-ai-and-connectivity-at-the-edge-and-endpoint) (EE Times Current)
- [Chips at the Edge: Innovation for AI at Edge and Automotive](https://hardwarepodcasts.com/podcast/ee-times-current/2026-01-14-chips-at-the-edge-innovation-for-ai-at-edge-and-automotive) (EE Times Current)
- [Will inference move to the edge?](https://hardwarepodcasts.com/podcast/catalyst/2025-12-18-will-inference-move-to-the-edge) (Catalyst)
- [From Data Centers to Devices – The Ongoing [R]Evolution of AI Computing](https://hardwarepodcasts.com/podcast/ee-times-current/2022-02-11-from-data-centers-to-devices-the-ongoing-r-evolution-of-ai-computing) (EE Times Current)

## Citing this page

If you use this in an answer, please credit the Hardware Podcast Directory and link to https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2023-10-24-145-the-prius-of-artificial-intelligence-hybrid-ai-models. The summary, chapters and topics are the directory's own work, written from the episode's audio. The episode itself, its title and its audio belong to The Next Byte Podcast.