AI Image
Apple’s A20 Pro Demonstrated To Be An On-Device AI Beast, Can Run A 27B Parameter Model At Double The Speed Of The iPhone 17 Pro’s A19 Pro
wccftech.com • • technology
Key Points:
- The new Apple A20 Pro chip features a dual-16-core Neural Engine, significantly boosting on-device AI performance and enabling faster processing of large AI models like the 27B parameter Bonsai model on the iPhone 18 Pro.
- The iPhone 18 Pro and Pro Max come with 12GB of faster 96-bit LPDDR5X RAM, enhancing memory bandwidth to 115.2GB/s, which supports improved AI workloads compared to the previous generation.
- Despite these advancements, larger AI models like Bonsai 2 with 2-bit quantization are too large to run efficiently on the iPhone 18 Pro due to memory constraints, limiting some AI capabilities.
- Bonsai 1-bit quantized models remain highly efficient on devices with as little as 4GB RAM, and perform exceptionally well on the iPhone 18 Pro thanks to its upgraded Neural Engine and memory system.
- Future Apple devices with increased memory capacity may enable support for even denser AI models, further advancing on-device AI processing capabilities.
