Technology

Apple Exploring Ways to Run Much Larger AI Models Directly on iPhones

Apple Exploring Ways to Run Much Larger AI Models Directly on iPhones


Apple has held meetings with PrismML about ways it could use the startup’s technology to run much larger AI models directly on iPhones, according to The Information.

The report said PrismML has managed to shrink down Alibaba’s open-source large language model Qwen 3.6 to run entirely on an iPhone 17 Pro. The model has 27 billion parameters, which is larger than Apple’s on-device AFM 3 Core Advanced model with 20 billion parameters. Apple’s model powers iOS 27 enhancements such as Siri AI’s more expressive voices and improved systemwide dictation on iPhone 17 Pro and iPhone Air models.

Unlike with AFM 3 Core Advanced, all of Qwen 3.6’s parameters can be active at the same time.

“One new on-device Apple model has 20 billion parameters but uses a so-called sparse architecture, in which only 1 billion to 4 billion parameters are active at a time,” the report said, in reference to AFM 3 Core Advanced. “In the case of PrismML’s on-device model, all 27 billion parameters are active at the same time.”

Larger models running directly on iPhones would allow for more Apple Intelligence features to run on device instead of on Apple’s Private Cloud Compute servers, which could reduce Apple’s costs and further enhance user privacy.

Popular Stories

Advanced AI Dictation Not Enabled by Default in iOS 27 Beta

Apple’s next-generation AI dictation feature for the iPhone 17 Pro and iPhone Air is not turned on by default in the first developer beta of iOS 27. Apple says the new AI-powered dictation system delivers “a major boost in accuracy,” with more reliable on-the-fly capitalization and punctuation than the existing dictation system. The feature runs on Apple’s new AFM 3 Core Advanced model,…

Apple Intelligence Home Features Require 2TB iCloud+ Plan in iOS 27

Using Apple Intelligence camera features in the Home app will require an iCloud+ plan starting at 2TB, according to Apple. Apple shared the detail in its notes for the third macOS Golden Gate beta that was released today. In iOS 27, iPadOS 27, and macOS 27 Golden Gate, the Home app is able to generate written summaries for motion alerts from HomeKit Secure Video cameras. It’s also able to…

‘Siri AI’ Lawsuit Update: Apple to Pay Owners of These iPhone Models

In May, Apple agreed to pay $250 million to settle a U.S. class action lawsuit over Siri AI’s delayed launch, and eligible iPhone users could receive up to a $95 payout. This week, the California court overseeing the case held a hearing regarding preliminary approval of the settlement, but the judge has not yet issued a ruling. It will likely be at least a few more months before eligible…



Source link