16th June, 2024: Auckland, New Zealand. Blog uploaded by: David Lim, @davidlim, #davidlim
Apple Intelligence Won’t Work on Hundreds of Millions of iPhones—but Maybe It Could
Older iPhones might well be able to cope with Apple’s AI, so why won’t your US$900 year-old model run it? Here’s why.
APPLE HAS ANNOUNCED its next era. Your experience of using an iPhone, Mac, or iPad will be guided by, and suffused with, artificial intelligence. Apple calls it, of course, Apple Intelligence. It’s coming later this year. That’s right: We have another “AI” to deal with.
You may have heard plenty about how it makes Siri smarter, rewrites your emails and essays, creates never-before-seen emoji, and turns rough sketches into bland AI art.
Exclusion Zone
A more cynical take on this is that these exclusion timescales are tied to the average upgrade cycle of phones and laptops. A person might be considered normal if they upgrade their phone every year. Buying a new laptop every year means you are probably foolish, a theft-magnet, or just plain clumsy.
The reality is a lot more complicated. The computation required for at least some parts of Apple Intelligence is quite different to that of the average iPhone or Mac task.
And this has all been obscured to the average generative AI or chatbot dabbler so far because of the way all of us have been introduced to the form. When you use ChatGPT, Midjourney, or even Adobe Photoshop’s Generative Fill feature, your own computer is doing almost none of the real work.
That is done on remote cloud servers, which perform the necessary calculations then simply beam the final result over to your phone or laptop. In this sense, generative AI to date has been rather like a digital assistant, such as Siri or Alexa. It can, at times, do great stuff. But little to none of it is really happening on the device on which it is used.
Apple Intelligence will try, at least in part, to change that.
Apple’s Familiar Privacy Play
Why? “You should not have to hand over all the details of your life to be warehoused and analyzed in someone’s AI cloud,” said Craig Federighi, Apple's senior vice president of software engineering, during Apple's announcement of the new features.
“The cornerstone of the personal intelligence system is on-device processing. We have integrated it deep into your iPhone, iPad, and Mac, and throughout your apps, so it’s aware of your personal data without collecting your personal data.”
On-device AI processing is a privacy play, a classic Apple strategy. But it’s not the first to make this move. Microsoft was. Its Copilot+ standard is a similar concept, but based solely around laptops. Copilot+ laptops have dedicated AI hardware designed to allow for on-device AI processing. The two even rely heavily on the same core artificial intelligence, that of ChatGPT creator OpenAI.
Which leads us to this completely justified question: Why the hell can’t my $900 iPhone 15 do this stuff too?
Neural Thinking
NPU is the term: the tech under the spotlight that separates older “non-AI” hardware from the new stuff our purses are meant to quiver in anticipation for. It stands for “neural processing unit.”
The latest phones and tablets have one of these in addition to the CPU (central processing unit) and the GPU (graphics processing unit). Its specialization is in carrying out an awful lot of operations simultaneously—and in the context of phones and laptops, doing so while using minimal power is key.
Just as generative AI has pebble-dashed the internet and wider society with what might charitably be called “stuff,” the creation of that stuff also requires a wide and shallow type of work.
For those who want to get slightly more technical, NPUs excel at matrix manipulation. This is the core form of work that powers chatbot LLMs and other generative AI. In each case, an AI starts off with a prompt and gradually homes in on a final result—be it a picture or a sentence of prose—through matrix manipulation.
Beyond the NPU
Case closed? Are we simply in an NPU world now? Sure, but we have been since at least 2017. Apple introduced the Apple ANE (Apple Neural Engine) in 2017, seen in the iPhone 8, iPhone 8 Plus, and iPhone X. It’s an NPU.
It was needed back then, years before AI was as much of a buzzword as it is today, because Apple has actually used forms of AI and machine learning in iOS for ages.
Perhaps Apple Intelligence isn’t all that different—there’s just more of it. And the software scene has already proved some of these new “AI” features are being artificially gated, paywalled, behind new hardware.
A hobbyist software historian who goes by the name of Albacore online has got some of Microsoft’s Copilot+ features working on hardware that shouldn’t, in theory, be able to run it—a cheap Samsung Galaxy Book2 Go notebook. It costs a fifth to a quarter of the price of a Copilot+ laptop.
“Getting Recall working was moderately challenging, I suppose. I've been reverse engineering Windows bits for close to 10 years, so tracking down checks and restrictions is practically second nature to me,” Albacore tells WIRED.
How does it work? “Track down what guards the features, devise a plan for altering the check so it's always happy no matter the real requirements, and then wrap it in a nice installer. Some testing and edge case hunting later, the app was ready,” Albacore says.
See the rest of the article hereSee the rest of the article here:
Let us sort you out on crack screen repair for Galaxy Tab, battery banks , Samsung phone case; or power banks, fast wireless charger tablets, laptop, sma
Are you on a tight budget and looking for a cost-effective way to acquire a refurbished iPhone, iPad, or laptop computer? We can assist you in maximizing the value you get for your budget by providing you with high-quality refurbished hardware.
If you help, support or information on AI (Artificial Intelligence) subject topics; we will be happy to sort you out. Please text us if you need support or online product queries:
Dr Mobiles Limited
1, Huron Street, Takapuna, Auckland 0622. Toll: 0800 429 429
Email - Website - Blog - Faceb
