Connect with us


Live Text in iOS 15 shocks people with its utility and power



Master the ways you can use it and information gathering on iPhone will never be the same

We are all cyborgs now, to paraphrase Elon Musk when speaking about his neural network project, neuralink. The implication is that we rely so heavily on the iphone in our pocket that it has been come a literal extension on our minds and bodies, like a bionic arm.

With live text features and functions using iPhone (or iPad) in iOS 15 and 15.1 there is a new and very powerful addition to our already amazing arsenal of sensory extension. But the use of these new powers is not always obvious, and since the iPhone comes without a user manual, or rather an infinite number of them via YouTube and the web, learning just how far this feature can take you is a journey in itself.

In typical Apple fashion, if there are 10 ways to use live text then there are 100

The first thing that is not immediately apparent but becomes clearer on repeated use is that you can extract text, including most handwriting, from any existing photo. It can be a photo you took to store some text (like a menu posted behind the deli counter or a for sale sign in front of the house you might want to bid on).

Less obvious is that you do not need to take a photo at all to activate the live text recognition options. You can just point the camera at the “thing” that has text on it that you want to extract. But taking this to it’s most extreme logical conclusion Apple has made it possible to access the camera from within various apps specifically to make it less of a hassle to get the text directly from that app you plan to store it in or send it from.

Examples in the video below include the Notes app, the Messages app (formerly iMessage) and the mail app.

It will also allow you to go directly to the phone app or Apple Maps to “act” on information that you gather, from any camera access node or from the camera app – such as extracting a phone number from a business card or a billboard and then just clicking call, or sending an address from either of those examples into Apple Maps and immediate get directions.

These are just a few of the “live” uses of the feature that come up amazingly often in real life. More detailed use cases will be in both the video below and in subsequent videos on this feature, already in the works.

iOS 15.1 is filled with features that have a myriad of use cases, almost too many to list or describe

Every year when a major upgrade is sent down from on high, there is adapting to do and bugs to avoid. Sometimes it seems like the effort to learn how to use the new features is nearly on par with the gains in productivity from the better performing software. Three steps forward and two steps back, as it were.

This is not the case with iOS 15 – it’s more like 10 steps forward and only four steps back! Seriously, there are so many new features that it is completely reasonable to want to slowly adapt to the improvements, no matter how exciting they may be.

But in the case of live text, as well as the extensive upgrades to nearly all the built in apps for iPhone, iPad and Macs, the future will reward those of us that proactively evolve with the software’s upgraded abilities.

For those that use iPhones and iPads with a mac laptop or desktop, the changes coming with iOS 15.1 and macOS 12 Monterey (scheduled to go public next week) are just the beginning of an intense evolution toward what we have been calling the “Apple OS ecosystem singularity”.

The added power from improved hardware in all Apple devices, along with the ever converging and evolving ability to interact with one another via software upgrades, is going to make the world feel like a very different (better?) place a year or two from now.

It’s only a question of if we, with our non-bionic brains and bodies, can adapt to the new powers that come our way fast enough to gain from them before the next wave of changes hits us with new challenges of adaptation.

Apple Articles:

Find books on Music, Movies & Entertainment and many other topics at our sister site: Cherrybooks on

Enjoy Lynxotic at Apple News on your iPhone, iPad or Mac.

Lynxotic may receive a small commission based on any purchases made by following links from this page


Subscribe To Our Newsletter

Subscribe for free premium stories and the latest news

Lynxotic Logo

You have Successfully Subscribed!