Version rapidly approaches Golden Master ahead of possible September iPhone 13 release event
Today those participating in the iOS 15 public beta program are able to update (again), this time to beta 8. This beta process is a “live” test of all the new features, indeed when participating in the program many features change and evolve and, of course, bugs are not infrequent.
As we get nearer and nearer to the launch of this year’s iPhone model, apparently to be dubbed “iPhone 13” the iOS 15 beta versions become more stable and eventually, usually coinciding with the event where the new iPhone model is announced, the Golden Master is reached – which becomes the first public release version.
The first iteration of the public release is often short lived, as the beta test phase almost never gets rid of all the bugs and various features and security patches and other urgent updates are often needed.
For this reason the 2nd or third public release is often the one many experts recommend for those upgrading.
Naturally, though the new phone models will be shipped with iOS 15 already installed, once the phones actually ship of course, which can vary in delay from the launch / announcement at the upcoming September event.
Nevertheless, most older iPhones will benefit from this upgrade, more than a little, and once the release is public a free upgrade will be available to the more than 1 billion users already in possession of an iPhone from previous releases.
Version rapidly approaches Golden Master ahead of possible September iPhone 13 release event
Today those participating in the iOS 15 public beta program are able to update (again), this time to beta 7. This beta process is a “live” test of all the new features, indeed when participating in the program many features change and evolve and, of course, bugs are not infrequent.
As we get nearer and nearer to the launch of this year’s iPhone model, apparently to be dubbed “iPhone 13” the iOS 15 beta versions become more stable and eventually, usually coinciding with the event where the new iPhone model is announced, the Golden Master is reached – which becomes the first public release version.
The first iteration of the public release is often short lived, as the beta test phase almost never gets rid of all the bugs and various features and security patches and other urgent updates are often needed.
For this reason the 2nd or third public release is often the one many experts recommend for those upgrading.
Naturally, though the new phone models will be shipped with iOS 15 already installed, once the phones actually ship of course, which can vary in delay from the launch / announcement at the upcoming September event.
Nevertheless, most older iPhones will benefit from this upgrade, more than a little, and once the release is public a free upgrade will be available to the more than 1 billion users already in possession of an iPhone from previous releases.
Boring? Are you kidding me? Time to look under the hood…
Somewhere in the land of media herding there was a familiar refrain. iOS 15 and iPadOS 15 are “boring”. Apparently the idea behind this is that there is no single feature that changes the entire experience of the iPhone or iPad – no “killer app” or killer upgrade.
The “boring” crowd have focused on things like “you can banish your ex from memories in iOS 15”. I saw a slew of articles with a variation on that title.
The biggest problem with the attitude, which must have been initiated by someone that has not really been hands on with any of the new iOS software (which is still in non-public beta only) is that it’s not true. (A public beta is expected in July but it is not recommended unless you are a developer testing on “non-critical” devices).)
Why? Because there are so many killer upgrades that it’s overwhelming, basically due to the avalanche of amazing new features and improvements. This article will attempt to give an illustration of that by focusing on only one feature inside one built-in app: Memories inside of the Photos app.
First a short digression. We have been testing on several devices including a MacBook Pro 15” from 2017, an original 1st generation iPad Pro (2015) and an iPhone XS Max from 2018. None of these machines have the new Apple Silicon chips and for that reason they are only able to produce the upgraded features that don’t require it.
That makes the improvements that are possible without buying any new hardware even more amazing. Stunningly, of the three devices we upgraded the MacBook Pro was the most stable right out of the gate. Any beta software will have bugs, glitches and sometimes crash but that does not prevent one from testing out features that are new.
The iPad pro, in a non-technical observation almost appears as if the screen resolution has been increased, obviously not possible but, as you will read below, could be part of a stunning emphasis on increased beauty, sensuality and luxurious feel in the new suite of OSs.
Memory movies on iPad OS15 are an amazing example of how AI and machine learning are evolving
For those not familiar with “Memories” they are auto-generated film clips that can be found in the “For You” tab in your photos app on iPhone and iPad. While you are sleeping this feature scans everything in your photos library and uses artificial intelligence, machine learning and neural networks to choose and edit the clips, as the name says, for you.
One not confirmed but almost certain technical backdrop to this is that the learning is improving even between updates to the OS. Not only that but all Apple devices on earth are “cooperating” to help each other learn. That’s a powerful force that spreads across over 1.65 billion devices.
This feature was added in iOS 12 but started to function in iOS 14 on a much higher level. If you had tested and used the feature over the last few years as we have you’d have noticed that the ability of the AI to “see” and select photos and videos to include was limited and, at times, comical. Not any more.
Much of the data that clues the software in as to what photos belong together is from the embedded meta data. The date, time and location information helps to tell the AI that you took a group of images or videos on a day in a particular location.
The difference in iPad OS15 (iPhone too, of course) is that the more difficult to accomplish tasks, such as recognizing the subjective quality of one photo verses another (humans often take several photos of the same scene to try to capture the best out of a bunch). Or, more importantly, who and what are the subject of a photo.
All of this began to get interesting in iPad OS 14 and many groups of photos and videos were already being chosen, edited and enhanced by the software to a level that was fairly impressive.
AI and aesthetics collide and the result is a Joy to witness
Something that is starting to become a thread and a definitive direction that Apple is taking, particularly with the iPad Pro series, is, true to the name, a Pro level of visual production and manipulation throughout the OS.
Center Stage, for example and many other video and photo related upgrades were some of the big features in the newest generation of iPad Pro. Those are great, but require a new iPad along with the OS upgrade.
When it comes to the memory movie clips what we found is that even on the oldest iPad Pro from 2015 the evolution of the software due to the constant learning by the AI is already taking a huge step forward doing all the things that it was already doing only much better.
Apple’s upgrade took that and give it an additional kick up a notch with somewhat that the company is known for: good taste.
What has changed specifically?
In iPad and iPhone OS 14 there were a few things that felt awkward in the way movies were created. The biggest shortfall was in the softwares ability to deal with various aspect ratios.
These days when we shoot photos and videos with an iPhone it is tempting and, at times, wonderful to use the vertical orientation. Other times, for landscapes and other scenes we might prefer a traditional film aspect or even use the panorama feature to get an ultra-wide screen “cinema-scope” style.
Until now this was dealt with very poorly by the software. Mostly the photos would constantly zoom in (the so called “Ken Burns” effect) and if shown without zooming in a vertical portrait shot would have ugly side bars (like a vertical letterbox effect).
The zooming and most of the effects in general destroyed the resolution and therefore the quality of many photos by enlarging them and adding the effects.
Additionally the effects that were added, while cute and fun, were not much more than a way to add fun and not what would likely be used by a human editor. All of this and more made for a kind of novelty feel to the whole process that was nice to have, but many never even bothered to look at the movies that software created for them.
That’s about to be over.
A whole new array of options for the AI to use while trying to entertain
In iPad OS 15, as can be seen on the photos and videos in this article, the ways that the software solves the aspect ratio issue as described above is genius and, dare I say it, beautiful.
In a collaboration between the AI and the software itself it now has a new bag of tricks to use and, boy, does it work. One feature that is fantastic is the letterbox generator for any wide screen photos in any aspect ratio.
How this works is that it takes the iPad aspect ratio and then uses the photo in it original at 100% full resolution and then adds a letterbox. But this is not the usual plain black bars we are all familiar with – the software and AI are able to see and analyze the photo and create a custom gradient letterbox that can be any shade or color.
The effect is often astoundingly tasteful and often makes the original photo look even better. We tested it on award winning photos (video above) and the result is, basically art. Also on our own “nice” photos, chosen 100% by the AI and software, look amazing also.
Actually, all the photos and videos in the clips generated from the library look much better than I had remembered. That turns out to be because the software and AI now do automated color grading on all the photos and videos in all the generated memories !
Color grading also known as color correction, especially for video, has traditionally required an expensive expert and high end software (and hardware) to enhance and color match various photos and clips, that have often been taken at different times and places, where lighting conditions vary and sometimes were shot with different camera.
AI and machine learning software on iPad OS15 (and iOS 15) now has a virtual colorist actively adjusting your shots and enhancing and color matching them while you sleep. That is basically insane. That’s probably why it appeared that the photos and even the iPad itself had been upgraded.
Ok, I could go on and on about that one feature, but let’s move to some more features. There are also new effects that are added that vary with each memory (there are a lot more clips being generated, including various versions of the same idea to choose from).
In the experiments so far the effects are clearly better and more subtle than in iOS 14. Again in many cases I found myself saying the word “beautiful” when I tried find an adjective to describe the results.
For shots that have a vertical bias there’s a vertical geometric split screen effect, often with a thin black border, and it has a kind of 60’s on steroids feel with the bars sliding in and out and resizing into place.
Another effect not seen in iOS 14 is a kind of circular rotation – great for landscapes – it’s not a common effect probably because it is computationally complex, but for the AI, it’s a snap. Sometimes this effect has a kind of blur-dissolve added which makes it fun and, again, still tasteful.
It appears that the effects are not only better and there’s a larger bag of them, but they appear to evolve and adapt to the content, that is to say that the speed and depth of each changes with the music combined with the photo and video content.
Oh, and the music. OMG. Each clip has 6 songs pre-selected and the entire clip adapts, in real time (!), when you change the song, showing you various styles and looks that match. Apparently Apple Music is also connected if you have a subscription.
As a mater of fact, it is hard to be certain, as we have not had more than a few hours to test this, but nearly everything appears to be “live” and constantly evolving in real time. In order to “freeze” a version of a memory you have to “favorite” it (with the typical heart symbol) and then “add to memories” in order to edit (change the names or choose more images – or remove anything if it is not to your liking).
There is so much more not yet mentioned here: this article could probably be a book
The AI is also getting creative with names and “concepts” for the clips. For example, if you had lunch (or took photos) over the years in the same city (for me it was Knoxville, TN) it might look at the coincidence that you tended to take photos around midday in that town and then create a memory clip called “Lunch in Knoxville over the Years”. Or for example the clip at the head of this article: “Golden Hour Over The Years”.
This is an early and primitive foretaste of the literary ambitions of AI. In the new Photos App in iOS 15 it is beginning to “think” about when, where and why humans take photos and videos and then conceiving a story that fits the behavior it is witnessing.
Other titles go beyond the basic “Amsterdam in 2016” and start to use the understanding and visual ability to “see” what is in the photo to create a clip like : “Playing in the Snow at Christmas”. Snow? Does it know it’s cold? Maybe just that it’s white and happens in the northern hemisphere in December. This is just the very beginning of something that will evolve, hourly, from now on. I can’t wait.
Among the avalanche of new features and upgrades to iOS, iPadOS and most of all macOS 12 Monterey, there were two that were like a dream come true for anyone who has used AirPlay with AppleTv or “SideCar”, which originally came to the mac with macOS Catalina, and wished for one bold step further.
In an office environment, like our newsroom, being able to beam an iPad or mac on to a large conference style TV is great, but springing for the $ it takes to get a high resolution computer monitor large enough for group viewing is not such a great treat.
A fantastic compromise, one that many have wished for but never seen is the new option cogently called “AirPlay to Mac” which, just as the name implies, allows you to bean your phone or iPad (or I presume one mac to another) for paired or group viewing. (there were times when I, for one, forgot that this feature did not yet exist and tried to connect a mac screen using airPlay, to no avail).
AirPlay brings the Mac to life in all-new ways.
Even with tiny bugs that might arise at first when trying to get multiple macs to act as screens for a single source, once this is mature it should revolutionize meeting of small groups of colleagues all armed with trusty macs but wanting to do a group think and discussion session. (At a digital publisher meeting, like at Lynxotic, we might be looking at analytics data for the past week and all want to see the same data across all screens, for example.
Oh, and did I forget to mention that sound, just as in “regular” AirPlay, is included in the bargain. So even if it’s audio only that you want to share (like force feeding colleagues your favorite song) that is going to sound great on built in iMac speakers etc.
This seems instantly like something that is so obvious and intuitive that it could be one of those things, like AirPlay itself, that once entrenched and bug free, would be hard to live without.
Apple’s marketing copy:
“With AirPlay to Mac, users can play, present, and share just about anything — from the latest movies and games to vacation photos and presentations — from their iPhone or iPad right to their Mac’s stunning Retina display. The Mac’s high-fidelity sound system can also be used as an AirPlay speaker, so users can play music or podcasts on their Mac, or use their Mac as a secondary speaker for multi-room audio.”
Universal control, which sounds somehow ominous is, hopefully, just a simple way to more easily migrate live from device to device (of the same owner)
Though the mechanics of this feature were not explained in detail at the Keynote for WWDC2021, this is another feature that seems mind-bendingly obvious as a boon for any Apple device power user, it also seems strange that it did’t exist all along.
As shown with one example in the video below, it involves having a single mouse or trackpad control multiple devices. Or the same set up for a keyboard, or both. While there are some unanswered questions – such as would the keyboard designated as being the one to “universally control” another device automatically turn off the control on the remote devices native keyboard?
Perhaps this is a naive question since it appears that it is presumed that any device being universally controlled is owned and being used by a single human.
In one way this seems to have the best use when using, say, an iPad pro for a drawing task and then moving across to the mac to process the drawing in photoshop, illustrator etc. Honestly, sometimes it’s interesting to see each device as connected to a “chair mode” – iPad for a chaise lounge, iMac or MacMini for an office chair, iPhone or iPad mini for freedom from any chair, and switching from the more human-centric modes (chaise lounge) to get down to serious business on the biggest baddest screen and most powerful CPU seems like a utopian dream, with this feature activated and working without a glitch.
The ways this could be integrated into a workflow, and the permutations of how this could be useful, seem infinite, assuming it operates anywhere near as seamlessly as in the demonstration by Craig Federighi in the video. Being able to drag and drop, as he did, across three (3!) separate devices at will is pretty incredible, if not only for its simplicity and elegance.
As per Apple: “Universal Control lets users work more seamlessly across their Mac and iPad. Working across Apple devices is now better than ever with new Continuity features:
Universal Control lets users work with a single mouse and keyboard and move between Mac and iPad for a seamless experience, with no setup required. Users can even drag and drop content back and forth between devices — great for sketching a drawing with Apple Pencil on iPad and placing it into a Keynote slide on the Mac.
The Origin of Everything is Shrouded in Mystery – looking at Apple’s history yields many clues, however…
PART I of a 3 PART SERIES:
Given the sheer size, breadth and power of the various “Tech Giants” as they have become known, many, if not most would be skeptical if an assertion were put forth that all of them were a direct product or outgrowth of Apple.
Click to see “Steve Jobs” and help independent bookstores. Also available on Amazon.
Although there is almost constant complaining that Apple is not the innovator it once was, or that they sell overpriced and overrated products, with more marketing than substance, tracing back through the history of tech a very different story emerges. Further, all the way to the present a pattern holds true that traces all big tech back to Apple in a direct route from at least 1984 or earlier.
The whole story is long and somewhat hidden; and it diverges from the accepted notions of how the massive empires of tech came about. In the end it is almost impossible not to see the behemoths now known as Microsoft, Google, Facebook and others as little more than incidental occurrences, spawned the wake of Apple’s growth and innovation.
Apple is an entirely different company from what it seems from the point of view of the masses & the media. For example, just as now we have Biden vs. Trump we once had Jobs vs. Gates. You can decide which is which. Perhaps today it seems like a stretch, but up until around 1998 the two were considered opposites and as compatible as oil vs. water.
Above: vdieo Clip from the “One More Thing 2020 Event and Video Still Photo Collage / Lynxotic
There have always been a huge number of people who are offended by the high-price high-quality ethos that Steve Jobs created and that the company carries forward to this day.
Steve Jobs Steve Wozniak with the Apple 1 prototype
Much like Tesla owners are heckled by Toyota, Ford and Chevy pick-up truck owners, Apple has always had an army of detractors. And while for many years it was Windows / PC users now it is Android and Samsung. But if you set aside the Apple-derangement Syndrome, sister affliction to the fabled “Reality Distortion Field” there are some fascinating theories that could be put forth showing that Apple and Steve Jobs are the ultimate source of all tech since the Garden of Eden, or at least the 70s.
[Readers note: there are many accepted truths and fabled stories that will be addressed in this article. These are, at times considered “fact” and at other times questioned openly. If it bothers you when either of those choices are made to suit the narrative, you may, of course, opt-out at any time. All attempts have been made to remain true to historical fact, but no claims or guarantees are made of perfection.]
In The Beginning there was… XEROX?
In the beginning there was Xerox Parc. From that private think-tank of a copy-machine company emerged two incredible discoveries; the Graphical-User-Interface (GUI) and the Mouse (mouse). In the fable Steve Jobs is invited to visit in late 1979, to gather knowledge from the computer scientists and R&D gurus and later decides to “steal” everything he sees. Xerox, on the other hand, continues to believe that copy machines are the real future.
Click to see “iWoz” and help independent bookstores. Also available on Amazon.
This fable / anecdote is often used to illustrate that Steve Jobs and Apple deserve no credit for the ultimate ubiquity of the software that emerged from the GUI concept and, the mouse that came about cause of the… mouse. It is also said, or at least implied, that Microsoft was fully justified in stealing anything and everything they could from Apple software innovations because “Steve did it first to Xerox”. These kinds of rationalizations are the reason why Apple is still, to this day, not recognized as the source for all tech in the universe.
The more accurate take on this origin story is that Steve Jobs was the first to recognize the ultimate importance of the GUI and mouse combo (after all Xerox never made any real commercially viable attempt to make and market the discoveries from its own R&D) and that the future of the tech world would be built on the bedrock of these early innovations.
“…In fact, turning expensive, hard-to-use, precision instruments into cheap, mass-producible, and reliable commercial products requires its own ingenuity and creativity. This marketplace intelligence is different from, but not inferior to, the intelligence of the laboratory; it just gets far less attention by journalists and historians. In the case of the relationship between the work at PARC and the development of the Macintosh, this blindness leads us to underestimate the originality of Apple’s own work, and the differences between the Alto and Macintosh. “
Further, at the time Bill Gates was madly in love with the wonders of MS-Dos and in particular the money he could bank in licensing it to IBM and all bidders… It was only years later in 1985 when he famously decided to steal the GUI_ Mouse based system software apple was using, in spite of his promises to refrain from stealing when he was shown the secrets during his fabled meeting with Steve Jobs to discuss word and excel, early versions of which were already on the Macintosh. Hence the echos of “Steve did it first to Xerox” became the rallying cry for all those that seemed to justify the direct theft of Macintosh OS to create the clunky-named system called “Windows”.
This story carried on throughout the 80s and 90s and, all the while, a 1988 lawsuit was pending resolution, which has at its center the accusation, by Apple, that Windows 1, released in November 1985, was directly copied, a.k.a. inspired by the Macintosh OS. In the end, in another famous fabled incident, the suit was settled out of court in 1997, by then obscenely rich Bill Gates, for $150 million, thus rescuing Apple from almost certain Bankruptcy.
Moral of the story? Windows, PC’s and everything Microsoft ever became, can be directly traced back to Apple. This is the most obvious of the various lines of creative attribution leading back to Apple and Steve Jobs.
The next saga: Google’s connection and the debt owed to Anti-trust and Apple, will be more subtle but all the more timely. Timely as in right now this minute. Stay tuned for Volume II of “How Apple Created the Entire Tech Universe and it Finally Makes Sense”
![iPadOS 15 Preview: [Part 2] Deep Dive - AI and Machine Learning that will Blow You Away](https://i.ytimg.com/vi/XrU6cNxC1rM/hqdefault.jpg)
