Eagerly awaited M1x chip expected to star and be unleashed in new Macs
For the second time in October Apple is hosting a virtual event to reveal new products and software. On October 18, 2021 at 10 the show will start, streamed as usual, from Apple Park.
Virtual events have become the norm since the pandemic restricted the possibility for live audiences. A bright side for this is that the production values for the virtual event have improved drastically in the last year and that makes for great streaming and online consumption after the fact in various forms of edited clips and screen shots.
Coming hot on the heels of the big iPhone 13 extravaganza earlier this month, this is turning out to be a big year for long awaited new products, and the M1x will potentially be the crowning achievement of the year.
Already a hit in the initial release the M series was received with a near ecstatic reaction with many in a state of awe when the upgraded capabilities were tested and measured in the wild.
As is widely known, the Intel i-7 chip was the workhorse for many years, with added cores and clock speeds helping somewhat, but with the M1 there was finally something that could usher in a new era of processors, particularly when used with optimized software from Apple and others.
With the M1x (with being the projected moniker with the actual designation to be confirmed on the 18th) there could be an even larger leap into faster, more efficient processor performance.
Gear lined up according to rumors and best intel on the street
Highly anticipated are MacBook Pros, with various larger screens and possible other hardware upgrades in addition to the new M1x, a mac mini with updated specs would be huge and many have pointed to an AirPod 3rd generation with unknown improvements.
As is often the case, if there are additional announcements they are likely to be big surprises and very interesting, the consensus is so all pervasive that is there is any deviation (like the absence of any of the above) it is going to be a shock.
The tweet from Apple Mktng SVP Greg Joswiak has a fun video that sets the tone for the virtual presentation and is likely to be followed with great content live streamed on Oct. 18th, with the option to tune in later for replays.
Even without surprises this will be a very important event with immense repercussions for all mac users. We will be covering the action live with additional details so please stay tuned.
The biggest iOS update in years comes with a learning curve to match
According to analytics company mixpanel, the adoption of iOS 15 is much slower than iOS 14 a year ago. Speculation in the media for the cause of the reluctance is a few “bugs” that they also widely reported.
The fear of bugs is a good reason to take a major iOS upgrade at a slower pace, and this is probably a large part of the reason, for most people. On the other hand, after our review of both iOS 15 and iOS 15.1 (beta version) it is also true that this year’s free upgrades have a steeper learning curve than in the past.
Paradoxically, this is due to the fact that both the sheer number of new features, along with the ground breaking and innovative nature they have, are responsible for the cost and the benefit of taking the plunge.
The big 2 year transition to Apple Silicon is driving the pace of software progress
While iOS, iPad OS and macOS gradually converge as they grow (along with the Peripherals like Apple TV, Apple Watch, etc) the new features and upgrades to existing apps and actions are in the midst of an explosion.
Although this is great news, and the productivity improvements are, in some cases remarkable, especially if you use your apple devices for work and business, with so many new features there’s bound to be some reluctance to fight through the brain fog that can come with having to learn new unfamiliar habits.
Perhaps the best known example of this so far is the famous “address bar relocation” backlash that happened as a result of the new feature allowing the address bar to be at the top of the safari page on iPhone, or at the bottom, closer to our thumbs.
Initially there was no opt-out and it was bottom only (while it was still in the beta testing stage) and due to a rumored backlash from users this was upgraded to the current system where this “radical” new design is an option, with the more familiar previous layout also available. (see video below for details on how to switch back to the “old” style).
In the grand scheme of things going backwards is rarely better
This example of resistance to UX change, even by the “elite” beta users is a telling example of just how all pervasive the new software features are in iOS 15, and how much we will all need to learn new “tricks” to get the most out of the changes and added functionality.
It is also a long standing Apple tradition to try to make things, in both hardware and software design, that “just work” and do not require an “owners manual” or how-to guide to figure out.
While this, in the best case, is miraculous and we “get” the new features in an intuitive metaphorical heartbeat, more often recently, there is a frustrated moment of near panic when we find ourselves in a software dead-end, with no obvious back button or option menu to select from.
For this reason, it appears that the usefulness and necessity of how-to videos and guides, the very ones that Apple is in the business of making unnecessary, are more important than ever.
How-To guides get a new lease on life, thanks to Apple
Thankfully, Lynxotic, and others are on the case and we are working overtime to provide the next generation of DIY documentation, both in video and article form for iOS 15.1, macOS 12 Monterey, iPad OS 15.1 and beyond.
It’s great to be able to absorb new features and design upgrades intuitively and without the need for a separate learning project to educate ourselves enough to use the devices we are already using.
However, with the massive and increasingly more powerful potential of the new Apple Silicon fueled software upgrades, proactive learning may be something that is not just a necessary evil.
It is looking, rather, like it will be semi-permanent and highly fruitful activity we will want to add, willingly, to our overburdened existences.
At least for a couple of years during the transition to a much better future in the life of the Apple device & software ecosystem.
With live view in Find My and ETA in Maps, iOS 15 is on a whole new level with keeping track of traveling significant others
Find My App (left) in iOS 15
In an update that is “just there” there has been an upgrade to the performance of the oft overlooked Find My app for iOS 15. In case you don’t use it, it’s the app that will help you find your iPhone or other iCloud connected device, as well as AirTags (or third-party geolocation products) and the devices they are attached to.
When you are following a person, generally with an iPhone or iPad (though, again the above additions and exceptions apply) you can click on that person’s name or icon (once they’ve allowed you to see their location (by turning on share my location in the FindMy app on their iPhone), in Find My and the their current location will show on the screen.
This is especially helpful, of course, if they are driving home from work, or on a road trip and you would like to follow along to see when they arrive, as examples. This level of intimate knowledge may not be necessary or appropriate for every contact in your address book (!) but between significant others (one obvious example) it can be incredibly useful.
One caveat, however, is that since this is a “stealth” update that “just works” your actual results may not be the same. Our video example was accomplished with two connected iPhone 13 Pro Max phones, both having 5G connectivity. Your results may vary.
With live view and in conjunction with the Maps app location tracking is now in a whole new universe
The update, which has been in a gradual roll-out since the public release of iOS 15 and upgraded in iOS 15.1 is a live feature where you can literally see the person (the icon or photo they have set) as they are driving, or even walking, and follow along with a moving map that updates in real time.
If used, for example while driving and using maps for the route, the map will update incrementally, showing the progress with a highlighted route all the way to the destination, while in FindMy there will be a second by millisecond live map showing the actual location as it changes. See the video above for the full effect!
The Maps app will also send notices and updates with an Estimated Time of Arrival (ETA) and will re-notify if the arrival time is significantly sooner or later (the exact amount that is deemed enough of a change to trigger a notification is unclear.
Just plain fun to watch, but also useful if the movements of a loved on are critical
There is also a secret, exclusive tip that we can divulge, which we stumbled on through trial and error. If you are watching someone driving, say on a freeway with little traffic, and they are moving smoothly along, but you want to see them at full speed, you can do the following:
Use a two-finger pinch-and-zoom gesture 3-4 times – the 3 or 4th gesture will zoom in to-the-max
Repeat #1 to maintain zoomed in status
Allow Find My live view to re-set to the standard zoom (medium)
Repeat as desired
Using this technique the person / car will be seen in an extreme close-up of the road (highway, freeway, etc.) and will appear to be traveling at the actual speed they currently are in relation to the zoom.
Think of it like a virtual drone that is following the car / person and then dives in close and has to keep pace to keep the subject in frame. Crazy.
In zoomed in mode it is also possible to do a one-finger-swipe in the direction of movement in order to keep the car / person in view (rather than letting them drive starlight off the edge of the iPhone screen).
The future is out there, and already here on your phone (with enough bandwidth and other possible requirements).
Increasing this feature to this degree of intensely detailed functionality may not be much more than a basic useful feature on overdrive, but applications for the future, for example the same feature but with satellite imagery, or maybe a simulated live view, could be a metaverse standard communication activity. We might all need to get used to having the ability to stay literally connected (in a virtual way) even as we hurtle through space. In a self-driving Apple Car, perhaps?
Bokeh into a corner; the coming of age for smartphone photography
Much has been said about the new camera system, and in particular, the top end iPhone 13 Pro and Pro Max versions. Cinematic mode is one new feature that has generated a lot of interest, some admiration and some confusion.
Apple marketing has not helped to clarify – the emphasis with the name and all the marketing materials and ads are jumping into the claim that this is a high-end pro replacement for prime lenses and a human focus puller. And you should make professional movies with it.
This is a valid idea, to a point, and it’s a fantastic accomplishment to have a cinematic mode at all, especially in your pocket. And, perhaps, the limitation at HD video and no 4k capability will be overcome, either in software or with the iPhone 14.
But, in reality, none of that matters. In reality this mode was absolutely necessary, with or without the autofocus “robot-focus-puller” trick.
Including the telephoto camera made the cinematic effect absolutely mandatory
So taking a small step back for a moment, let’s look at the big changes in the iPhone 13 Pro cameras compared to the iPhone 11 Pro and iPhone 12 Pro. The big change was the ultra-wide camera / lens combo along with the 3X 77mm telephoto camera / lens. In total making 6x optical zoom range possible.
It’s the 77mm that is the huge move. Why? Well, if you are a photographer and have ever worked with a prime or zoom lens of 77mm or above you will be aware of a couple of things. The size, length and weight of the lens is massive. And to duplicate that in a tiny camera module as part of a three camera array on an iPhone presents a pretty big challenge.
Obviously the size limitation makes it impossible for a “real” 77mm lens to be strapped to the back of an iPhone. And, even if the magnification was possible, what about the “look” and the quality of the image?
And what constitutes, in photographic tradition, the beauty and style that makes a long lens like a 77mm artistically desirable? Because just having the ability to get a closer view or shot of an subject without moving the camera closer is a small and relatively insignificant part of the challenge.
Bokeh because it’s beautiful and highlights the subject (often a human or animal) in the video or photo.
Now, to be clear, we are really talking about video recording, not just photos. Because the portrait mode on iPhone has been around, and improving, for years, and cinematic mode is creating similar effect and adding a new level for video.
Adding a 77mm lens, however, if it was not getting the bokeh effect in the video recording, would have been a disappointment of monumental proportions for photographers and would not have been an option.
And, good news folks, the bokeh in cinematic mode when using the 77mm lens is very usable and takes the cinematic style potential into a creative realm that is “Pro”, with or without the focus pulling tricks, and / or the panning or dolly shots with a moving camera.
Both the addition of “portrait mode” backgrounds for FaceTime video, which is a look that has become standard for YouTube videographers, and, more impressively and more importantly, the ability to shift through the lens “kit” as a feature film director would, using different focal lengths (like swapping out prime lenses on a feature film shoot) is a game changer.
However, none of this would be even remotely possible if the switch from a virtual 26mm wide angle prime lens to a virtual 77mm prime did not have some emulation of the unique qualities such as depth or field and, above all, bokeh that shifted as well.
And, thankfully this works the way a director or DP would want – not the same, of course, as a rig that has lenses that cost as much as a dozen iPhone 13 Pro Maxes, but one that is unique and able to produce beautiful, soulful and human effects that are a computationally assisted approximation. That look, or at least something with a similar feel, is akin to what has inspired generations of filmmakers to love what a 77mm or 85mm or even a 100mm (my personal favorite) does for a human subject in the wild.
It is now possible to produce images that have the convenience of an iPhone and the creative mix of styles that could previously only be found in a full professional kit with multiple prime lenses, and that is something that will change and impact the quality and style of everything we watch, particularly in production areas where million dollar kits are not an option.
Above: Photo Collage / Lynxotic / J. Flavia / Unsplash
Ear related! 2nd best and more are also interesting
With so many new features on the iPhone 13 Pro models, and with so many of them made possible by iOS 15, the A15 bionic chip, the 16-core Neural Engine, which performs up to 15.8 trillion operations per second, and power features like Cinematic Mode and Smart HDR 4, machine learning and other hard to explain facets of the overall experiential upgrade, sound playback (and recording) are often barely mentioned, it seems.
Ever since there was the biggest Apple success story near the turn of the century there has been a special relationship between the fruit company and music / sound. I’m talking, of course, about the iPod.
Long before the iPhone was even a rumor, the iPod was a huge success, taking over the mp3 player market and, with the iTunes store for music downloads, launching the software and services division, for all practical purposes.
It’s hard to imagine now, but there was doubt that Apple could make it in the competitive cell phone market, with behemoths like Nokia and Blackberry so well established. It was the iPod’s success that made it seem plausible.
There was one thing that the iPod never had, however; speakers. And even the recent iPhones, with speakers for voice and music, if you didn’t use your AirPods for that, had speaker and sound quality that was not on the quality level of the larger iPads.
With a much larger area to hide speakers, the iPad was always an obvious choice for watching movies and listening “out loud” via the built in speaker system. With an iPad pro that could be pretty spectacular with a relatively full frequency spectrum and, more recently via software upgrades, spatial audio.
With iPhone 13 Pro models the audio barrier has finally been shattered
In a tiny, nearly forgotten passage at the very end of a list of new specs and enhancements in the iPhone 13 line, Apple adds one more thing; a stereo speaker at the top where the notch is located and a second stereo speaker at the bottom next to the Lightning port.
What it doesn’t mention is the improvement in the sound quality. Like so many features in the newer generation of devices and software, this unassuming, seemingly simple statement is just the tip of the iceberg and does not divulge what’s really going on.
Once more a combination of all the recent software and hardware upgrades combine to produce an experience that goes beyond what you could expect with these tiny, nearly invisible, speakers.
First, the two stereo speaker sets are, sound wise, equal in quality. So when you are watching a movie in landscape mode there is a distinct stereo effect. This is enhanced by spatial audio and dolby atmos depending on your set up.
The actual experience is noticeably “iPad like” and in some ways even goes beyond. Having the phone relatively near you, due to its size, and listening to a high quality movie score, there’s a feeling that your phone has morphed into a personal theater – as long as you can let the sound out into your local environment.
Try “SharePlay”, once it’s live in iOS 15.1, or just manually sync with your partner, assuming you each have a new iPhone 13 (!) and you will get a glorious room filling surround experience from the 4x stereo output (8 speakers?!) into the room.
And the mysterious mics also hidden in multiple places, are also a big upgrade – the seem to switch roles for video, calls etc and maximize the audio quality in live recording situations.
Apple’s software and service bundles and ambitions are driving hardware and iOS upgrades
As jubilant as this may sound, there is also an ulterior motive lurking. Some of the audio features work best (or at all) with an Apple Music subscription. And having more subscriptions, Apple TV, Apple News, Apple Music, iCloud Extra Storage, along connected devices, with so many available, it becomes an ecosystem of plenty for Apple, already the largest company by market cap.
On the optimistic side there’s always Apple One Premiere, the top of the line for bundled services (see below) and looking more and more like a steal at $29.95 per month.
Perhaps, one day not to far away, there will be a Apple One Premiere plan that also includes all Apple devices and you just trade them in every two years (every year?) or maybe you never own them at all?
The way the upgrades in hardware, software and the rest are becoming more interdependent and how crazy it already is to upgrade various devices (assuming you have more than one or two) yearly or bi-annually it’s an interesting idea to try and imagine.
And with an Apple Car perhaps on the way (self driving and outfitted with all the rest of the tech and service bundles) this could be a whole-house, whole-office (will there still be offices?) all transport bundle too. Apple haters will be in trouble, and have to move to Google Island, but otherwise, hey, why not?
Apple One Premiere example package:
Speakers after tear down by iFixit:
credit: iFixit
Audio Playback
Audio formats supported: AAC‑LC, HE‑AAC, HE‑AAC v2, Protected AAC, MP3, Linear PCM, Apple Lossless, FLAC, Dolby Digital (AC‑3), Dolby Digital Plus (E‑AC‑3), Dolby Atmos, and Audible (formats 2, 3, 4, Audible Enhanced Audio, AAX, and AAX+)
Spatial audio playback
User‑configurable maximum volume limit
Video Playback
Video formats supported: HEVC, H.264, MPEG‑4 Part 2, and Motion JPEG
HDR with Dolby Vision, HDR10, and HLG
Up to 4K HDR AirPlay for mirroring, photos, and video out to Apple TV (2nd generation or later) or AirPlay 2–enabled smart TV
Video mirroring and video out support: Up to 1080p through Lightning Digital AV Adapter and Lightning to VGA Adapter (adapters sold separately)9
Upgrades for hard and software, though groundbreaking and exciting, do have limitations and problems
The new upgrades for iOS 15, iPad OS 15, mac OS 12 Monterey and the rest are in many ways amazing, feature filled wonders, as we’ve discussed at every opportunity. The multi-year transition to a more unified system across all apple devices is underway and we are big supporters of the benefits.
However, nothing is perfect, and particularly in the early days it is to be expected that glitches and strange twists and turns in the journey can disappoint and confuse along the way.
Below we’ve outlined a few.
Various less than perfect ideas and execution in the OS software
Some issues are not really issues at all but things that people just don’t like. One example is the move of the address bar on safari in iOS 15 to the bottom. Many people had trouble getting used to this so a button was added to move it back to the top.
Other glitches include a false warning that you are out of storage space. Others have reported a reduction in perceived (if not real) battery life. Although these are minor annoyances and will be fixed with future updates, such as iOS 15.1 due any minute now, they show that this bug hunting is, unfortunately part of the process of any upgrade, much less a huge and important one like iOS 15.
There are also specific limitations though that should be mentioned about the iPhone 13 Pro camera system.
This issues are less bugs or errors and just limitations that may, or may not, be improved at a later date.
The new high end Pro camera system for the iPhone 13 Pro series is a major upgrade that has so many features and new capabilities that it is hard to even list them all, let alone illuminate the multitude of options and enhancements that they create.
On the obvious down side, however, a few things have jumped out at users now that these phones are in the wild.
Cinematic mode only works (currently) in 1080p. This is a serious limitation, since the whole idea of “Pro” is 4k and above. Many even go so far as to say that 1080p aka HD is no longer the standard for video and even obsolete. While there are rumors that this could get a software upgrade, perhaps even before the next iPhone model next fall, but it is not at all clear if, or when, that might happen.
This limitation is a fairly serious one, since an entire project would have to be shot at 1080p HD rather than 4k to make any use at all of the beautiful and fascinating rack-focus effects available in cinematic mode.
Less and issue but often mentioned is the inability to shoot 4k slow motion footage.
The lack of slo-mo at any resolution above 1080p is also something that has surprised aficionados. There is an option for 1080p at 240 fps, but unless you are shooting ultra high speed action that is not a hugely useful setting.
It seems odd, since a large part of the limitation is likely the large amount of data required to make this happen at 4k but there is a silver-lining here that few have mentioned in recent articles decrying the lack of 4k slow-mo options.
Since the system is already capable of shooting 4k at 60fps, and a final project setting for editing could be 4k at 30 or even 24fps, the 4k 60fps could be seen as a double speed slo-mo setting for a 4k video projects shot at 30fps for standard and 60fps for footage to be slowed to 30fps for the 1/2 speed slo-mo effect.
In the feature film 35mm celluloid days this was a very common and useful way to get slow-mo without eating up tons of expensive film stock.
Also, shooting at 4k 60fps for a 4k 24fps project would yield a 1.5 ratio of frame rate, giving an even more extreme slow-mo effect. For most slow motion effects 1 to 1.5x speed in-camera for later playback at the project rate is more than adequate.
The 120fps rate, since the top frame rate at 4k is 60fps, is, indeed, double which, as stated above, standard.
Therefore, for all practical purposes, there is already a way to produce beautiful 4k slow motion effects in a 30fps or 24fps project and have those be in camera pristine slo-mo and not the less desirable edit-only EFX.
Summing up, even with glitches and minor disappointments, it’s a beautiful world and now we just have to shoot it
If no more serious glitches or known issues pop up during the transition from iOS 14 to iOS 15, and iPhone 12 Pro to iPhone 13 Pro, we can be satisfied that this is a monumental job well done by the gang at Apple.
Though there are a lot of shortcomings that we may perceive in the new world topping combo-pack; iPhone 13 Pro Max running iOS 15.1, these are when compared to far more costly and cumbersome alternatives, or simply, when compared to our wildest dreams. Those will have to wait a few years, in all likelihood.
Human greed is a powerful thing. When given a photographic system that even attempts to approximate a profession system based on prime and zoom lenses and accessories, there’s a tendency to want it all, right now!
Of course, instead, what we get is an amazing extension of the iPhone photo tradition – taken up a bunch of notches at once. The computational enhancements are incredible and will only get better – in many cases without a new phone as they are based on AI and machine learning, which as the name implies, are continually improving while you sleep.
It is also the reason why real lenses and traditional DLSR cameras still have an important use and value.
The new system unveiled with the iPhone 13 pro is revolutionary precisely because of the potential for people to create new visual expressions and ways of communicating.
These photographic traditions and the efforts that were made in the design to emulate them are important and valuable. However, the future will benefit from the spontaneous and new ways that people will decide to use this evolving system and the current extensions of our eyes, ears and minds….
The cameras are at the center of what makes an iPhone 13 a Pro investment
Direct hands on experience with something as complex and interesting as the new iPhone 13 Pro Max is invaluable for a useful assessment. After a few days and also taking into account some observations of others I will attempt to shed light on the state of the art of iPhone as of September 2021.
Comparing this iteration of iPhone with the previous versions is meaningful for buying decisions, but it must also be compared based on what it can do for a professional that has a need for a higher grade of gadget.
Judging and comparing the machine as a whole is also necessary, since the cameras are not cameras at all be just one part of an integrated system of visual (and audio!) production tools.
Big changes that begat others and on the circle goes
The first thing I noticed, out of the box was the sheer size of the 13 Pro Max, particularly compared to the 11 Pro Max, which was my previous workhorse. From photos I had gathered that the three cameras stuck out more and, yet they do, so much so that it is almost comical.
If you brave the world sans case and put this monster in your the back pocket of your loose fitting jeans, the bulge from the cameras will feel like you are doing something crazy, as it is as if they are rubbing against anything they touch, continuously.
That’s not all about the physical size, though. Looking at the diameter of the three circles (lenses) they appear significantly larger. Believe me, they are. Since the 11 Pro max and the 12 Pro Max have the same size triple camera layout (spec upgrades notwithstanding) this is an immediate and obvious change.
Above: Photo / Lynxotic
The increased size and weight of the camera itself is noticeable, more than I expected. The screen appears far larger due to the new specs and it is a bit of a shock at first, but the level of quality is the biggest and most noticeable feature.
The design logic has an implied history that jumps out once you start to use the camera system.
The changes to the three cameras are significant. After two years of using the 2019 11 Pro Max the framing options, based on the three lenses is a complete new experience.
The ultra wide 13mm equivalent is a bit of a bold and crazy choice. If I was ordering a set of lenses for a music video shoot the ultra wide might go as far as 11mm (very wide!) but that is basically an EFX look and causes an almost fish-eye look.
The 13mm is literally as wide as you can get without getting into potential “clown” territory, which is fun but not usable for a non-EFX composition.
What is odd, in a way, is that the “main” lens at 26mm equivalent is still very wide meaning that the standard 40mm equivalent, which was always considered the closest to a neutral look, is absent here.
Similarly, the telephoto lens at a 77mm equivalent is exactly the same type of choice – once again in my kit this would have been a 100mm for a deep bokeh and a noticeable sweet spot that is ultra-flattering for close ups and head shots.
The 77mm, therefore, is a long enough lens to get the magnification and emulate the look of a telephoto style. But wait, no glass no bokeh.
Both the 13 Pro and 13 Pro Max have the same sensors, optics, stabilization and features. The three cameras in the Pro models span a 6x optical focal length range.
This is where the logic of the design and how the system works, as a whole, begins to get deep.
Once you have made the commitment to not only extend the range of the entire optical focal length range to 6x the differences between a glass & steel 77mm prime lens and a “cell phone camera” must be addressed.
The 77mm requires the bokeh and relatively narrow in-focus range of a “real” telephoto lens is the stylized creative uses that a full kit of prime lenses makes possible is to be achieved.
This is addressed with the already present portrait mode – with enhanced functionality made possible by the A15 chip, the machine learning, AI and neural network – in other words software and computational assists.
And for video, cinematic mode is an absolute must – since the same bokeh effect and stylized effects are needed and desired for video.
All of this does not include the macro effects that effectively extend the range into the nearly microscopic. This feature requires a whole article, which you can check out here.
Getting to a full photographic system in your pocket, and beyond.
Once the effects and artifacts of the 77mm style glass prime lens have been added to the mix, emulated things get more interesting.
Since the bokeh and artifacts in the cinematic mode for video are computational and not photographic, they are stored separately and can be altered after the fact, just like has been the case with portrait mode all along.
This is a big deal in one way, since it could never be conceived of with traditional lenses and cameras. It also, however, one more variable to consider when putting together a large batch of footage for a project. This adds a new layer of creative flexibility, and choices to contend with.
Further, since the long lens stylizations are a byproduct of and influenced by focus settings, that has to be in the mix also. That produced the need for the cinematic mode which you can think of as a slightly stoned robot focus puller. who is also a little bit psychic.
The first robot camera assistant is already in the box when your phone arrives
Let me explain…. A real life focus puller (doing rack focus settings) in real life would function roughly as follows:
A shot is planned that requires a focus pull from one subject to another – this could be a close shot of a face panning to another face, or a close up that refocuses from the foreground to the background, for example. The focus must also factor in any movement of the camera / dolly.
The two desired subject distances are measured (using a tape measure) and the focus settings noted. In complex shots this can be multiple focus settings and a particular speed of the “rack pull” from one to the next.
Often such complex focus / dolly set ups must be rehearsed multi times just for the focus puller – so that his error does not ruin a perfect take when, for example, the actors get their best performances.
So, in the robot world practice is also good – and a plan is almost essential, but the virtual focus puller will go with the flow, and try to anticipate and predict what you want him to focus on in real time as you shoot.
This is pretty incredible and also, much like autocorrect typing, sometimes very successful and sometimes comical in the outcome. What is tricky is how to get the robot puller to know what you are trying to have as a subject if it is not a persons head or face.
Also, if the action is fast or if you are shooting something that has no pre-determined outcome or script, like a political protest or a sporting event, you will get somewhat random results.
This makes the name apt, since cinematic also implies a movie with a plot and a script.
Conclusions and a few known limitations and caveats
Human greed is a powerful thing. When given a photographic system that even attempts to approximate a profession system based on prime and zoom lenses and accessories, there’s a tendency to want it all, right now!
Of course, instead, what we get is an amazing extension of the iPhone photo tradition – taken up a bunch of notches at once. The computational enhancements are incredible and will only get better – in many cases without a new phone as they are based on AI and machine learning, which as the name implies, are continually improving while you sleep.
There are specific limitations though that should be mentioned about the iPhone 13 Pro camera system.
Cinematic mode only works (currently) in 1080p. This is a serious limitation, since the whole idea of Pro is 4k and above. There are rumors that this could get a software upgrade during the year but it is not clear if or when that will happen.
Along with the lack of slo-mo at any resolution above 1080p there is a lot of disappointment in this issue. It is the reality of how difficult the computational “assist” really is to achieve that makes this a big step that is still in the future.
It is also the reason why real lenses and traditional DLSR cameras still have an important use and value.
The new system unveiled with the iPhone 13 pro is revolutionary precisely because of the potential for people to create new visual expressions and ways of communicating.
These photographic traditions and the efforts that were made in the design to emulate them are important and valuable. However, the future will benefit from the spontaneous and new ways that people will decide to use this evolving system and the current extensions of our eyes, ears and minds….
”It Just Works” is the basic how-to for the new Macro-Mode on iPhone 13 Pro
Steve Jobs was famous for repeatedly using this line to describe in product demos how something was so intuitive that no user manual would ever be needed. While this phrase has also often been used to try to help Apple accountable when something doesn’t “just work” it is a core design principal and an important part of the legacy of Steve Jobs, up until the current day.
The new iPhone 13 Pro (we are using an iPhone 13 Pro Max for photos and testing) has so many new features that it can be overwhelming to try and absorb, at first. Fortunately this one is almost completely intuitive to learn to use, if not obvious.
A short history of what the heck macro photography is
I will never forget when I was first taught about macro lenses and learned how to shoot extreme close ups. I was working with a professional camera operator (as a music video director) and I wanted to do a close up that would be so close as to be considered a macro shot.
Novice that I was at the time, I assumed that you could just keep pushing the camera closer and closer and focus on the tiny area desired, with no further ado. When my operator told me we would need a special “macro” lens adaptor (that we had not ordered as part of our kit), I felt a bit foolish and knew I would need to bone up on the macro ins-and-outs for the future shoots.
For traditional photography and film shooting there are macro lenses and adaptors that can enable super-close-up shots. These can be simple and relatively cheap or more elaborate and expensive for traditional film cameras and digital DSLRs. There have also always been lens attachments that can be used with an iPhone to get some macro capabilities.
Now, with the iPhone 13 Pro and Pro Max you have a built-in software enhanced macro capability that “just works”. Currently this feature is not supported on the iPhone 13 (regular) or mini.
Above: Photo / Lynxotic
Real world test shows some extreme possibilities that beg for more
As with many of the new camera features in iOS15, when using an iPhone 13 Pro, the macro mode is built-in and needs only be triggered by your behavior.
To shoot your first macro photo follow these steps:
Open the camera app and choose either photo or video (not cinematic or portrait
Move the phone closer to the object that you want to shoot a macro photo of. When you get close enough you should see a “jump-cut” indicating that you have automatically switched to macro mode due to the untra-close object in frame have been detected by the software. The macro range appears to be 14cm to 6cm according to specs.
Move camera into position (you might be almost touching the object if you want an ultra-macro-look) so that the object is in focus and shoot.
Above: Photo / Lynxotic
Above: Photo / Lynxotic
Some considerations: With large professional macro lenses, which are “slow”, extra light would be required to get the proper exposure. This is less true with the “computational photography” hybrid on the iPhone 13 Pro, but light conditions, as always, will impact the photo quality, a lot.
In particular, with a huge phone so close to the subject of the photo it is sometimes difficult to avoid shadows cast on the object being shot by the phone itself. It is also a somewhat surreal feeling, at first, to be shooting an object that you are almost touching with the lens.
Our live real world experiments (shown in the various photos above and below) are using every possible combination of lens and the automated software to see just how extreme the results can be. In a word, the answer is; very.
Above: Photo / Lynxotic: A reference photo to give scale, the two following photos show the extreme macro close up possible magnification
Above: Photo / Lynxotic: A reference photo to give scale, the two following photos show the extreme macro close up possible magnification
The future of computational and software manipulated imagery production using iPhone and iOS
Anyone who had initially learned about photo techniques based on the “real world” environment of glass, steel and celluloid will no doubt at times feel confusion, anxiety or even a sense of loss when confronted with software, AI and machine learning based computational photography.
And, yes, purists have commented and complained about the various trade-offs when images are produced with software manipulation during the shooting process.
But, as results here show, most of us will feel a sense of exhilaration at the visual and artistic potentials that are becoming possible – all using a device that is, pretty much always, “in your pocket”.
While a multi-thousand dollar high end professional lens, using optical grade, painstakingly engineered glass (usually from Germany), can be used to produce world class image quality, now and in 100 years, the benefits of computational hybrid photography techniques are already going in a whole new direction.
An important, and nearly infinite, benefit is that these enhancements are being improved, both through human based code improvements, and even more so, by machine learning and AI on a continual basis.
As we’ve discussed in previous articles, the fact that these improvements are inevitable and will potentially even accelerate, “while you sleep” is a mind-blowing concept that spills into all aspects of future potential for iPhone photo techniques.
The trade off is large, if you want to turn off these “artificial” enhancements, you will have to wait for macro mode (or use current work arounds) and then switch off night-mode and personalized filters and other beautifying add-ons in order to get a more “natural” or realistic look.
Apple, meanwhile, is 100% all-in with the idea of making iPhone photography intuitive and as beautiful as possible, even if, in some cases the “beauty” is enhanced beyond reality (!).
The photos and degree of magnification possible with macro mode on an iPhone 13 Pro, as seen in these rough test photos, is almost surreal. So much so that it’s easy to imagine that, not long in the future, a medical grade microscope could be possible. One that “just works”, of course, and usable by anyone, anywhere and all on a device that’s already in your pocket.
Pro 12MP camera system: Telephoto, Wide, and Ultra Wide cameras
Telephoto: ƒ/2.8 aperture
Wide: ƒ/1.5 aperture
Ultra Wide: ƒ/1.8 aperture and 120° field of view
3x optical zoom in, 2x optical zoom out; 6x optical zoom range
Digital zoom up to 15x
Night mode portraits enabled by LiDAR Scanner
Portrait mode with advanced bokeh and Depth Control
Portrait Lighting with six effects (Natural, Studio, Contour, Stage, Stage Mono, High‑Key Mono)
Dual optical image stabilization (Telephoto and Wide)
Sensor‑shift optical image stabilization (Wide)
Six‑element lens (Telephoto and Ultra Wide); seven‑element lens (Wide)
Apple’s tweet, presumably, to avoid a collision course with the iPhone 13 arrival day (big!) says it all. A sudden, last minute escalation of the time frame for this highly anticipated new series:
From @Foundation_’s epic debut to @TedLasso’s Emmy-winning antics, watch the latest episodes from Apple TV+ three hours earlier this week. Streaming begins Thursday at 9pm EST/6pm PST.
Apple TV tweet
Perhaps a planned sudden breaking news update to the years long scheduling for this big sci-fi event? Hard to say – maybe the iPhone 13 arriving in stores and for some folks arriving by UPS is more of a distraction than expected, in the eyes of the Apple TV+ big-wigs?
Of course, that’d be a good thing since it would mean that the futuristic phone has just too much juice for the venerated classic book series come-to-life as a streaming series on Apple TV+. Hooray for both, I suppose. If you are starting to become enamored with Apple TV+ shows after having fun with Ted Lasso or other recent hits (really a hit, seems so according to the Emmys ) that are perhaps the early beginnings of a trend…
And last, but definitely not least, is the long-awaited sci-fi adaptation of the timeless classic “Foundation” by Isaac Asimov.
click to see “Foundation” and help Lynxotic and independent bookstores. Also available on Amazon.
The first 3 episodes of Apple TV’s “Foundation” will be live tonight (!) and will ultimately have a total of 10 episodes in total when all is said and done.
From @Foundation_’s epic debut to @TedLasso’s Emmy-winning antics, watch the latest episodes from Apple TV+ three hours earlier this week. Streaming begins Thursday at 9pm EST/6pm PST. pic.twitter.com/vxkkAEUuOe
That’s not all. Apple TV+ is also bringing us an extraterrestrial extravaganza. On October 22nd (when the first 3 episodes will be released), sci-fi fans can experience what it would be like to live through an alien invasion. Joy!
When the iOS 15.1 update drops for the general public (likely soon as it’s already been seeded to beta testers since Monday) it will feature the ability to add your proof of vaccination status to the Health app and then create a vaccination ID card in Apple Wallet.
Many businesses, venues, restaurants, and more are requiring proof of vaccination for entry. For example California is the first state where proof of COVID vaccination or negative test for indoor events over 1,000 people.
The new feature in iOS 15.1 is made possible by the support Smart Health Cards which are valid for California, Louisiana, New York, Virginia, Hawaii, and some Maryland counties, as do Walmart, Sam’s Club, and CVS Health.
Above: ID in iPhone Wallet
Therefore, using this system you would be able to to look up their information in state databases, if you are in any of the states listed above, but if you were vaccinated through at Walmart or CVS it will also be feasible to add your information to the Health and Wallet.
Once you have gone to the web site for your state, for example in California it would be found at https://myvaccinerecord.cdph.ca.gov where you can type in personal information such as name and date of birth to get access to your records and status.
Though iOS 15 already has the ability to download the information to your Health app, and you can do this today, the last step, adding an ID to your wallet from the health app will not be possible until you have upgraded to iOS 15.1.
The record is locked to your name and can only be used by you. There will be a QR code that you will first download to your health app on the iPhone, then, once it is in the health app there will be a prompt to allow you to “add to wallet”. By clicking that link a vaccination ID car, with the QR code will be generated and added to your wallet.
iOS 15.1 is likely to be available under > General > software update in your phone’s Settings app within days. (Our guess is by Monday, September 27, 2021)
Tap the download link on your iPhone or iPod touch.
Tap Add to Health to add the record to the Health app.
The new Os’s are free and will be adopted fast if recent past is a guide
Apple has had a fairly predictable cycle for new iPhone releases and the yearly, free, software upgrades. If you use your apple devices for business or WFH like many, this ritual can be excruciating since you already know you will have to get your hands on the best new gadgets.
Nevertheless, with sky high prices for the best devices not going away, choosing when exactly to upgrade which devices can be a tricky process requiring skill, cunning and some serious bucks.
A lot of us see the iphone top-of-the-line product as a must upgrade either every cycle or every-other year if budgets are tight (and some years do seem like “off” years).
For iPads, various mac machines, Apple Watch, Apple TV and so on, there is more leeway and potential confusion. And for mac, there are times (like now!) when we all know the next iteration of various models (macbook Pro, mac mini, mac pro, iMac 27” +) are on the way but there is the unknown factor of what to pick and when-the-heck it can be ordered and shipped.
We all know there is a chip shortage, and with the Apple Silicon M1 potentially being upgraded for a slew of machines to the M1X, M2 or M2X as various rumors have discussed, the timeline is very uncertain.
The best things in life are free, software edition
All this leads us to the good, even very good, if obvious, news. iOS 15, iPadOS 15 and macOS Monterey have been in public beta for some time now and, if history is a guide in this case, should be released publicly soon after the Apple Fall Event announcements on September 14th, regardless of what hardware is coming down the pike, or in what particular order.
Generally the hard date for the new OS systems to be public available is the date that any new hardware, always optimized for the new OS, hits the street and becomes deliverable.
Sometimes certain iPhone models, such as the very high end Pro Max, etc., are delayed, but whichever model ships first that device should also be shipped with the Golden Master of the new operating system, iOS 15 in this case.
This is not 100% guaranteed, as nothing in like and Apple releases is 100%, but this looks extremely likely. Therefore we could and should see the new iOS and macOS going live publicly soon, possibly this week.
What to watch our for and expect, besides great new features and work-flows
Often in the past, a “Golden Master” release has been followed within a day or two with an update patching issues that arise once a mass “test” has revealed flaws and weaknesses in the initial public version.
This is nothing to worry about, as per past experiences, but if you are someone that gets easily annoyed by constantly updating, you could wait a week or so to bypass these intermediate “patch fix” versions.
Also, since with Apple, as opposed to Android, the adoption rate for people to upgrade quickly to the newest versions of the OS is extremely high there will be a sea change in the air. That means that within a few weeks up to a billion devices, or more, could be running the newest OS systems across all the various devices in the wild.
This is great news, because some of the best features in all the new software upgrades function best with various devices within an iCloud account or family group and, in some cases, between two devices anywhere interacting, as long as they both have the newest systems.
The best new features are only going to get better after the launch, more so even than usual; here’s why
During our tests of the various systems, first in the developer-only phase and then in the more recent public beta, one thing was a small annoyance that, after the full launch, will instead become a huge plus.
When operating within a company, for example, and in some cases with multiple devices on the same iCloud account, there have been a lot of glitches related to how the Big Sur devices interact with the macOS Monterey devices, or an iPhone with iOS 14 and one with iOS 15 function in tandem.
This is because, more so than in any previous upgrade cycle, this system focuses on virtually every built in app that is bundled with the OS, like photos, mail, messages, notes, FaceTime, reminders, calendar, contacts, voice memos, etc, etc, etc.
There are so many, with so many upgrades it is hard to make a list, as above, of what they are all called and what they do. In the best Apple fashion, they “just work” and we tend to take them for granted.
In case you ever wanted to know the complete list (for iOS 15) we have added it at the bottom of this post.
These apps are pretty much all getting big upgrades in iOS 15, along with a similar situation happening for iPadOS 15 and macOS Monterey, TVOS, WatchOS etc. The difference this time is that they are being actively designed to become more and more interoperable and interactive between devices and system software types.
The big picture is extreme big, much wild, and will be quite a ride…
This is a huge push that will go on for years. We call it the Apple System Singularity. And it is a big deal!
It will, ultimately, create a kind of seamless clarity of function between your devices, particularly the mobile or semi-mobil variety, such as iPhones and iPads, and the slightly less mobile (laptops, desktops) of the macOS variety.
Meaning that the ultimate transition that is being made possible through the switch to Apple Silicon and that a whole new concept philosophy and structure of the device hardware and software. And it’s all being created via the interaction and potential synergies coming available and these are being maximized during the process.
All of this is not to mention machine learning, neural networks, A.I. and all the interactive hardware and software upgrades that are now nearly continuous and happening without a user to intervene.
An example of this is in the photos app where various library functions, a.i. object and facial recognition, search cataloguing, etc. are continuous while you sleep. Another example is how iCloud manages data and storage across your devices regardless of geography or proximity 24/7/365.
Welcome to the first phase of this with the first devices incorporating Apple Silicon across all product lines being harmonized more and more via, guess what, the free system upgrades.
These upgrades will yield maximum fruit in the short term after the world wide population of devices adopts the new systems, and longer term, as more and more devices out of the total are already using and maximizing performance and features by having Apple Silicon and other associated hardware & software upgrades under the hood.
Rest assured, while this sounds complicated, and there will be glitches, the transition starting this fall, and over the life of iOS15, iPadOS15 and macOS Monterey (around a year as usual!) will be one of continuous change, improvement and discovery, unlike any you have seen in the history of Apple.
Apple teased the announcement with a cool AR demo “Easter egg”
Apple announced that on September 14 at 10am Pacific Time., it would hold the long speculated, much anticipated, highly awaited annual September product reveal event. Invites were sent out for its annual launch, which many believe is going to be the day the company will unveil new products, such as the iPhone 13.
If the next iPhone is revealed, it is also likely Apple will share the release or release date for iOS 15, there is already the Public Beta 8 version available.
Although there has been no confirmation on exactly what will be announced at the event, some have speculated, based on the invite, there could be upgrades to photography, especially night mode. Other projects in progress could make an appearance, including, the next generation Apple Watch Series 7 or its newest version of AirPods.
Apple’s SVP Marketing head, Greg Joswiak tweeted a video showing the AR Easter egg announcing the event to be streamed on Apple’s website. Since the start of the pandemic, the company has held virtual-only events. A cool little Easter egg, if you view the event website , using an iPhone or iPad, you can tap on the Apple logo to open up the AR viewers and see the 3D logo move around in the world to whatever is in the background of your camera.
New features in the pipeline along with the new iteration of the hit timepiece
The next version of the Apple Watch (Series 7) is expected to be released in the coming weeks, and the WSJ reported that the company is currently working on additional health-related features and improvements for the smartwatch. While it is not certain that these to be included in Series 7, there is no doubt that they are coming, either as a software or hardware update.
Apple is already known for many of its current health conscious features, including the well known Exercise rings and Fitness App, as well as the ability to check your heart rate for irregularity with its electrocardiogram and check your Blood Oxygen levels with a Series 6.
One of the new capabilities that may be coming to your Apple Watch will include measuring blood-pressure which would prompt a user when their BP levels are too high (or increasing in rate). This can influence behavior, diet or give you a warning to seek medical attention is the reading is extreme, for example.
When Apple does roll out this feature, it could be a game changer (or rather a life-saver), as hundreds of millions of Americans suffer from high blood pressure and / or hypertension. The condition leads to almost half a million deaths a year according to the Centers for Disease Control and Prevention.
Another feature said to be in the works is targeted towards females, a thermometer to help with fertility planning. Bloomberg also reported earlier of Apple’s additional health goals to add blood-sugar sensors to help those with diabetes monitor glucose levels.
A useful, even sometimes addictive health aid, which is a good thing
Those who have an Apple Watch can likely attest to its effectiveness in promoting health and well being, particularly around exercise and weight control. The recent addition of of medical features, that in some cases have directly contributed to lives being saved, appear to be a high priority at the giant tech company.
Although it is tantalizing to speculate on the incredible features yet to be added to the device, it will take time for the technological innovations and solutions to be developed in order to make these possible.
Apple has some very ambitious improvements they want to add to its Watch, however there is no official timeline that has been announced and most likely will not be expected before 2022.
Version rapidly approaches Golden Master ahead of possible September iPhone 13 release event
Today those participating in the iOS 15 public beta program are able to update (again), this time to beta 8. This beta process is a “live” test of all the new features, indeed when participating in the program many features change and evolve and, of course, bugs are not infrequent.
As we get nearer and nearer to the launch of this year’s iPhone model, apparently to be dubbed “iPhone 13” the iOS 15 beta versions become more stable and eventually, usually coinciding with the event where the new iPhone model is announced, the Golden Master is reached – which becomes the first public release version.
The first iteration of the public release is often short lived, as the beta test phase almost never gets rid of all the bugs and various features and security patches and other urgent updates are often needed.
For this reason the 2nd or third public release is often the one many experts recommend for those upgrading.
Naturally, though the new phone models will be shipped with iOS 15 already installed, once the phones actually ship of course, which can vary in delay from the launch / announcement at the upcoming September event.
Nevertheless, most older iPhones will benefit from this upgrade, more than a little, and once the release is public a free upgrade will be available to the more than 1 billion users already in possession of an iPhone from previous releases.
iOS 15 and WatchOS 8 to expand Features in your Digital Wallet for select states to start soon
Back in June at the WWDC21, Apple announced it was working, along with the Transportation Security Administration (TSA), on a new feature that will allow Apple users to replace things in our physical wallet like Driver’s Licenses/State Identification.
The company has now announced that 8 states will take part in the roll out of the feature of users adding their’s licenses to the Apple Wallet (available for iPhone and Apple Watch) to use for airport travel at some participating airports.
There are also various apps and programs in each state for storing vaccination ID status information on the iPhone and this will also eventually, in many cases, migrate to the wallet app. The driver’s license and state ID upgrade, is a very big step, however, as this paves the way for the phone to have wallet status no less valid than a physical wallet full of IDs and credit-cards.
Arizona, Connecticut, Georgia, Iowa, Kentucky, Maryland, Oklahoma and Utah will be among the first states to utilize the capability. Although at this time there is no specific date for timeline.
Just in time for back for in person learning season
This coming school year, for schools within the U.S. and Canada, Apple will offer mobile Student IDs via Apple Wallet, allowing for students to access campus buildings or make school related purchases without having to hold on to a physical card.
iPhone users capable of entering the world of cinematography
It is no secret, and most Apple users already know, that their devices are capable, being equipped with the latest technology, to take great photos. Beautiful works of art and photography have been created not from a professional DSLR camera, but rather, on an iPhone.
More surprisingly, is the ability to create top level fully professional videos using only on Apple devices, and now, various megastar and upcoming singers are starting to use this method for their music videos. Including Selena Gomez. In her “Lose You to Love Me” video, the monochromatic shots are interwoven with transition effects, produced in shooting and editing by iPhone.
The newest iPhones (including the upcoming iPhone possible to be called the “iPhone 13”) and iPads that use Apple silicon are making huge strides forward in video production and editing capabilities.
There’s AI, machine learning, neural networking and all kinds of software under the hood that is being extended and improved constantly (in some cases via AI), and all that tech mumbo jumbo adds up to more creative potential and less costs to get in the game at a very high level. No limits.
Lady Gaga’s music video for “Stupid Love“was also shot on an iPhone and Olivia Rodrigo’s latest single “brutal” was made on an iPad.
#BrutalMasks created by iPad are a setup for singer’s AI reality in newest music video
The young and top chart-leading pop star of 2021, Olivia Rodrigo, has debuted her album SOUR. Her first song “brutal” on the album, first released back in May was met with 26.7 million streams its first week.
This week, the artist released her new music video for the song and, incredibly, it was produced exclusively on an Apple iPad. Incredible because of the way it turned out, showing how Apple is aggressively positioning itself, particularly with the iPad Pro, iPadOS 15 and the upcoming iPhone 13 as a full professional production option that will only get better with each software / hardware iteration.
Promotions leading up to her video had fans create their own #BrutalMasks to share on TikTok.
The 30 second video breaks down how some of the custom masks that are featured throughout the video were made with the FacePaint feature on the Procreate app using the Apple pencil.
https://youtu.be/Z6_J8KxIlmI
This isn’t the first time Apple has partnered with musical celebrities, other stars that have worked alongside the company include Lady Gaga, Selena Gomez, and Billie Eilish. With the new direction in marketing and even designing updates to lean more and more towards a pro orientation, expect more major artists, as well as new upcoming ones that can benefit most from the lower cost of top flight production values to get a bump this fall. And the proliferation of creative visual and musical expression will hopefully follow…
Unexpected and Explosive Rumors Emerge as September Launch Dates Loom
Several new stories, based on rumors but from credible sources, indicated that both short and longer term some unexpected twists could be coming out at Apple. The first was reported in 9to5 Mac where they quoted renown source Ming-Chi Kuo saying that the iPhone 13 will include a feature that would allow the device to make calls and send messages without 4G/5G coverage. This would be accomplished via a new low-earth-orbit (LEO) satellite communication mode.
This idea appears to be extrapolated from the fact (unconfirmed) that the iPhone 13 will use customized version of the Qualcomm X60 baseband modem chip, and this will allow the possibility of communications over LEO satellite networks.
The famous analyst also believes that Apple will most likely partner with Globalstar, a LEO Sat company associated with Qualcomm, to provide satellite support.
Further, Kuo intimated that this type of feature would also, eventually, be included in other products such as the upcoming Apple AR headset, the Apple Car and other Internet-of-Things accessories.
This, while a huge revelation if true, both regarding to the timing, with the iPhone 13 almost certainly being announced in September, and regarding the implications for the future of, well, everything, creates more fascinating questions than it answers.
First, is how the “pre-loading” of the LEOSAT capability would work, with what partner constellations (Starlink, etc.) or even with an as yet wild rumor of a network to be built by Apple itself.
Further, if this would eventually be a full connectivity option or just a voice and message only service (plus FaceTime?), at least initially.
Pure Speculation, Theoretical Observations and Tantalizing Conjecture…
Added to all this was a second rumor, somewhat less solid but nevertheless interesting, that the long rumored Apple Car is, potentially, ready to be revealed (at least as a concept and announced and confirmed publicly) before the end of 2021 (!).
The source for this is an interview in Reuters with Akira Yoshino, the inventor of the first safe, production-viable lithium-ion battery. In the interview he mentioned Apple, Tesla and hinted at big things, particularly long term from Apple.
Here is the juiciest passage:
Reuters: What else should we know about the future of mobility?
Yoshino: Right now, the auto industry is thinking about how to invest in the future of mobility. At the same time, the IT industry is also thinking about the future of mobility. Somewhere, sometime, with the auto industry and the IT industry, there is going to be some kind of convergence for the future of mobility. Tesla has their own independent strategy. The one to look out for is Apple. What will they do? I think they may announce something soon. And what kind of car would they announce? What kind of battery? They probably want to get in around 2025. If they do that, I think they have to announce something by the end of this year. That’s just my own personal hypothesis.
Convergence for the future of mobility has been something that ties together all of Apple’s products including the as yet murky Apple Car plans. These various complimentary rumors logically lead to the even more mysterious idea that Apple could be working already to tie together the ubiquitous and all pervasive access to the internet – 4G/5G, wi-fi, LEOSAT networks, and ultimately all Apple products with the Apple Car as a mobile station (driving autonomously of course). That’d be convergence, all right.
And wow, taking this one giant step further, there has been a little known, highly speculative rumor that Apple, ultimately, has plans to build (launch?) it’s own satellite network.
Naturally, Starlink and others are already building-out, so this is somewhat of a moot point, but based on Apple’s penchant for owning the “whole widget” and squeezing all possible from any synergies, it does make total sense as a long term projection.
The biggest, mind-blowing, aspect of that potential scenario would be the “walled garden” that would include all current devices plus a car (!) and the idea that anywhere on earth connectivity would be always available to the entire system. Oh, and powered by sustainable energy.
It’s that’s not a utopian fantasy (for Apple fans at least) it’s hard to say what would be!
Potential launch dates teases Apple customers as September anticipation builds
According to claims found on the Chinese e-commerce site IT Home, Apple may have plans to launch its iPhone 13 (all models including mini, pro and pro max) starting on September 17 and the next generation AirPods on September 30.
The dates are totally speculative, other earlier dates have also been floated, and there have yet to be any official confirmations of launch dates from the company. The two separate September product launch dates could also align with previous rumors that Apple will hold up to 3 events in the same month.
However Apple has traditionally released new products starting in September so the timeline could be true. In previous years, Apple has held events on September 7, 14, and 21.
Version rapidly approaches Golden Master ahead of possible September iPhone 13 release event
Today those participating in the iOS 15 public beta program are able to update (again), this time to beta 7. This beta process is a “live” test of all the new features, indeed when participating in the program many features change and evolve and, of course, bugs are not infrequent.
As we get nearer and nearer to the launch of this year’s iPhone model, apparently to be dubbed “iPhone 13” the iOS 15 beta versions become more stable and eventually, usually coinciding with the event where the new iPhone model is announced, the Golden Master is reached – which becomes the first public release version.
The first iteration of the public release is often short lived, as the beta test phase almost never gets rid of all the bugs and various features and security patches and other urgent updates are often needed.
For this reason the 2nd or third public release is often the one many experts recommend for those upgrading.
Naturally, though the new phone models will be shipped with iOS 15 already installed, once the phones actually ship of course, which can vary in delay from the launch / announcement at the upcoming September event.
Nevertheless, most older iPhones will benefit from this upgrade, more than a little, and once the release is public a free upgrade will be available to the more than 1 billion users already in possession of an iPhone from previous releases.
How to take an iPhone camera and make the most of it using taste and talent
Apple offers “Today at Apple” to inspire and educate iPhone users to help them learn and be creative with their devices. The online videos range from music to photography and are centered around Apple’s latest technologies.
This most recent video teaches users how to get the most out of the iPhone in portrait mode, but really using all to the various power features that are already in the iPhone 12 and even 11.
For example, 3 lenses allow ultra-wide, X1 and X2 (tele) shots at any time just by flipping between each preset. And once a group of photos exists, simple creative cropping and framing has a huge potential to bring out the most attractive and interesting features of each shot, and can be immediately saves as a separate image.
Of course, with such a high resolution image capture in the first place, cropping retains enough image-data that even an ultra-close crop can retain beautiful depth and detail.
Learning how to use all the tools, and most of all a photographer’s eye
The five minute video features self-taught New York City photographer Mark Clennon. In the clip he shows and explains how he sets up, shoots and edits his images, mainly in-camera (that is to say “in-iphone-camera”) to capture his most powerful portraits.
With iOS 15 (released in public beta) and soon with the iPhone 13 (or what the actual name turns out to be) both expected to be revealed in early September, the potential for portrait mode will be added also, potentially, to video in addition to photos and many other upgrades and improvements are on deck.
Free and extensive software upgrades, along with the not free and not inexpensive new hardware are a yearly ritual with Apple since the very first iPhone was released in 2007. Recently, with Apple Silicon and the gradual merging of the functionality to MacOS, iOS and iPad OS the upgrades seem to be in overdrive.
We have cataloged some of the more interesting changes in stand alone articles but still have more to come as this years upgrades and changes are particularly extensive.
This video is an example of how it’s possible to take even one feature, designed to assist in one form of photographic expression, and dig deeper into it with talent and intelligent use of experience and take the resulting images to a whole other level:
Boring? Are you kidding me? Time to look under the hood…
Somewhere in the land of media herding there was a familiar refrain. iOS 15 and iPadOS 15 are “boring”. Apparently the idea behind this is that there is no single feature that changes the entire experience of the iPhone or iPad – no “killer app” or killer upgrade.
The “boring” crowd have focused on things like “you can banish your ex from memories in iOS 15”. I saw a slew of articles with a variation on that title.
The biggest problem with the attitude, which must have been initiated by someone that has not really been hands on with any of the new iOS software (which is still in non-public beta only) is that it’s not true. (A public beta is expected in July but it is not recommended unless you are a developer testing on “non-critical” devices).)
Why? Because there are so many killer upgrades that it’s overwhelming, basically due to the avalanche of amazing new features and improvements. This article will attempt to give an illustration of that by focusing on only one feature inside one built-in app: Memories inside of the Photos app.
First a short digression. We have been testing on several devices including a MacBook Pro 15” from 2017, an original 1st generation iPad Pro (2015) and an iPhone XS Max from 2018. None of these machines have the new Apple Silicon chips and for that reason they are only able to produce the upgraded features that don’t require it.
That makes the improvements that are possible without buying any new hardware even more amazing. Stunningly, of the three devices we upgraded the MacBook Pro was the most stable right out of the gate. Any beta software will have bugs, glitches and sometimes crash but that does not prevent one from testing out features that are new.
The iPad pro, in a non-technical observation almost appears as if the screen resolution has been increased, obviously not possible but, as you will read below, could be part of a stunning emphasis on increased beauty, sensuality and luxurious feel in the new suite of OSs.
Memory movies on iPad OS15 are an amazing example of how AI and machine learning are evolving
For those not familiar with “Memories” they are auto-generated film clips that can be found in the “For You” tab in your photos app on iPhone and iPad. While you are sleeping this feature scans everything in your photos library and uses artificial intelligence, machine learning and neural networks to choose and edit the clips, as the name says, for you.
One not confirmed but almost certain technical backdrop to this is that the learning is improving even between updates to the OS. Not only that but all Apple devices on earth are “cooperating” to help each other learn. That’s a powerful force that spreads across over 1.65 billion devices.
This feature was added in iOS 12 but started to function in iOS 14 on a much higher level. If you had tested and used the feature over the last few years as we have you’d have noticed that the ability of the AI to “see” and select photos and videos to include was limited and, at times, comical. Not any more.
Much of the data that clues the software in as to what photos belong together is from the embedded meta data. The date, time and location information helps to tell the AI that you took a group of images or videos on a day in a particular location.
The difference in iPad OS15 (iPhone too, of course) is that the more difficult to accomplish tasks, such as recognizing the subjective quality of one photo verses another (humans often take several photos of the same scene to try to capture the best out of a bunch). Or, more importantly, who and what are the subject of a photo.
All of this began to get interesting in iPad OS 14 and many groups of photos and videos were already being chosen, edited and enhanced by the software to a level that was fairly impressive.
AI and aesthetics collide and the result is a Joy to witness
Something that is starting to become a thread and a definitive direction that Apple is taking, particularly with the iPad Pro series, is, true to the name, a Pro level of visual production and manipulation throughout the OS.
Center Stage, for example and many other video and photo related upgrades were some of the big features in the newest generation of iPad Pro. Those are great, but require a new iPad along with the OS upgrade.
When it comes to the memory movie clips what we found is that even on the oldest iPad Pro from 2015 the evolution of the software due to the constant learning by the AI is already taking a huge step forward doing all the things that it was already doing only much better.
Apple’s upgrade took that and give it an additional kick up a notch with somewhat that the company is known for: good taste.
What has changed specifically?
In iPad and iPhone OS 14 there were a few things that felt awkward in the way movies were created. The biggest shortfall was in the softwares ability to deal with various aspect ratios.
These days when we shoot photos and videos with an iPhone it is tempting and, at times, wonderful to use the vertical orientation. Other times, for landscapes and other scenes we might prefer a traditional film aspect or even use the panorama feature to get an ultra-wide screen “cinema-scope” style.
Until now this was dealt with very poorly by the software. Mostly the photos would constantly zoom in (the so called “Ken Burns” effect) and if shown without zooming in a vertical portrait shot would have ugly side bars (like a vertical letterbox effect).
The zooming and most of the effects in general destroyed the resolution and therefore the quality of many photos by enlarging them and adding the effects.
Additionally the effects that were added, while cute and fun, were not much more than a way to add fun and not what would likely be used by a human editor. All of this and more made for a kind of novelty feel to the whole process that was nice to have, but many never even bothered to look at the movies that software created for them.
That’s about to be over.
A whole new array of options for the AI to use while trying to entertain
In iPad OS 15, as can be seen on the photos and videos in this article, the ways that the software solves the aspect ratio issue as described above is genius and, dare I say it, beautiful.
In a collaboration between the AI and the software itself it now has a new bag of tricks to use and, boy, does it work. One feature that is fantastic is the letterbox generator for any wide screen photos in any aspect ratio.
How this works is that it takes the iPad aspect ratio and then uses the photo in it original at 100% full resolution and then adds a letterbox. But this is not the usual plain black bars we are all familiar with – the software and AI are able to see and analyze the photo and create a custom gradient letterbox that can be any shade or color.
The effect is often astoundingly tasteful and often makes the original photo look even better. We tested it on award winning photos (video above) and the result is, basically art. Also on our own “nice” photos, chosen 100% by the AI and software, look amazing also.
Actually, all the photos and videos in the clips generated from the library look much better than I had remembered. That turns out to be because the software and AI now do automated color grading on all the photos and videos in all the generated memories !
Color grading also known as color correction, especially for video, has traditionally required an expensive expert and high end software (and hardware) to enhance and color match various photos and clips, that have often been taken at different times and places, where lighting conditions vary and sometimes were shot with different camera.
AI and machine learning software on iPad OS15 (and iOS 15) now has a virtual colorist actively adjusting your shots and enhancing and color matching them while you sleep. That is basically insane. That’s probably why it appeared that the photos and even the iPad itself had been upgraded.
Ok, I could go on and on about that one feature, but let’s move to some more features. There are also new effects that are added that vary with each memory (there are a lot more clips being generated, including various versions of the same idea to choose from).
In the experiments so far the effects are clearly better and more subtle than in iOS 14. Again in many cases I found myself saying the word “beautiful” when I tried find an adjective to describe the results.
For shots that have a vertical bias there’s a vertical geometric split screen effect, often with a thin black border, and it has a kind of 60’s on steroids feel with the bars sliding in and out and resizing into place.
Another effect not seen in iOS 14 is a kind of circular rotation – great for landscapes – it’s not a common effect probably because it is computationally complex, but for the AI, it’s a snap. Sometimes this effect has a kind of blur-dissolve added which makes it fun and, again, still tasteful.
It appears that the effects are not only better and there’s a larger bag of them, but they appear to evolve and adapt to the content, that is to say that the speed and depth of each changes with the music combined with the photo and video content.
Oh, and the music. OMG. Each clip has 6 songs pre-selected and the entire clip adapts, in real time (!), when you change the song, showing you various styles and looks that match. Apparently Apple Music is also connected if you have a subscription.
As a mater of fact, it is hard to be certain, as we have not had more than a few hours to test this, but nearly everything appears to be “live” and constantly evolving in real time. In order to “freeze” a version of a memory you have to “favorite” it (with the typical heart symbol) and then “add to memories” in order to edit (change the names or choose more images – or remove anything if it is not to your liking).
There is so much more not yet mentioned here: this article could probably be a book
The AI is also getting creative with names and “concepts” for the clips. For example, if you had lunch (or took photos) over the years in the same city (for me it was Knoxville, TN) it might look at the coincidence that you tended to take photos around midday in that town and then create a memory clip called “Lunch in Knoxville over the Years”. Or for example the clip at the head of this article: “Golden Hour Over The Years”.
This is an early and primitive foretaste of the literary ambitions of AI. In the new Photos App in iOS 15 it is beginning to “think” about when, where and why humans take photos and videos and then conceiving a story that fits the behavior it is witnessing.
Other titles go beyond the basic “Amsterdam in 2016” and start to use the understanding and visual ability to “see” what is in the photo to create a clip like : “Playing in the Snow at Christmas”. Snow? Does it know it’s cold? Maybe just that it’s white and happens in the northern hemisphere in December. This is just the very beginning of something that will evolve, hourly, from now on. I can’t wait.
:format(webp):no_upscale()/cdn.vox-cdn.com/uploads/chorus_asset/file/22877338/earpiece_ifixit.png)
![iPadOS 15 Preview: [Part 2] Deep Dive - AI and Machine Learning that will Blow You Away](https://i.ytimg.com/vi/XrU6cNxC1rM/hqdefault.jpg)
