Today at Apple’s 2021 WWDC event, the company unveiled the new iOS 15, iPadOS 15 operating systems. This year, Apple presented a large number of new features and improvements across both the main OS components as well as Apple’s core ecosystem apps. While we are just scratching the surface, we picked out a few highlight features that are looking forward to test later in the year once the new versions will be hitting consumers in their final versions.

Offline Siri

A large new upgrade to Siri isn’t exactly a functional one, but rather the way the voice assistant works under the hood. With iOS 15, Siri now becomes fully offline, with all voice queries being captured, and processed and interpreted by the Neural Engine inside of your iDevice SoC. Beyond greatly improving the security aspect of things, given that data never leaves your device for cloud processing queries, a large functional benefit of the new on-device processing is that it vastly reduces round-trip time and accelerates Siri’s response time. This means that Siri will now act or respond more immediately, rather taking a pause to think about every query, greatly improving the experience.

Live Text (OCR)

Another big new feature to iOS 15 is Live Text, which is essentially an OCR mechanism built right into the OS that will be able to seamlessly integrate into apps and extract text from pictures, either on the web – or in photos that you’ve captured on your device.

“Visual Look Up” is an object identification mechanism that works in your photos app to categorize and classify objects and persons – notably allowing you to also search your galleries now.

New Maps (for those lucky)

One of the more impressive showcases at this year’s WWDC was the new more detailed Maps app. The updated app and dataset now features far more datail for major cities, featuring even advanced 3D terrain representation of the scene. This also extends over to navigation as well, which now features advanced 3D modelling of roadways and bridges, as welll as information on a road's various lanes (turn, etc), simplifying complex intersections for example.

The negative part of this new announcement is that it’s limited to only a hand-full of US cities and London – with most of the rest of the world having to wait out for future updates – if they ever happen.

New FaceTime & Screen Sharing

Apple spent a lot of time around the new FaceTime and screen sharing features. Essentially Apple here is attempting to create their own virtual social ecosystem and build a conferencing integration around FaceTime. FaceTime itself received a large number of new features including spatial audio reproduction-based Group FaceTime calls in which callers’ audio is mimicked to be spatially spread out.

FaceTime calls now essentially are able to get Zoom-ified in terms of creation of links into calls – which now can be integrated and easily shared across applications. FaceTime now even works for any other non-Apple device by allowing users which have access to a link to join in via a web browser interface. And, given how many devices this expands Facetime to, it's a bit of a shame that Apple didn't go into more detail on how that will work.

SharePlay is a screen sharing and application experience synchronisation feature. It allows callers to share media with each other, such as playing back the same audio or movie content, and goes quite deep into app integration as Apple introduces as swathe of new APIs that allow sharing and essentially casting of content across devices and applications.

New Notificiation Summary

iOS’s notification system has lagged behind Android’s for quite some years now, and Apple today took a further step in trying to get a grip over the more traditional “linear” notification system that iOS had to deal with until now. “Notification Summary” is essentially a second layer filtering and grouping mechanism of your notifications, allowing you to prioritise notifications which are important to you and set aside more general clutter notifications for later. It’s said that the priority algorithm will learn based on your apps and contacts, and try to keep those notifications at the top for you to see.

New Safari UI

Safari has seen a large new UI shift on the larger form-factor macOS and iPadOS variant, but also the iOS variant has seen important UI changes such as a more full-screen browsing experience with a dynamic address and navigation bar that appears and disappears at the bottom of the screen, which is a nice ergonomics improvement given the size of devices nowadays. Under the hood, the introduction of full fledged browser extensions is sure to vastly augment the iOS Safari experience.

A larger Wallet

A new expanded Wallet can now go well beyond your Apple Pay uses or even transport card uses today. Apple will be partnering up with states and providers to enable integration of things such as hotel room keys, or even your actual government ID. The system will continue to use the secure enclave which enables Apple Pay.

Beta starting July

Apple will be making available the new versions of iOS for developers starting today, while the public beta will start in July with the usual planned final roll-out in the September period.

Related Reading:

Comments Locked

17 Comments

View All Comments

  • eastcoast_pete - Monday, June 7, 2021 - link

    Oh, and about the "Larger Wallet": Isn't this already a requirement for anyone wanting to own and use an iOS or iPadOS device? They aren't exactly cheap and affordable, are they now?
  • 29a - Tuesday, June 8, 2021 - link

    No more expensive than other quality phones.
  • Spunjji - Wednesday, June 9, 2021 - link

    The iPhone SE is £450 for the 128GB version in the UK (I would never recommend a 64GB phone). That's pretty reasonable for a device as well-rounded as that.

    As for the iPAd, those start around £410 for a 128GB device here - you're actually looking at more (£499 up) for a comparable Android tablet, and they all seem to be running Android 10.

    Don't get me wrong, I'm an Android user myself, it's just the pricing argument isn't what it used to be. You get Android devices selling for more than Apple at the top end, and the only ones that undercut them at the bottom end are seriously compromised in one way or another.
  • 29a - Tuesday, June 8, 2021 - link

    Hopefully they will add caching to the Maps app, I had to switch to Google Maps two weeks ago on a trip because I couldn't get a cell signal to update Apple Maps. Luckily Google Maps allows caching an area and I keep my home state cached.
  • name99 - Tuesday, June 8, 2021 - link

    Google caching is a nice feature, but the manual curation is ridiculous.
    I don't know why Google requires that manual curation, but I suspect the same concern is limiting Apple -- when they introduce this they won't want to require the user manually refresh the "hold" on the data every month.
  • evilspoons - Wednesday, June 9, 2021 - link

    While manual caching is a thing for sure, you can also get directions and Google Maps will go "there may not be service along your route, should I download it?"

    I've also added a manual download region around my home city and I've never, ever had to do anything to keep it updated. Just the single initial request.
  • Sailor23M - Friday, June 25, 2021 - link

    Apple Maps already has caching feature, just need to open that area and zoom in/out a few times and it caches.

Log in

Don't have an account? Sign up now