After an impressive demo of Apple Intelligence I can’t help but wonder how smart can Siri get. Will apps still exist in the future?
Apple has joined the AI arms race, releasing its own take on Intelligence System. Siri got an upgrade integrating it more deeply with iOS. For example, now it knows which app is on your screen and can act on it.
This is especially interesting when you also consider projects like Rabbit AI and Jace. Apparently, instead of relying on APIs, it could make more sense to train AI in using actual apps and websites. Huh.
AI assistants, but good
Currently AI devices like AI Pin or Rabbit AI can use one app at a time. Same with Siri. Asking for something is often slower than picking up the phone. That’s not enough to change things. The true potential of AI lies in workflows — scenarios spanning across multiple apps/websites.
AI using various apps, putting output into one harmonious interface… well, that sounds like the future of UI to me.
With workflows AI could do more than just mindlessly follow instructions. Properly designed AI should:
Automate complex, yet repetitive tasks. Googling for something, choosing the right website, signing up for us? Magic.Filling our knowledge gaps. AI might be good in figuring out what information we are missing. Additional context could help us make better decisions.Gather predictions. Checking apps for important data. Created a travel checklist note? Maybe it should pop up in the morning before flight.
The vision of AI using apps alongside people is weird, and I am all for it.
AI as a designer
Asking for a schedule and getting calendar events is an example of AI using one app. How about multiple apps? What would be different? Well, it could be:
Checking for airplane tickets in your travel appChecking for a hotel booking in your mail appFiguring out you need a plan to get to the airport, maybe getting it from your navigation app?Checking multiple apps manually vs. design concept of AI generated widget with all data in one place.
That’s a workflow. As a bonus: someone still has to develop those apps for AI to use. That calmed me down for sure.
Let’s add the fact that Apple Intelligence knows what is on the screen and can act accordingly. After all, AI’s big promise is personalization, understanding the user and context.
What if Siri could detect you are in a hurry and design an interface that shows what needs to be done?
Concept of AI generated UI. Unified data from multiple apps and personalized predictions.
AI has potential to quickly react in stress-cases. Solutions to urgent, yet unusual, situations are rarely in main user flows. Swept into hamburger menus and “more” popups… and stress takes up mental resources, which makes it even harder to find those features.
AI can offer better experience here than designers ever could.
Designing apps for AI
Opening an app or checking widgets might still be faster than asking AI for help. However, for more complex problems we need to be sure our app is a part of the solution. It needs to be included in the workflow, appear in the output design. For now all we have to do for this to work is:
Submit App Intents, Shortcuts and DonationsCreate Intents UI Extension, custom UI Siri can use for outputDefine Vocabulary (apps terminology, so Siri understands what to do)
But what if Siri would actually tap through our apps? It might require us to maintain UI consistency across all apps, on top of all that.
Training AI to operate on current UI patterns might be tricky.
If we want more exposure for our app we’ll have to make its interface AI-friendly:
Following Human Interface Guidelines is a must, even without Siri.Icons are another thing that comes to mind. The line between settings/adjustments/filters icon is blurry at best. Relying on symbols similar to system icons might be the safest approach.As much as it pains me… limiting custom UI elements. Relying on swiftUI components will be the best way to keep your app recognizable for AI.
As a creative, this makes me sad. Standardization in app design is rolling, apps are starting to look the same. AI might be the final nail here.
As a user, though… well it’s a win. More consistency means similar icons, tab bars, navigation, filters. This leads to predictable interactions and more focus on the actual content.
Future of UI
AI will get faster. To prepare for that future we will need to figure out user flows. Know when our app’s data might be useful.
Sharing apps with AI, making sure they are useful, help with common scenarios – that sounds at least like a good transitional period. Along with it we could gain more advanced, interactive and personalized responses.
I surely am curious how it will turn out.
Useful resources
“Designing Human-Centric AI Experiences” by Akshay Kore — I can’t recommend this book enough, great source of best practices.Generative UI and Outcome-Oriented Design — Great read on the impact of AI generated interfaces on UX profession.
Also, check out my portfolio for more thoughts on future of design!
https://kamilkolodziejczyk.pl
Siri, could you build me an app? was originally published in UX Collective on Medium, where people are continuing the conversation by highlighting and responding to this story.
