Apple Details Next-Generation Apple Intelligence Features

Apple today previewed the next generation of Apple Intelligence, adding new AI-powered features across Photos, Safari, Passwords, Image Playground, Messages, Mail, Phone, Calendar, Shortcuts, Home, and accessibility tools.

Apple says the new features are available for developer testing starting today and will be available to users this fall. The same next-generation Apple Intelligence architecture also powers Siri AI, which Apple is releasing to developers now and bringing to users as a beta later this year.

Photos Editing

In Photos, Apple is adding new editing tools powered by its image models. Spatial Reframing lets users change the composition of a photo after it has been taken by shifting the perspective while generating new content only where needed.


A new Extend tool can expand an image to add more space around a subject, straighten a horizon, or change the aspect ratio without cropping out important parts of the photo. Apple says Clean Up is also being upgraded to remove distractions with better-quality, more realistic infill. Photos adjusted with Apple Intelligence will include a hidden SynthID watermark identifying that they were edited with AI.

Safari and Passwords

Safari is gaining tools that use Apple Intelligence while keeping browsing data private, according to Apple. The browser can automatically organize open tabs into relevant topics, such as grouping travel-planning tabs for a weekend trip.

Notify Me lets users ask Safari to monitor a web page for changes, such as product restocks or price drops. Users can describe what they want Safari to watch for, and Safari will send a notification when it detects a matching change.







The Passwords app can now automatically fix weak or compromised passwords with one tap. Apple says Passwords uses Apple Intelligence and Safari to navigate through supported websites, sign in, and upgrade eligible accounts to strong passwords.



Safari is also getting Describe an Extension, which lets users create a custom Safari extension by describing what they want. Apple says Safari can generate the extension directly in the toolbar, such as a button for saving and rating recipes.

Image Playground

Image Playground is being rebuilt with a new generative model that runs on Private Cloud Compute and can create photorealistic images. Generated images will automatically include a hidden SynthID watermark to identify them as AI-generated.


Users can modify images by describing changes, or by tapping, circling, or brushing an object to move or resize it. Image Playground can also generate images for Messages, Lock Screen wallpapers, and Contact Posters, with selectable aspect ratios for different uses.

Messages, Mail, Phone, and Calendar

Messages is adding one-tap suggestions based on conversation context, such as creating a reminder or note. If someone asks for photos, Messages can suggest searching the Photos library using keywords, locations, and people. Apple says Mail suggestions will also become more capable, including actions that work with third-party apps.

Smart Reply in Mail and Messages can now draw on a user's personalized writing style.





In Phone, Call Context can surface relevant information, such as a confirmation code or reservation number, when a user calls a business. Apple says it looks at who the user is calling, not what is being said, and runs entirely on device.

Calendar can add or modify events from natural-language descriptions. As a user types, Calendar can identify contacts and locations and create a title for the event.

Shortcuts and Home

Shortcuts is adding Describe a Shortcut, which can turn a user's description into an automation. Apple says users can then describe changes if they want to tweak the generated shortcut. Examples include setting a morning alarm based on the next day's first calendar event, opening productivity apps in a specific window layout when connecting an iPad to a Magic Keyboard, or turning on porch lights when a food delivery notification arrives.

In the Home app, Apple Intelligence can group related accessory notifications into a single updating activity. For HomeKit Secure Video cameras, the Home app can generate descriptions across clips, search camera clips for events such as package delivery, and surface noteworthy clips at the top of Search.

Accessibility and Other Updates

Apple says Apple Intelligence is also powering updates to accessibility features. VoiceOver users will get richer image descriptions, while Live Recognition will let users press the Action button on iPhone to ask questions about their surroundings. Magnifier is getting similar assistive exploration in a high-contrast interface.

Voice Control users will be able to describe onscreen buttons and controls instead of memorizing exact labels or numbers. Accessibility Reader will support more complex source material and provide on-demand summaries and translation.

Other updates include automatic proofreading across the system, intelligent suggestions for file and folder names based on contents, improved Genmoji quality, and the ability to describe changes to Genmoji. Workout Buddy is adding Spanish support, more fitness data for motivational insights, and support on Apple Watch without an iPhone nearby.

Architecture and Availability

Apple says the new capabilities use next-generation Apple Foundation Models, custom-built in collaboration with Google and its Gemini models for integrated Apple Intelligence experiences. The models run on device and on servers using Private Cloud Compute. Apple says when Private Cloud Compute handles a request, personal data is not stored or made accessible to Apple or anyone else, and outside experts can continue to verify the system.



The new features are available for testing starting today through the Apple Developer Program. A public beta will be available next month through the Apple Beta Software Program, and users with supported products set to a supported language will get access this fall with iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27.

Apple Intelligence supports English, Danish, Dutch, French, German, Italian, Norwegian, Portuguese, Spanish, Swedish, Turkish, Vietnamese, simplified Chinese, traditional Chinese, Japanese, and Korean, though some features may not be available in all regions or languages.

Apple Intelligence in iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27 will be available on iPhone 16 models or later, iPhone 15 Pro, iPhone 15 Pro Max, iPad mini with A17 Pro, iPad models with M1 or later, MacBook Neo with A18 Pro, Mac models with M1 or later, Apple Vision Pro, Apple Watch Series 10 or later, Apple Watch Ultra 2 or later, and Apple Watch SE 3 when paired with an Apple Intelligence-enabled iPhone nearby.

Some features, including image generation, have daily usage limits because they rely on server models. Apple says increased access is available with most iCloud+ subscription plans, which also include Apple Intelligence support for compatible Home cameras.