New Photos App Can Detect 7 Facial Expressions, 4432 Scenes and Objects

The new Photos app in iOS 10 and macOS Sierra can detect 7 expressions and 4432 scenes and objects. It can also create Memories in 33 categories, according to a Medium post by developer Kay Yin.

Apple detects facial expressions after forming a 'faceprint'. The expressions are used for sesarch and rated and indexed for Memories and montages.


These are the 7 expressions Apple detects:
● Greedy, Disgust, Neutral, Scream, Smiling, Surprise, Suspicious

When creating memories, Apple has 33 categories it chooses from:
● Memories from areas of interest, Best of past memories, Memories that break out of routine, Celebration in history, Contextual memories, Crowd, Day in history, Holiday in history, Location of interest, Nearby, New contextual memories, New memories, Person’s Birthdays, Person’s memories, Recent events (calendar, crowd, holiday, people, person, social, trip, weekend), Region of interest, Social group memories, Sometime memories, Special memories, Favourited, Trips, Week in history, Weekend, Year summary, Last week, Last Weekend

Yin has also found a comprehensive list of 4432 scenes and objects that Apple can detect. You can find the full list at the link below.

Notably, Photos can locate landmarks for example the 'Maho' beach in Saint Martin, despite not being programmed to understand specific landmarks.


Behind the scenes, Photos app first generates a generic categorization for the scene, “beach”, then searches through a built-in dictionary for all landmarks that has the name “beach” in its definition. Therefore, cleverly, despite Photos app knows nothing about “Maho” in particular, it is still able to return the right results.

We'll have more coverage of Apple's Photos enhancements in the upcoming weeks ahead of its release. Please follow iClarified on Twitter, Facebook, or RSS for updates.

Read More [via MacRumors]