Google vs. Siri: A 1600 Question Comparison

Posted June 29, 2012 at 2:51pm by iClarified | Please help us and submit a translation by clicking here | 17235 views

Piper Jaffray's Gene Munster asked an iPhone 1,600 questions, 800 on the busy streets of Minneapolis, 800 in a quiet room, in order to compare the performance of Google vs. Siri, reports FORTUNE.

Analyzing the results, Munster estimated that Siri is more than two years behind Google giving it a grade D compared to B+ for Google.

Notably, Siri uses Google to answer 60% of its queries. The rest of the answers are divided as follows: 20% of from Yelp, 14% from WolframAlpha, 4% from Yahoo and 2% from Wikipedia.

"Breaking down Siri's reliance further," Munster writes, "Google provides 100% of navigation results, 61% of information results, 48% of commerce results and 42% of local results. Among other result aggregators, Yelp provided the most local results (51%) and commerce results (51%), while WolframAlpha provided 34% of information results."

RESULTS:
● Google understands 100% of the questions (not surprisingly, since they are keyed in)
● Google replies accurately 86% of the time
● Siri comprehends 83% of queries in noisy conditions, 89% in a quiet room
● Siri answers accurately 62% of the time on the street and 68% in a quiet room.

COMMON SIRI MISTAKES:
What team does Peyton Manning play for? Responded with the answer to the previous query. This was the most common error.
Where is Elvis buried? Responded I can't answer that for you. It thought the persons name was Elvis Buried.
Where am I? Pin dropped in the wrong place.
When did the movie Cinderella come out? Responded with a movie theater search on Yelp.
How do I get from Boston to New York? Responded I can only give directions from your current location. I cant give you directions to a place you are not in.
What spices are in Lasagna? Responded with a Yelp search with lasagna on the menu.
When is the next Haley's comment? Responded "You have no meetings matching Haley's"
I want to go to Lake Superior? Responded with directions to the company Lake Superior X-Ray.

Read More


Share
Add Comment
C.A. - July 1, 2012 at 3:18am
Are they testing Siri on iOS 5.1.1 or 6.0 ? It's gotten better with the new iOS.
NoGoodNick - July 1, 2012 at 6:18pm
It's not out yet.
NoGoodNick - June 30, 2012 at 11:02am
Idk what I'm talking about
NoGoodNick - June 30, 2012 at 4:52am
Without seeing the kind of questions asked (not just the ones that Siri failed), it's impossible to evaluate this test. Siri's biggest problem, aside from having to transmit the questions to be translated before answering, is it's overreliance on commerial answers (see the "movie question").
Vin - June 30, 2012 at 2:19am
So this is comparing Siri to typing on google ? Apples and Oranges. Who cares. I'd expect google to win. Who wouldn't ?
Tony - June 30, 2012 at 1:10am
Siri was listed as Beta when it first came out. I don't know why anyone would or could judge its functionality yet.
7 More Comments
Follow iClarified
These Are Amazon's Black Friday Deals
Amazon has unveiled its Black Friday deals on...
Apple's Black Friday Deals Are Now Live Online
Apple's Black Friday deals are now live throu...
Amazon's Thanksgiving Day Deals on Apple Products and Tech
Here's a list of some of the deals Amazon is ...
MacMall's Massive Black Friday Sale Has Over 1000 Deals on Apple Products, Accessories
Pixelmator for Mac and iPad are 50% Off for Black Friday
Pixelmator has announced that its powerful im...