ie8 fix
madison

New Windows Phone Mango speech technology can't be beat

By | September 13, 2011, 4:30am PDT

Summary: There are a ton of great functions in Windows Phone Mango and after spending a few days connected via Bluetooth I am sold on the hands-free voice recognition technology.

I recently wrote that Windows Phone 7 is the most stable mobile phone OS and I wanted to follow that up with some other examples of why I find it to be an excellent choice for consumers. Over the years, I have tried different 3rd party applications and integrated services to try to control my iOS, Android, Symbian, and BlackBerry devices just with my voice. Some apps and services did well, but NOTHING has functioned as well as Windows Phone 7.5 (aka Mango) from Microsoft. Android has pretty advanced voice recognition, but I still have not found it as seamless and accurate as Windows Phone Mango. This capability may even have some people picking up a new Mango phone when they launch in the next couple months.

There were a few instances in the last couple of days when I really dove into using the new Windows Phone Mango voice-to-text features and I was blown away by the capability and performance and like Adrian wrote in August this one feature may be the “killer” feature for many consumers. Chris Weber, president of Nokia USA, recently stated that this functionality is a game changer too and after using these features this past week I completely agree. Bill Pardi wrote up some more thoughts on speech in Mango on the Windows Phone Blog. Let me give you the details on my experiences.

Mowing the lawn and texting

My daughters were watching a high school football game on Saturday afternoon and I was home mowing the lawn with my Dell Venue Pro in my pocket streaming podcasts through the JayBird Freedom headset. My oldest sent me a text message to give me an update on the score and this is the progression of what happened next:

  • Tone comes across the headset.
  • WP7: Message from 253-555-1111 or caller ID name.
  • WP7: You can say read it or ignore.
  • Me: Read it and then the phone reads me the message.
  • WP7: You can say reply, call, or I’m done.
  • Me: Reply. State your message. WP thinks then states what you stated.
  • WP7: Send or say again.
  • WP7: Send and then the message is sent and the podcast started back up.

Keep in mind I NEVER touched my phone or headset and performed all of this while actively mowing my lawn with a push mower. My Dell Venue Pro, with RTM of Mango installed, translated what I spoke perfectly so that my daughter received what I intended.

Driving the car

On Sunday, I was in the car with a couple of my daughters leaving a soccer game and my daughter sent a text to my wife to share the score and game status. A conversation then followed via text in the car and this is how this experience went:

  • Incoming text tone came across the Bluetooth SuperTooth HD speaker.
  • WP7: Message from Dayna Miller.
  • WP7: You can say read it or ignore.
  • Me: Read it and then the phone reads me the message.
  • WP7: You can say reply, call, or I’m done.
  • Me: Reply. State your message. WP thinks then states what you stated.
  • WP7: Send or say again.
  • WP7: Send and the message was sent.
  • WP7: Message from Dayna Miller.
  • WP7: You can say read it or ignore.
  • Me: Read it and then the phone reads me the message.
  • WP7: You can say reply, call, or I’m done.
  • Me: Call.
  • WP7: Calling Dayna Miller. The call is made and conversation follows.

My daughters were blown away that I did not have to touch ANYTHING and the entire conversation took place completely hands-free with such accuracy. They both said they wanted a Windows Phone 7 device next.

I then showed them how you could press and hold the Start button (yes, I did finally have to touch the phone) and perform the following functions on Windows Phone 7 Mango:

  • Call (name, number, voicemail)
  • Find with Bing. “Find coffee in Seattle”
  • Open apps. “Open Maps” “Start Office”
  • Text people. “Text Dayna” You will then be prompted through commands like those above.
  • Other functions such as call another person while on a call, press numbers, and save speed dial.

This amazing voice technology is powered by Tellme advanced speech recognition and as I stated gives you a completely hands-free experience. I would like to have more control over my Zune Music, similar to what the powerful Microsoft Voice Command software provided in Windows Mobile. Once you try it you will think it is magical and like I tell people Windows Phone 7 needs to be used to understand why it is so compelling.

Kick off your day with ZDNet's daily e-mail newsletter. It's the freshest tech news and opinion, served hot. Get it.

Topics

Matthew Miller started using a Pilot 1000 in 1997 and has been writing news, reviews, and opinion pieces ever since.

Disclosure

Matthew Miller

Matthew is a professional naval architect by day and a mobile gadget freak at all other times. He purchases his own devices and then sells them on eBay or Craigslist to buy more. Many other devices are sent for review on a 30-day loaner basis and then returned to the carrier or manufacturer. If any are provided as “long term loaner units” this will be clearly disclosed in his reviews.

Biography

Matthew Miller

Matthew Miller started using a mobile devices in 1997 and has been writing news, reviews, and opinion pieces ever since. He is a co-host with GigaOM's Kevin Tofel on the MobileTechRoundup podcast and an author of three Wiley Companion series books. Matthew started using mobile devices with a US Robotics Pilot 1000 and has owned over 125 different devices running Palm, Linux, Symbian, Newton, BlackBerry, iOS, Android, webOS, Windows Mobile, and Windows Phone operating systems. His current collection includes an HTC Radar 4G, Dell Venue Pro, Apple iPad 2, HTC Flyer, Samsung Galaxy Nexus, Nokia N9, Apple iPhone 4S, MacBook Pro, and many more, along with tons of accessories and classic devices like the Apple Newton MessagePad 2100 and Sony CLIE UX50. Matthew can be found on various discussion forums under the user name of "palmsolo".
59
Comments

Join the conversation!

Just In

RE: New Windows Phone Mango speech technology can't be beat
tomlin21-24319035676893835085146735905770 11th Oct
Have you ever previously previously considered like a certain amount of bit a lot more than reebok jerseys just your information? I indicate, that which you say is substantial and every little thing.
WinPhone, I think, is one of those things that you just have to try to feel the magic. Microsoft just needs to get its marketing right this time around.
Right now, no matter how cool they want to make it look the ads always make it seem like a wannabe. They need to throw some attitude behind the OS. It can surely steal customers from Android, if not from iOS.
Damn, can't wait to get my hands on a Mango Device
@regsrini In other words, Microsoft needs to have some leather clad woman beat up a bunch of CGI robots to convey the message?
@facebook@... Ouch!
@facebook@... Yep, but you remember that Leather Clad Woman don't you? It caught my attention and at first quick glance the robots looked like the one from the fox football animation...

Then I said, wait a minute what is this and that chick is pretty cute.

Of course it was the Bionic Commercial.
0 Votes
+ -
Bionic babes
Robert Hahn 13th Sep
Say this for Microsoft: they aren't that dumb. They're not as good at it as Apple, but at least they are trying to tell you what their product does and why you might want to buy it. That Droid Bionic ad is just stupid.

Half the people with cell phones still have feature phones, which means they still need to be told why a smartphone is better than what they have now, and why a particular smartphone is the one they want. The Bionic ad does none of that. It just leaves you wondering what the product is, what it does, and why anyone would spend money to run that ad.
0 Votes
+ -
@regsrini

Got my Mango RTM installed yesterday on my HTC Trophy...the speech recognition is unbeatable. The added features are sweet. I think my phone is even faster then it was before and battery life appears to be improved as well. This update is sweet! Thanks MS for making the best Smartphone OS and continuing to build upon it by releasing a great update like Mango! MS Does it again! Now if they could just get the brain washed apple fanatics to realize they're wasting time and money on IOS driven devices.
0 Votes
+ -
@regsrini
See this article: http://techcrunch.com/2010/10/20/drivesafe-ly-2-0-responds-to-text-email-while-you-drive/

Sounds a lot like DriveSafe.ly it even has almost the exact same prompts in the spoken menus. It's a little disappointing that MSFT won't let developers like us create apps like this and just does it themselves. Of course, I'm biased because I'm from iSpeech and I think our technology is the best... at least our text to speech and speech recognition
@hahrens@... Microsoft is working on TellMe speech SDK for Windows Phones and Nuance just released an SDK for Windows Phones. And you cannot give your core phone experience to developers which will fragment the market.
0 Votes
+ -
Like OS/2, it seems knowledgeable people think it's technically very good, it's just ordinary users who can't understand why they should buy it.
@ldo17
I'd counter that and say that WinPho 7 and Mango are as intuitive as ever. That is why I said, you need to see it to believe it.
@ldo17
Well I think that is why some of these basic abilities will be important. Sending/translating a text message by phone's usefulness will be evident almost immediately after the first time it happens while you are driving. Not that I think people should be composing and receiving text while they are driving but they are going to do it anyway. And this method is far better than them fumbling for their phone, looking down and pretending to not be on the phone while they drive. Speech recognition is one of those things that any average joe can appreciate.
no thanks Android is the best
@shellcodes_coder
Thank you for that compelling argument for Andriod, love all of the facts around why.
0 Votes
+ -
RE: New Windows Phone Mango speech technology can't be beat
Return_of_the_jedi Updated - 13th Sep
@ItsTheBottomLine

".. love all of the facts around why."
One word, Marketshare.

PS. Stolen from the Win fanboys. That explanation works for them. So I figure I'll give it a try.
@ItsTheBottomLine Because Voice Commands using MS technology often screws up in the cars so why should this be better?

Also, Androids Dictation Feature is by far the best I have seen in such a small device, it is flat out awesome.

Are these features a good idea from MS? Sure they are, I just don't think they are anything special.
  • Flagged
@Peter Perry
it seems you have a mango device on hand, otherwise you wouldn't have said this "Because Voice Commands using MS technology often screws up in the cars so why should this be better?

Also, Androids Dictation Feature is by far the best I have seen in such a small device, it is flat out awesome."

Otherwise your statements are just FUD as usual on WP7 and Microsoft.
@Return_of_the_jedi

I'll admit, I laughed.
0 Votes
+ -
@shellcodes_coder And why would this be? What makes the speech recognition on Android so much better than the speech recognition on Mango? I'll be the first one to tell you I think it sucks on iOS and is my one major gripe about that platform - and it sucks because it does not seem like it's fully integrated with the OS but its there more as an afterthought. I went from WM to iOS when the iPhone 3G first came out and the one thing I missed from WM - and still do - is the way Microsoft Voice Command integrated with the platform.

So tell us all just how Android's speech recognition is so much better than Mango's?
@shellcodes_coder Which Android are you referring to? The one on HTC? Samsung? Sony?
@shellcodes_coder
Android is by far the worse in just about every aspect. The hardware should be fast... but the OS bogs it down. Can't wait to get a dual core phone with a good OS.
Seriously considering Mango. Just need US Cellular to offer it.
The more I read about WP7 the more I am thinking of dumping the iPhone and iOS.
0 Votes
+ -
RE: New Windows Phone Mango speech technology can't be beat
Return_of_the_jedi Updated - 13th Sep
@bobiroc

That means MM is doing a good job. He is a good salesman, eh?
@bobiroc, my brother is thinking the same. He was impressed with the interface after a couple minutes with my phone. He has had iPhones since they came out, but Windows Phone 7 is just slick.
@G Computer Network

I am on my second iPhone (iPhone 4) and while I still like the phone I find that the OS is becoming a bit stale and the innovation it had at it's release is now gone and it is just trying to keep up with the features found in Android and WP7. I am willing to dump the phone and maybe just use it as an iPod for my car because the WP7 devices I have had the chance to use seem really nice.
0 Votes
+ -
@bobiroc I'm seriously considering switching out my work BB for a WP7 device... but I like my iPhone 4 too much to consider switching it out - at least not until the iPhone 6 which will presumably be announced/ released when my current contract is up.
Mango speech technology can't be beat

Wrong!
0 Votes
+ -
@Return_of_the_jedi How it is wrong? Come on dude, provide some sort of insight rather than sound like a troll.
@Return_of_the_jedi

My name is Return_of_the_jedi and I have no idea what I'm talking.
This would be great, saw that same vid weeks ago... I feel like I was sold, but I think I'll still have to wait out for a wp7 phone design specs that I want. Top requirement for me is a PHYSICAL QWERTY keyboard (preferably slide) because I've always loved typing faster on physical buttons than on-screen... Another would be removable storage, for obvious reasons.
Can the WP7 speech-to-text technology allow a deaf person to receive tel. calls by text and reply with voice? If so, where can I find more information?
Definitely cannot wait for Mango. Great feature and look forward to using it.
This is just mind blowing!!! #magic indeed!
My first question is where/whom did MS buy the technology from? If you say they didn't, then my next question is where/whom did they unofficially "borrow" it from? MS is a marketing company, and has been from day one. Just seems that since Gates left, they've lost their marketing mojo.....or is it that the rest of the world is finally waking up to the fact that it's all marketing spiel, and not technical prowess that made MS what it is?
I've had (and still have) several MS based phones (of various vintages and releases) - and without fail, they all have major problems, including needing to be rebooted about once a week or so.
@dabbsil

Where it ccame from doesn't matter, there is only one place to buy it. wink
@dabbsil
I think you misunderstood Google for Microsoft (Marketing company statement). Microsoft bought Tellme a while back and they have voice recognization technology even before that. They had them in Windows Mobile, and which is is predecessor to both iOS and Android. Now please get facts straight before rant, http://www.microsoft.com/en-us/tellme/
0 Votes
+ -
@dabbsil Did you somehow forget about Microsoft Voice Command which was an available add-on for Windows Mobile 5 and up? I had it on my old PPC-6700 and while the unit had issues (a lot less so using a custom ROM) the integration of Microsoft Voice Command was excellent - so no Microsoft did not have to borrow it from anyone although they also bought TellMe and could be using their tech as well to improve upon their own voice recognition software.
0 Votes
+ -
You don't sound credible at all,
adornoe@... 13th Sep
because, it you had major problems with one "MS-based phone", why would you continue making the same mistake, and with "various vintages and releases". That sounds like many mistakes that you made. So, why would you want to continue making the same mistakes over and over again? Sounds like you're making up your stories there, bud.
@dabbsil
I guess you haven't tried there software. It's pretty good for a marketing company!
0 Votes
+ -
just wondering...
@jk_10
She is totally occupied with her dated technology.
I'm using Mango for some weeks now and really love it, but the speech recognition feature doesn't work well, at least when your native language is German.
Calling contacts via speech worked perfectly well from the first minute i used a WP7 device, and letting the device read incoming messages does, too, but when i try to dictate messages, the results are so bad that they are not really usable right now.
Since speech recognition is web based, i sure do hope that problem can be fixed without updating the phone.
I really love my Samsung Focus, and can't wait for the Mango update....go ahead and buy and Android if you want....I'll wait....
0 Votes
+ -
You can....
rickzdnet1 13th Sep
You can say....
Listening to this more than 3 times would drive me up the wall!
TILES? which win95 UI designer dreamed this up?
0 Votes
+ -
You can say.......
rickzdnet1 13th Sep
You can say....
Listening to this more than 3 times would drive me up the wall!
TILES? which win95 UI designer dreamed this up?
2 words: BUTT UGLY
I heard about how good the voice recognition would be in Mango at least a year ago. We started developing an app that needs Mango. Any idea if you will be able to take a picture by voice command?
I think you should change Voice with Speech in the summary sentence:
"There are a ton of great functions in Windows Phone Mango and after spending a few days connected via Bluetooth I am sold on the hands-free voice recognition technology."
Windows Phone 7 has is not dual core compatiable yet and most screens are only TFT. I think it has way more catching up to do.
@Droider
The funny thing is that it still out performs Android phones running dual core processors. Android... what a joke.
Sounds Cool!

I would but my entertainment center needs an ios enviroment. Pioneer!
0 Votes
+ -
RE: New Windows Phone Mango speech technology can't be beat
tomlin21-24319035676893835085146735905770 11th Oct
Have you ever previously previously considered like a certain amount of bit a lot more than reebok jerseys just your information? I indicate, that which you say is substantial and every little thing.

Join the conversation!

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]
ie8 fix
ie8 fix

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources
ie8 fix
ie8 fix