HomeWinBuzzer NewsMicrosoft AI Reaches ‘Major Milestone’ by Defeating Humans in Stanford Reading Test

Microsoft AI Reaches ‘Major Milestone’ by Defeating Humans in Stanford Reading Test

The Microsoft AI scored 82.650 on the Stanford Question Answering Dataset, beating the human score of 82.440. The test was based around a series of Wikipedia articles.


A AI can now read and answer questions about a document better than a human. The milestone comes from a team at Asia, who used the Stanford Question Answering Dataset (SQuAD).

The dataset contains questions about a set of Wikipedia articles. Microsoft's model reached new highs of 82.650 on the exact match portion, just beating out Alibaba, which submitted a score of 82.440. Both beat human performance, which is 82.304.

By utilizing the technology behind its breakthrough, Microsoft hopes to provide an AI that's more useful to consumers. However, that doesn't just mean virtual assistants. The company is already applying earlier versions to its Bing search engine for more natural queries.

In the future, it envisions the ability to provide users with plain answers, rather than a list of web pages, as well as multiple sources. It could also let AI read through documents and present the information in a digestible way, saving hours of research.

A More Natural Cortana

Still, is a potential target, and this milestone should help fuel more natural interactions. Microsoft is looking to implement follow up questions that incorporate previously asked data. After asking the location of a city, for example, you could then ask, “when was it founded?”

It's a functionality Google Assistant already offers, but with its reading breakthrough, Microsoft may be able to do it more naturally. It combines with previous breakthroughs in speech parity, which put its AI's recording capabilies on par with humans.

Even so, there's a long way to go. The Redmond giant envisions a world where doctors can simply ask about specific medical findings, but that will require further investment.

“Natural language processing is still an area with lots of challenges that we all need to keep investing in and pushing forward,” said Ming Zhou, assistant managing director of Microsoft Research Asia.

“This milestone is just a start.”

Ryan Maskell
Ryan Maskellhttps://ryanmaskell.co.uk
Ryan has had a passion for gaming and technology since early childhood. Fusing the skills from his Creative Writing and Publishing degree with profound technical knowledge, he enjoys covering news about Microsoft. As an avid writer, he is also working on his debut novel.

Recent News