To showcase how this might work, Microsoft is updating the Bing Android app on August 20 with some snapshots from the Knowledge and Action Graph. By long-pressing the home button, Bing will be able to read the contents of a user's screen and present that person with relevant information about a photo on Instagram, information about artists and songs on Spotify or other similar types of data without the user having to do a separate search outside the app.
(Google is implementing a similar feature with its Google Now on Tap feature it showed off at its developer conference earlier this year.)
Microsoft introduced a similar option inside Word Online late last year in the form of "Insights for Office." At that time, Microsoft explained that Bing's "ability to index the world's knowledge," plus its machine-learning-relevance models enabled the company to surface entity cards about many people, places and things.
Currently, Bing has information on more than a billion of these kinds of entities and more than 21 billion associated facts about these entities, officials said. Microsoft also has in its graph 18 billion links to actions and five billion relationships between these entities.