Microsoft is previewing a new feature called Video Breakdown, created by Microsoft Garage. The underground division of the company has made a habit of launching interesting side-projects. Video Breakdown fits the Garage mold nicely and is designed to make video searching easier.
The service will achieve that by using cognitive insights. More specifically, Video Breakdown will use intelligent features like OCR, Linguistic Transcript, and Face Detection. The software will make finding video content easier by using these intelligent features to “breakdown” the video.
At the moment, finding a specific video is hard unless you know the direct URL or title. Microsoft Garage is using more intelligent search tools to give more information about a video. For example, using cognitive insights, the service will perform face recognition to identify the people in the video.
Also, it can extract keywords using linguistic transcript. Users can even see the sentiment analysis to see if the video is positive or negative. Other dynamic features include the ability to differentiate who spoke in a video and specific main keyword discovery through OCR.
In the official preview page, Microsoft details the key features of Video Breakdown:
- Linguistic Transcript – Convert audio to text based on acoustic language models
- Face Detection – Find when does each face appears in the video
- Speaker Diarization – Map and understand who spoke when
- OCR – Extract text that appears in video as overlay, slides or background
- Face Identification – Understand who is the person that appears as face
- Voice Activity Detection – Separate background noise and voice activity
- Contextual Search – Understand the context of search results
- Sentiment Analysis – Understand the level of positive vs negative spoken or written content
Microsoft Garage is known for allowing teams within the company to collaborate. They can create things that Microsoft would not otherwise make and work with people from other teams. Many Garage projects take some features from existing Microsoft services. Video Breakdown certainly draws some comparisons with Azure video services.
The Garage division has churned out some excellent concepts and apps this year. However, Video Breakdown may be the most dynamic and innovative of them all. You can head to the official preview for the service at the source.