Transcribing recordings is the bane of journalists, meeting note-takers and students everywhere. Enter Otter.ai, a speech-to-text transcription tool that works online or via a phone app using artificial intelligence (AI) and machine learning (ML) to carry out transcription, live or by uploading a speech file after the event.
Otter Live Notes for Zoom has proven particular popular during lockdown, enabling meeting participants to open a live transcript directly from Zoom then view, highlight, comment and add photos to create meeting notes collaboratively.
Otter.ai VP of Product Simon Lau talked to Verdict about the product, shared his top tips for users and revealed how the company got its name.
Simon Lau, VP of Product at Otter.
Simon Lau: The pandemic has forced everybody to adopt technology much quicker, so its very timely that we provided our integration with Zoom. Whether it is for deaf or hard-of-hearing students, accessibility for any participants that have accommodation needs, students who want to take notes, for meetings or interviews where you dont have to worry about taking a full transcription of the entire meeting, Otter is right there.
If you hear any anything interesting, you can just click on the highlight button and just to highlight that last sentence or two, so you can come back to it more easily and review it and playback just those important bits of your conversation.
We built the speech-to-text technology thats at the very core; turning English spoken audio or video into written English. So whether you call it speech-to-text or ASR [automated speech recognition], thats the core functionality of our speech engine. Thats one component of our Ambient Voice Intelligence, but on top of that, we also have by speaker diarisation and speaker identification.
Speaker diarisation is nothing more than separating speakers into one or two. So, without knowing Berenice and Simons voice, for example, the transcript should say speaker one, speaker two. Currently, we are able to do that after the fact, meaning that in real-time you dont see the labels yet, at this stage. But after this recording is done, we will be able to go back and take another pass and analyse the entire recording and be able to tell between speaker one speaker two. In the speech industry, this is called diarisation (or speaker separation). And speaker identification takes it further.
In the Otter product, you can click on speaker one, and then type in Berenice, you can click on speaker two, and type in Simon, and then Otter goes back and relabels them. It will also take the opportunity to create voiceprints for you and me so that it will go back and relabel the entire conversation for this particular recording, but also it will apply to future conversations. Lets say we have a follow up in six months or a year and we have another Zoom call again, then your voice will be recognised.
Were also building out other types of intelligence. A starting point is just summary keywords, because who has time to review the entire 60-minute recording of a podcast? Otter provides a set of summary keywords and associated word cloud that you can click on. You can get in a quick glance the gist of the conversation, and then move on. If you want to drill down a little bit more, you can click on key terms. That will turn into meeting notes that are actionable.
We also let users highlight and comment by selecting a sentence in the conversation and then it will automatically be collected into highlight summary and comment summary. At the very top of your Otter conversation, you can click on three highlights or comments, and youll be able to go back and only listen and review those three highlights.
It is ambient in the sense that Otter does not talk back to you; this is not like Siri, or Google Assistant, or any of the voice assistants that youre used to. This is not about question and answer. This is about Otter applying speech, and intelligence into your conversations silently ambiently behind the scenes to provide new value.
Get the Verdict weekly email
Yeah, definitely, for example, Google Meet, Microsoft Teams, WebEx, RingCentral those are just a few that come into mind. We dont have any specific roadmap and timeframe to share yet, but we are still a very small team so were laser-focused on the building out the functionality for Zoom.
We want to provide a platform-agnostic way for our users to capture conversations and be able to review playback and collaborate and share content that they deem valuable. We want to give our users the choice because they might meet with people that use all the different platforms. You or your organisation might have a preferred platform that you tend to use for these remote and virtual meetings, but you are bound to be invited to many platforms and you still want to take notes on those. Thats why we offer a platform-agnostic way of capturing all of these important conversations and turn them into useful knowledge and useful notes.
We certainly want to expand to other languages. It wouldnt come as a surprise if I said Spanish, Japanese, Mandarin, Cantonese Chinese, German, Italian, French; those are the top languages that people request. We dont have a time frame to share at this point; it is in our future plans to expand to other languages but right now theres still more room for improvement for English, covering all the different accents. Hopefully, our laser focus on English, providing the top of the line accuracy across all types of environments, gives us the differentiation to be able to compete against all the other alternative solutions.
We have figured out a way to pick up new trending words quickly; it does require human intervention, its not completely automatic. Even as an individual account level, you as an Otter user would be able to go into your settings and be able to add custom vocabulary.
Thats particularly useful for any organisation that use acronyms. It makes sense to provide a very simple and easy way for customers to add custom vocabularies such as acronyms such as jargon, unique spellings of peoples names; there might podcasters who would be interviewing people and, and they want to make sure that as they interview their guests their names are transcribed correctly.
First and foremost, we want to provide the data for our users to analyse. We wont be able to share too far into the future what we plan to do, but the goal is that we want to provide value to our users. A business, school or organisation may get a licence of Otter because that they want to retain the knowledge of that meeting, their sales teams, their schools, all the lectures and all the educational material.
If you think along the lines of those use cases, there are specific requirements in each vertical on what type of conversation, analysis they want and they come to expect from Otter. So were gonna listen to those customers and build out a roadmap to satisfy those analysis requirements.
Nothing specific but I can speak broadly. Were very excited to roll out new functionalities for our speech engine and for our speaker identification that will take the next leap in improvement on that.
The top tip that I love to share with our users is to use Otter to record and transcribe live. That way you can take notes simply by highlighting in one tap, faster than you can type notes into document or jot things down with pen and paper.
By the time you finish the recording, Otter gives you both the detailed transcript and the summary of highlights containing just the important bits.
The inspiration for Otters name. (via David Groves on Unsplash)
The giant otter is one of the chattiest species on earth. The adults have 22 different calls and the babies have 11 calls of their own too. But most interestingly, most of the calls suggested an action, depending on the context. Our technology is all about accurately understanding human talk, and helping turn it into action, so we thought Otter was a great name. Plus, its a cute animal!
Read more: CTO Talk: Q&A with Cervests Alex Rahin
More here:
Otterly indispensable: How Otter.ai has transformed transcription - Verdict
- Make Money from Images, Documents and Photos Uploading - December 18th, 2016 [December 18th, 2016]
- Immortal but Damned to Hell on Earth - The Atlantic - January 29th, 2017 [January 29th, 2017]
- Hands on review: Zencastr podcast maker - The Sydney Morning Herald - February 7th, 2017 [February 7th, 2017]
- How to keep your children safe online as it's revealed half of six-year-olds use the internet - Mirror.co.uk - February 7th, 2017 [February 7th, 2017]
- Yetunde Olasiyan: Between Having a Voice & the Need to Show Off on Social Media - Bella Naija - February 7th, 2017 [February 7th, 2017]
- How a WiFi Pilot Program Is Helping Students in the Rio Grande Valley - KUT - February 7th, 2017 [February 7th, 2017]
- These Shows Understand Why TV Cannot Survive Without The Internet And They're Doing Something About It - Decider - February 8th, 2017 [February 8th, 2017]
- 10 reasons to not miss John Bender at El Club this weekend - Detroit Metro Times - February 8th, 2017 [February 8th, 2017]
- Ideal Flatmate promises to stamp out all roommate worries - The Tech Portal - February 8th, 2017 [February 8th, 2017]
- Five ways to ensure your kids are safe as they go 'online' - The Standard (press release) - February 8th, 2017 [February 8th, 2017]
- How to improve your LinkedIn profile - ArabianBusiness.com - February 9th, 2017 [February 9th, 2017]
- Deal: New customers can get Google Play Music and YouTube Red free for 4 months - Android Authority (blog) - February 10th, 2017 [February 10th, 2017]
- Breaking Down Global Silos (Part 2): Lessons Learned from Conflict - Spend Matters - February 14th, 2017 [February 14th, 2017]
- Issa Rae New Series Giants Is A Must Watch - CampusLATELY (blog) - February 15th, 2017 [February 15th, 2017]
- Fake news, who benefits? - Shelbyville Times-Gazette (blog) - February 16th, 2017 [February 16th, 2017]
- GST beneficial for traders, says official - The Hindu - February 16th, 2017 [February 16th, 2017]
- It's time to get tech-savvy with The Mind Lab by Unitec! - Scoop.co.nz - February 16th, 2017 [February 16th, 2017]
- 'Being an Irish author is more of a Grimm fairytale than a Cinderella story' - Irish Times - February 17th, 2017 [February 17th, 2017]
- Barbie becomes a hologram version of herself - TechCrunch - February 18th, 2017 [February 18th, 2017]
- PLYMOUTH BUSINESS EXPANSION: MycomPETibility.com goes nationwide - Wicked Local Kingston - February 20th, 2017 [February 20th, 2017]
- The three reasons YouTubers keep imploding, from a YouTuber - Polygon - February 22nd, 2017 [February 22nd, 2017]
- SnailBlitz 2017: Citizen Scientists Wanted - NBC Southern California - February 22nd, 2017 [February 22nd, 2017]
- Nikon D5600 Review: Hoping to Make Photo Transfers a Snap - Huffington Post - February 27th, 2017 [February 27th, 2017]
- Appealing Social Security Decisions Online - CBN News - February 28th, 2017 [February 28th, 2017]
- How to file your social security appeal online - WZZM13.com - February 28th, 2017 [February 28th, 2017]
- Meteor is OpenSignal's own speed test app - SlashGear - March 1st, 2017 [March 1st, 2017]
- Data limits are the worsthere's how to stay under yours - Popular Science - March 3rd, 2017 [March 3rd, 2017]
- Overcome problems with public cloud storage providers - TechTarget - March 3rd, 2017 [March 3rd, 2017]
- When Words Beget Blows - Outlook India - March 4th, 2017 [March 4th, 2017]
- A man with vitiligo who was called 'zebra' by bullies has defied their cruel comments by becoming a model - The Sun - March 8th, 2017 [March 8th, 2017]
- Shark Tank's Robert Herjavec coaches kids to fuel entrepreneurial spirit - VentureBeat - March 9th, 2017 [March 9th, 2017]
- Everything new in Stellaris: Utopia, one of Paradox's biggest game updates ever - PC Gamer - March 10th, 2017 [March 10th, 2017]
- IN TRANSIT: The Idol Maker - Mumbai Mirror - March 11th, 2017 [March 11th, 2017]
- Paytm to continue free uploading of money - Business Standard - March 11th, 2017 [March 11th, 2017]
- The perils and false rewards of parenting in the era of 'digi-discipline' - Minnesota Public Radio News - April 8th, 2017 [April 8th, 2017]
- Showtime docu-series sees the 'Dark' side of tech - LA Daily News - April 8th, 2017 [April 8th, 2017]
- Elon Musk: Australian man pens desperate letter to download his brain - NEWS.com.au - April 8th, 2017 [April 8th, 2017]
- How Vestas Wind Systems used outsourced machine learning to transform contract management - Diginomica - June 7th, 2017 [June 7th, 2017]
- Wednesday Web Artist of the Week: Eva Papamargariti - ArtSlant - June 7th, 2017 [June 7th, 2017]
- Your Obsolete Brain: Life and Death in the Age of Superintelligent Machines - Digital Journal - June 7th, 2017 [June 7th, 2017]
- Under Armour launches its first customisable shoes - just-style.com (subscription) - June 8th, 2017 [June 8th, 2017]
- I Don't Care What You Think, I Love My Facial Birthmark - SELF - June 9th, 2017 [June 9th, 2017]
- Cable: Where Are We Headed After This Political Meltdown? - Seeking Alpha - June 9th, 2017 [June 9th, 2017]
- Best Screen Recorders Top 10 Screen Capture Software - Gazette Review - June 10th, 2017 [June 10th, 2017]
- Nigeria just got a verified Twitter handle - TechCabal - June 12th, 2017 [June 12th, 2017]
- Just keep pinning: why your business should be on Pinterest - Cambridge Network - June 12th, 2017 [June 12th, 2017]
- Track-by-Track of Paramore's 'Riot!' Read Through Emo Teen Memories - Noisey - June 13th, 2017 [June 13th, 2017]
- Decision day for Go Forward Pine Bluff - Pine Bluff Commercial - June 13th, 2017 [June 13th, 2017]
- Addressing rape culture - News24 - June 14th, 2017 [June 14th, 2017]
- Italy's Samantha Cristoforetti Says Being a Good Astronaut is All About Teamwork - Fortune - June 16th, 2017 [June 16th, 2017]
- Google Drive will soon make it easy to Backup and Sync PCs, Macs - SlashGear - June 16th, 2017 [June 16th, 2017]
- What's worse than getting phished? Getting phished *and* sending a selfie of your Photo ID and credit card - Graham Cluley Security News - June 17th, 2017 [June 17th, 2017]
- Track Of The Day 16/6 - Maximillian - Clash Magazine - June 17th, 2017 [June 17th, 2017]
- AROUND TOWN: GOP chairman questions Ossoff's London office - MDJOnline.com - June 20th, 2017 [June 20th, 2017]
- RESEARCH & TECHNOLOGY/INNOVATION: ITS Fiber brings fast connections, data center services to local business - TCPalm - June 20th, 2017 [June 20th, 2017]
- Fiberlink Internet Packages & Prices 2017 - TechJuice (press release) (blog) - June 20th, 2017 [June 20th, 2017]
- CS Editors: Creating Content - Security Sales & Integration - June 20th, 2017 [June 20th, 2017]
- How to post a GIF to Facebook - Tech Advisor (registration) - June 21st, 2017 [June 21st, 2017]
- The Living Vampire / Real Vampire FAQ (Frequently Asked Questions) - HuffPost - June 21st, 2017 [June 21st, 2017]
- Facebook Is Introducing New Tools to Protect Women in India - Fortune - June 21st, 2017 [June 21st, 2017]
- Mum drops off daughter at college then sends her hilarious texts with football team - NEWS.com.au - June 22nd, 2017 [June 22nd, 2017]
- Is Chrome OS right for you? A 3-question quiz to find out - Computerworld - June 22nd, 2017 [June 22nd, 2017]
- Facebook wants to stop creeps from downloading your profile picture - TNW - June 23rd, 2017 [June 23rd, 2017]
- Action and Emotion - lareviewofbooks - June 26th, 2017 [June 26th, 2017]
- 6 ways to be more hirable and 1 that could land a job today - Deseret News - June 27th, 2017 [June 27th, 2017]
- Searching for a Career? Set up a Free Profile at AutoCareCareers.org - PR Newswire (press release) - June 27th, 2017 [June 27th, 2017]
- Industry Job Seekers Can Set Up A Free Profile At AutoCareCareers.Org - AftermarketNews.com (AMN) - June 29th, 2017 [June 29th, 2017]
- Steve Mitchell The Mind of Watercolor Blog - June 29th, 2017 [June 29th, 2017]
- How to Upload to Google Drive - Cloudwards - July 1st, 2017 [July 1st, 2017]
- Stevie Ryan, YouTube personality, found dead at home - Blasting News - July 4th, 2017 [July 4th, 2017]
- 5 tips to a delicious food photo - Orlando Sentinel - July 5th, 2017 [July 5th, 2017]
- Gordon Hayward the best Jazz wing player of all time? Not what the numbers say. - SLC Dunk - July 5th, 2017 [July 5th, 2017]
- 36 Years of Loretta's - Racer X Online - July 6th, 2017 [July 6th, 2017]
- How to Work on Your Laptop at a Coffee Shop Without Being a Jerk - Lifehacker - July 8th, 2017 [July 8th, 2017]
- There's a new most-viewed Youtube video, pushing Gangnam Style off the top spot - Buzz.ie - July 12th, 2017 [July 12th, 2017]
- How to prevent bandwidth throttling with a VPN - T3 - July 14th, 2017 [July 14th, 2017]
- Google will now let you back up your entire computer for FREE on its servers - Mirror.co.uk - July 15th, 2017 [July 15th, 2017]
- Google Drive Backup and Sync lets you backup your entire computer: Here's how it works - BGR India - July 17th, 2017 [July 17th, 2017]
- Why Mythology Still Matters: Wisdom from Game of Thrones' 'Dragonstone' - Big Think - July 17th, 2017 [July 17th, 2017]
- Mum somehow manages to convince her daughter her nipple's fallen off in hilarious text exchange - Metro - July 18th, 2017 [July 18th, 2017]