Microsoft Certified: Azure AI Engineer AssociateImplement natural language processing solutionsMedium

A developer is building a mobile application that allows users to dictate notes and reminders. The application needs to be highly accurate in transcribing diverse accents and noisy environments, and it must support multiple languages. To achieve this, the developer wants to fine-tune the speech recognition model with custom audio data and associated transcripts. Which Azure AI Speech feature should the developer use?

  1. AAzure AI Speech - Speaker Diarization
  2. BAzure AI Speech - Custom Speech
  3. CAzure AI Speech - Speech-to-text (Base Model)
  4. DAzure AI Speech - Neural Text-to-Speech
Show answer & explanation

Correct answer: B. Azure AI Speech - Custom Speech

Custom Speech allows developers to train and fine-tune speech recognition models with their own audio and text data. This is crucial for improving accuracy in specific domains, accents, or noisy environments beyond what a general base model provides, and it supports multilingual adaptation.

Why the other options are wrong

  • A. Speaker Diarization identifies different speakers in an audio, not for improving transcription accuracy.
  • C. The base Speech-to-text model is general-purpose and cannot be fine-tuned with custom data to handle specific accents or noisy environments as effectively as Custom Speech.
  • D. Neural Text-to-Speech converts text to speech, which is the opposite of what's needed.

Azure Custom Speech

A feature of Azure AI Speech that enables developers to customize speech-to-text models by providing their own audio and text data, leading to significantly improved transcription accuracy for specific use cases, vocabularies, and acoustic environments.

  • Trains models with custom audio and corresponding transcripts.
  • Improves accuracy for specific accents, noisy environments, or domain-specific vocabulary.
  • Creates tailored speech recognition experiences.

Memory trick: Make the Speech Recognizer hear YOUR world, perfectly.

More Implement natural language processing solutions questions