What is personal voice for text to speech?

With personal voice, you can enable your users to get AI generated replication of their own voices in a few seconds. With a verbal statement and a short speech sample as the audio prompt, you can create a personal voice for your users and allow them to generate speech in any of the more than 90 languages supported across more than 100 locales.

Note

For the current list of regions that support personal voice, see the Speech service regions table. For supported locales, see personal voice language support.

The following table summarizes the difference between personal voice and professional voice.

Comparison Personal voice Professional voice
Target scenarios Business customers to build an app to allow their users to create and use their own personal voice in the app. Professional scenarios like brand and character voices for chat bots, or audio content reading.
Use cases Restricted to limited use cases. See the transparency note.
Training data Make sure you follow the code of conduct. Bring your own data. Recording in a professional studio is recommended.
Required data size A 5–90-second human speech sample. Requirements depend on the selected training method and version.
Training time Less than 5 seconds Training time depends on the selected training method, version, and data size.
Voice quality Natural Highly natural
Multilingual support Yes. The voice can speak about 100 languages, with automatic language detection enabled. Yes. Select a training method and version that supports multilingual synthesis.
Availability The personal voice demo is available in Foundry (classic) and Speech Studio upon registration. Personal voice customization is available in Foundry (new). Access to the API is restricted to eligible customers and approved use cases. Request access through the intake form. You can only use professional voice fine-tuning after access is approved. Professional voice fine-tuning access is limited based on eligibility and usage criteria. Request access through the intake form.
Pricing Check the pricing details here1. Check the pricing details here.
Responsible AI requirements Speaker's verbal statement required. No unapproved use case allowed. Speaker's verbal statement required. No unapproved use case allowed.

1 Note that personal voice pricing will only be visible for service regions where the feature is available. For the current list of supported regions, see the Speech service regions table.

Try the demo

The personal voice demo isn't currently available in Foundry (new). You can access the demo in Foundry (classic) or Speech Studio. To create a personal voice customization in Foundry (new), see Set up a personal voice. To use the personal voice API, apply for access.

  1. Go to Foundry (classic) or Speech Studio.

  2. Select the Personal Voice card.

  3. Record your voice and try the voice output samples in different languages. The demo includes a subset of the languages supported by personal voice.

    Screenshot of the personal voice demo experience in Foundry classic or Speech Studio.

How to create a personal voice

To get started, here's a summary of the steps to create a personal voice:

  1. Set up a personal voice.
  2. Upload consent file. With the personal voice feature, it's required that every voice be created with explicit consent from the user. A recorded statement from the user is required acknowledging that the customer (Azure Speech in Foundry Tools resource owner) will create and use their voice.
  3. Create a personal voice from the speaker's verbal consent statement and a 5–90-second audio prompt. The custom voice REST API returns the speakerProfileId that's used for text to speech.

Once you have a personal voice, you can use it to synthesize speech in any of the 91 languages supported across 100+ locales. A locale tag isn't required. Personal voice uses automatic language detection at the sentence level. For more information, see use personal voice in your application.

Tip

Check out the code samples in the Speech SDK repository on GitHub to see how to use personal voice in your application.

Reference documentation

Responsible AI

We care about the people who use AI and the people who will be affected by it as much as we care about technology. For more information, see the Responsible AI transparency notes.

Next steps