The Voice SDK enables you to bring voice interactions to your app experiences. Use the Voice SDK to enhance the AR/VR experience with more natural and flexible ways for people to interact with the app. For example, voice commands can shortcut controller actions with a single phrase, or interactive conversation can make the app more engaging.

Powered by the Wit.ai⁠ Natural Language Understanding (NLU) service, the Voice SDK is compatible with Meta Quest headsets, mobile devices, and other third-party platforms. Wit.ai is a free service that requires no prior AI/ML knowledge to configure. The Voice SDK and Wit.ai handle voice processing, so you can focus on the creative and functional aspects of the app.

Features

Enable custom app voice experiences with Wit.ai⁠.

Easy-to-use Unreal plugin.

Automatic speech recognition to process voice requests into text.

Natural language processing (NLP) for processing text into user intents for app voice experiences.

Included activation methods.

Cross-platform support so that you can integrate voice once, and then make it work for Meta Quest and other AR/VR devices.

Personalize voice requests based on the user and your app state with dynamic entities⁠.

High quality voice experience with low latency, with real-time transcription.

High quality English language support, along with an early preview of 12 other Meta Quest device languages.

Dictation for real-time speech-to-text without NLU processing.

Text-to-speech (TTS) to generate spoken audio from text.

Live Understanding for real-time NLU processing during speech.

Common Use Cases

Using the Voice SDK, you can turn your game into a powerful voice experience that will help create an even greater sense of immersion.

Here are a few examples of what you can enable with voice experiences:

Voice navigation and search. Navigating unfamiliar nested menus can be time-consuming and difficult, especially when trying to type into VR keyboards with a controller. Voice SDK can help your users get where they want to go quickly and with far less effort.

Voice FAQ. Looking for instructions is a good way to frustrate your user and break their focus on your app. But what if new players could just ask when they need a hint? Not only could that be helpful, but it might also keep them engaged longer.

Voice-driven gameplay and experiences. Immersing yourself completely in your game can significantly increase your enjoyment. Imagine winning a battle by activating a magic spell with your voice or actually talking to the characters in your story. Voice-driven gameplay can make experiences more immersive, even close to magical.

Privacy

This SDK is powered by Wit.ai and will process voice data on your behalf. Your use of the Voice SDK must at all times be consistent with the Meta Platform Technologies SDK License Agreement and the Developer Data Use Policy and all applicable Meta policies, terms and conditions, and all applicable privacy and data protection laws. In particular, you must post and abide by a publicly available and easily accessible privacy policy that clearly explains your collection, use, retention and processing of data (including voice data) through the Voice SDK. You must ensure that a user is provided with clear and comprehensive information about, and consents to, your access to and use of voice data prior to collection, including as required by applicable privacy and data protection laws. You cannot collect, use or otherwise process voice data without obtaining a user’s specific consent and your processing of voice data must at all times be consistent with applicable laws, the Developer Data Use Policy and all applicable Meta policies, terms and conditions.

When a user consents to use your App Voice Experiences, Wit.ai processes the voice data on your behalf. The transcribed utterance of what they say (along with any matching intents, entities, and traits) is shared with you to provide voice-enabled in-app actions. It may also be used for other consistent purposes, like product improvement, subject to you notifying the user of those purposes. Please see our revised Terms of Service⁠ to learn more.

Supported Languages

The Voice SDK supports English voice recognition, and offers an early preview of voice recognition in other languages that Meta and Wit.ai provide support. For more information about these languages, see Supported Languages for Wit.ai⁠.

Integrating Voice SDK - Get started with Voice SDK in your Unreal project

Voice Command - Set up voice commands with Wit.ai NLU

Dictation - Transcribe speech to text in real time

Text-to-Speech Overview - Generate spoken audio from text

Voice SDK Activation - Activation and deactivation methods

Providing Voice Transcriptions - Access transcriptions of user speech

Live Understanding - Reduce latency with real-time NLU

Providing Visual Feedback - Indicate mic status to users

Voice SDK Best Practices - Best practices for voice experiences

Sample Project - Example project demonstrating Voice SDK features

Troubleshooting - Common issues and solutions

Design guidelines

Design guidelines are Meta’s human interface standards and design frameworks that help you create safe, user-oriented, and retainable immersive and passthrough user experiences.