Voice assistants

Audio Flamingo

Models that listen to speech, sounds and music and answer questions about them. Audio Flamingo Next handles recordings up to 30 minutes. Research use only.

Developer
NVIDIA, USA
First release
Jul 2024
Latest release
Apr 2026
Sizes
0.5B – 8B
License
Non-commercial onlyNVIDIA non-commercial licenses (OneWay Noncommercial), research only
Russian
Not supported
Running
On your own serverNeeds a GPU
Industries
Media and production, Science and research
Deploy on your server Hugging Face GitHub

What it does

  • Detailed descriptions of audio recordings
  • Questions and answers about a long recording
  • Tagging music and sounds

Where it is used

Media and productionResearch

Hardware requirements

LaptopLaptop or regular PC, up to 8 GB of VRAM — smaller versions
fits
1 GPUOne GPU with 16–80 GB — mid-size versions
fits
ClusterServer with several GPUs — flagship versions
no versions

Versions

  1. Audio Flamingo Next
  2. Music Flamingo
  3. Audio Flamingo 3
  4. Audio Flamingo 2 (0.5B – 3B)
  5. Audio Flamingo

How to run it

On your own serverWeights are downloaded from Hugging Face and served with vLLM (load and API) or llama.cpp (modest hardware). The model then runs in a closed network with no per-request fees.Hugging Face
How much hardware you needCalculate the VRAM for the model size, context length and number of concurrent requests.Open the hardware calculator

I can set this up end to end: pick the model size, deploy it on your server and connect it to your systems.

Frequently asked questions

Can Audio Flamingo be used in a commercial project?

No. License: NVIDIA non-commercial licenses (OneWay Noncommercial), research only. A commercial product needs a different model or a separate agreement with the rights holder.

What hardware does Audio Flamingo need?

At minimum: Laptop or regular PC, up to 8 GB of VRAM — smaller versions. Without a GPU the model is not practical. You can calculate the exact VRAM for your model size and context in the hardware calculator.

Does Audio Flamingo support Russian?

No. The model card lists its languages and Russian is not among them.

Where can I download Audio Flamingo and what does it cost?

The Audio Flamingo weights are open and free to download. You only pay for the hardware it runs on and for the setup. Source links are at the bottom of this page.

How I deploy it for clients

  1. SelectionI pick the model size for your task and hardware and test it on your examples.
  2. DeploymentI deploy it on your server or in a closed network and provide an API.
  3. Fine-tuningI fine-tune it on your data (LoRA) or connect a knowledge base — whichever is cheaper for the task.
  4. IntegrationI connect it to your CRM, ERP, bot, website or team chat and set up monitoring.

Similar models

Voice assistantsQwen OmniAlibaba (Qwen) · ChinaCommercial use allowed

Models that understand text, images, audio and video and reply by voice in real time. Qwen3-Omni speaks 10 languages, including Russian.

DetailsVoice assistantsKimi-AudioMoonshot AI · ChinaCommercial use allowed

A general-purpose audio model: speech recognition, answering questions about sounds, detecting emotions and voice dialogue. Trained on 13 million hours of audio; languages are English and Chinese.

DetailsSpeech to textVoxtralMistral AI · FranceCommercial use with conditions

Mistral's speech models: they understand audio, transcribe and answer questions about a recording. The Realtime version recognizes speech live and supports Russian; speech synthesis is also available.

Details

Source: huggingface.co/nvidia/audio-flamingo-next-hf. Data checked against the model card on 22 Sep 2026. Have a lawyer review the license before commercial launch.