Speech: TTS and ASR
- Speech: TTS and ASRArticle
TurnBench benchmarks turn-taking in spoken dialogue
TurnBench is an open benchmark with 30 hours of triple-annotated dyadic speech, a scoring protocol grounded in conversation analysis, and results for 14 systems. It measures turn-taking in spoken dialogue.
Engineers can use the benchmark to evaluate whether voice systems handle turn endings and backchannel cues.
- Speech: TTS and ASRProject
FireRedAudio combines speech recognition, audio understanding, and TTS
FireRedAudio uses Qwen3.5-9B as a shared backbone for ASR, audio understanding, zero-shot and instruction-based TTS, and speech editing. It uses separate continuous representations for audio understanding and generation.
Engineers can explore an open-source model covering multiple speech tasks in one audio language model.
- Speech: TTS and ASRProject
Breeze TTS 2 releases open weights
BreezeBlue says Breeze TTS 2 is now open-weight and links to its GitHub repository and model weights on Hugging Face. The author claims it ranks first among open-weight TTS models in the Artificial Analysis Provider Voices Speech Arena.
Engineers can inspect and test the model weights and repository for self-hosted TTS use.
- Speech: TTS and ASRModel
Pocket TTS runs on Android with LiteRT
Pocket TTS, a 100M-parameter text-to-speech model, runs on-device with LiteRT. The post reports six bundled voices and real-time or faster playback on current Android devices.
Engineers can evaluate an on-device TTS option for Android apps.
- 2 months ago @ArtificialAnlys
Breeze TTS 2 offers open weights and streaming generation
Breeze TTS 2 is a text-to-speech model supporting 50 languages, voice generation from text prompts, and streaming generation. Its weights are available on Hugging Face.
Engineers can evaluate an openly weighted TTS model with multilingual and streaming capabilities.
- Speech: TTS and ASRProject
ComfyUI plugin adds VoxCPM2 inference and LoRA training
ComfyUI_VoxCPM_SM is a ComfyUI plugin for VoxCPM2 inference and LoRA fine-tuning with custom voice data. The post says it supports low-VRAM use and quantized models, including INT4, INT8, and GGUF.
Engineers can use a node-based workflow to run and customize VoxCPM2 voice generation locally.
- 3 months ago @GenAI_is_real
Packed FlashAttention Speeds Up a Transformer Vocoder
A post reports that waveform reconstruction in a transformer vocoder, not autoregressive decoding, was the TTS latency bottleneck. A packed FlashAttention path with variable-length packing, local-causal attention, and RoPE reportedly improved QPS by 48.64% and reduced latency by 32.71%.
It highlights why profiling the full TTS pipeline can reveal optimization targets that differ from LLM decoding bottlenecks.
Open-source real-time voice demo
Hugging Face and Cerebras built a real-time voice demo with open-source models and code. The demo supports WebSocket or WebRTC.
Engineers can test the demo and inspect or modify its code and models.
- 4 months ago @ArtificialAnlys
Artificial Analysis introduces a Speech-to-Speech model index
The index combines Big Bench Audio, a Full Duplex Bench subset, and τ-Voice with equal weighting to assess speech reasoning, conversational dynamics, and agentic performance. Models need valid results on all three datasets to be included.
It gives engineers a combined benchmark for comparing native Speech-to-Speech models across three capabilities.
- 4 months ago @jichiep
LocalVQE Pi V1 targets audio cleanup on Raspberry Pi 5
The post announces a 49k-parameter model for acoustic echo cancellation, noise suppression, and dereverberation, claiming 21× real-time performance on one Raspberry Pi 5 core.
It may interest engineers building local speech-audio processing on Raspberry Pi hardware.
- Speech: TTS and ASRProject
VoiceGate adds cross-lingual dubbing workflows to ComfyUI
VoiceGate is a video dubbing project built with VoxCPM2 and ComfyUI. It combines ASR, LLM translation, multilingual TTS, and SRT timestamp-based audio alignment.
Engineers can inspect a workflow for coordinating transcription, translation, speech synthesis, and audio-video synchronization.
- Speech: TTS and ASRArticle
Ubuntu introduces Project Myna for desktop dictation
Project Myna aims to bring speech-to-text dictation to Ubuntu Desktop, with a planned Ubuntu 26.10 workflow that inserts spoken text into the active application. The project description says processing will run on local hardware.
Engineers can follow development of an upcoming, locally run dictation feature integrated with the Ubuntu desktop.
- 5 months ago @cohere
Cohere announces open-source speech recognition model
Cohere says its open-source speech recognition model, Cohere Transcribe, ranks first on Hugging Face’s new Far-Field ASR benchmark.
The benchmark result may help engineers evaluating speech recognition models.
- Speech: TTS and ASRArticle
Gradium updates TTS pronunciation for structured text
Gradium says its upgraded TTS model improves pronunciation of spelling, acronyms, emails, phone numbers, and codes. The company reports benchmark results against its previous model and several real-time competitors.
Accurate readback of structured text is important for voice agents handling contact details and verification codes.
- Speech: TTS and ASRArticle
Live translation with the Gemini Live API
Google’s Gemini API documentation covers live translation with the Gemini Live API.
Useful to engineers exploring API-based live translation for multilingual experiences.
- Speech: TTS and ASRProject
UNITTS unifies inference and benchmarking for open-source TTS
UNITTS is a toolkit for running inference and benchmarking across open-source TTS models. The post says it supports Chatterbox and Fish Audio s2-pro.
A unified interface can make it easier to compare and switch between open-source TTS engines.
- 6 months ago @Tu7uruu
Open ASR Leaderboard Adds Private Evaluation Data
The Open ASR Leaderboard now includes private evaluation data from Appen and DataoceanAI, aiming to reduce test-set contamination and overfitting in speech recognition benchmarks.
Private evaluation data can make ASR benchmark results harder to optimize through test-set leakage.
- 6 months ago @realmrfakename
Qwen3-ASR-Enhanced v0.1 Beta Checkpoint Announced
The author describes Qwen3-ASR-Enhanced v0.1 as an early beta checkpoint. Support for nonverbal tags is not yet stable, and a revised version is planned.
Engineers evaluating ASR models can track an early checkpoint and its known limitation with nonverbal tags.
- Speech: TTS and ASRProject
FireRedVAD supports voice activity detection in 100+ languages
FireRedVAD is a GitHub project for voice activity detection and audio event detection. Its description says it supports more than 100 languages.
Engineers building speech pipelines can evaluate it for voice activity and audio event detection.
- 8 months ago @HuggingPapers
Microsoft VibeVoice-ASR supports long-form transcription
Microsoft says VibeVoice-ASR can transcribe 60-minute audio in one pass, with speaker diarization, timestamps, and hotwords. It supports more than 50 languages without requiring a language setting.
The stated capabilities may make it useful for engineers building multilingual speech-recognition pipelines.
