Speech: TTS and ASR
- Speech: TTS and ASRModel
FireRedTTS 2 open-source text-to-speech model
FireRedTTS 2 is an open TTS model on Hugging Face. The post describes long-form conversational speech, multilingual and cross-lingual voice cloning, low-latency output, and random timbre generation.
Engineers can evaluate a self-hostable TTS model for multilingual speech generation and voice cloning.
- Speech: TTS and ASRProject
Qwen3-ASR-Toolkit handles long-audio transcription
Qwen3-ASR-Toolkit is a Python CLI for the Qwen3-ASR API. It supports long audio and video transcription using VAD splitting, parallel API calls, multiple media formats, and automatic resampling.
It provides a way to process long recordings through the Qwen3-ASR API with parallel calls and media-format support.
- 1 year ago @jiqizhixin
FireRedTTS-2 Uses Streaming Tokens for Multi-Speaker Dialogue
FireRedTTS-2 is described as a long-form streaming TTS system using a 12.5 Hz speech tokenizer, a dual-transformer architecture, and interleaved text–speech input for context-aware multi-speaker dialogue. The post claims it outperforms several systems on intelligibility, speaker turns, and…
Its streaming design and multi-speaker format may be relevant to engineers building conversational speech generation.
- Speech: TTS and ASRArticle
Deploy streaming Kyutai STT on Modal
Modal provides an example for deploying a streaming audio transcription service with Kyutai STT.
It offers engineers a concrete reference for running streaming speech recognition.
- 1 year ago @cocktailpeanut
Zonos TTS Beta and Cross-Platform Local Launcher
Zonos announced a beta expressive TTS model with voice cloning, releasing transformer and SSM-hybrid models under Apache 2.0. The post also presents a one-click launcher for Mac, Windows, and Linux.
Engineers can explore a locally runnable voice-cloning TTS model and its available model architectures.
- Speech: TTS and ASRProject
Hibiki: a model for streaming speech translation
Hibiki is a decoder-only model for simultaneous French–English speech translation. Its synthetic training corpus uses translations from MADLAD, the authors’ TTS, and a simple lag rule.
The repository offers engineers a model for streaming speech translation to evaluate and run.
- 1 year ago @Tu7uruu
Moonshine ASR model added to Transformers
The post announces Moonshine, an ASR model integrated into Hugging Face Transformers. It says the model uses Rotary Position Embeddings and can handle audio inputs of any length.
Engineers can evaluate another ASR model for processing long audio inputs.
- 1 year ago @tom_doerr
Piper is a local neural text-to-speech system
Piper converts text into speech using various voices and phonemization libraries. It supports multiple languages and customizable options.
Engineers can evaluate a local TTS option with multilingual support and configurable settings.
- Speech: TTS and ASRProject
Ultravox: a multimodal LLM for real-time voice
Ultravox is a fast multimodal LLM for real-time voice. Its source code is available on GitHub.
Engineers can inspect the project and evaluate its approach to real-time voice applications.
- 2 years ago @cocktailpeanut
e2-f5-tts Gradio App Supports Custom F5-TTS Finetunes
The official e2-f5-tts Gradio app now supports custom F5-TTS finetunes. The post mentions finetunes for Spanish, Hungarian, German, Portuguese, and Greek.
Engineers can use the app to try custom multilingual F5-TTS voice models.
- Speech: TTS and ASRPaper
MaskGCT: Zero-Shot Text-to-Speech with a Masked Codec Transformer
MaskGCT is a zero-shot text-to-speech model introduced in a paper and released by Amphion. The post claims it can clone a voice from five seconds of speech.
Engineers can explore a released approach to zero-shot TTS and its voice-cloning requirements.
- 2 years ago @cocktailpeanut
E2-F5-TTS adds a Gradio fine-tuning UI
The E2-F5-TTS project adds a Gradio app for fine-tuning the model with user-provided audio. It automatically transcribes audio clips.
Engineers can explore a UI-based workflow for adapting a TTS model to their own audio.
- Speech: TTS and ASRProject
Hugging Face Speech-to-Speech voice agent toolkit
A GitHub project for building voice agents with open-source models.
Engineers can explore a project for assembling voice agents from open-source models.
- Speech: TTS and ASRModel
French Parler-TTS Mini Model on Hugging Face
The post points to PHBJT’s French Parler-TTS Mini model hosted on Hugging Face. It also mentions XTTS and FishAudio, and speculates about a future multilingual Parler-TTS.
Engineers exploring French text-to-speech models can inspect the linked model page.
- 2 years ago @reach_vb
Moshi: an open-source speech-to-speech model
Moshi is a 7.6B-parameter speech-to-speech model, accompanied by Mimi, a streaming audio codec. The post says the release includes model checkpoints and inference code for Candle, PyTorch, and MLX.
Engineers can evaluate the model and run inference with different frameworks and hardware.
- 2 years ago @rohanpaul_ai
VoiceCraft for Zero-Shot Speech Editing and TTS
VoiceCraft is a neural codec language model for speech editing and zero-shot text-to-speech. The post says it can clone or edit an unseen voice using a few seconds of reference audio.
Engineers can evaluate its approach to voice cloning and speech editing on varied audio.
- 2 years ago @yoachlacombe
Parler-TTS Mini and Large v1 Released
Parler-TTS Mini and Large v1 are open-source text-to-speech models trained on 45K hours of speech data. Speech characteristics such as gender, background noise, rate, pitch, and reverberation can be controlled with text prompts.
Engineers can evaluate controllable TTS models with released weights, training data, and recipes.
- 2 years ago @chenwanch1
XEUS speech encoder released with code and checkpoints
WavLab announced XEUS, a self-supervised speech encoder trained on over 1 million hours of speech and covering more than 4,000 languages. The post says its code, checkpoints, and data are being released.
Engineers can evaluate a multilingual speech encoder and its accompanying data for their own systems.
- Speech: TTS and ASRArticle
Speech-to-Text Provider Comparison
Artificial Analysis compares speech-to-text models by word error rate, speed, and price, with a leaderboard for choosing a model by use case.
Engineers can compare ASR quality, latency, and cost when evaluating providers.
arxiv.org
