848c2c6cb5
INTEGRATED: Silero TTS (tts-1-silero) - Added silero_wrapper class to speech.py for PyTorch Hub integration - CPU-friendly, no GPU required (48kHz sample rate) - Supports 5 languages: English (117 speakers), Russian, German, Spanish, French - Loads on-demand via torch.hub from snakers4/silero-models - Added 6 OpenAI-compatible voice mappings (alloy, echo, fable, etc.) PREPARED: Chatterbox & Kokoro TTS - Added dependencies to requirements.txt: * git+https://github.com/resemble-ai/chatterbox.git * transformers>=4.35.0 (for Kokoro) * huggingface-hub[cli] (for model downloads) - Created Makefile targets for downloading models - Created test targets for all three new engines Makefile Enhancements: - make voices-silero: Download Silero models (en, ru, de, es, fr) - make test-silero: Test Silero TTS endpoint - make voices-chatterbox: Download Chatterbox models via HF CLI - make test-chatterbox: Test Chatterbox with emotion control - make voices-kokoro: Download Kokoro models via HF CLI - make test-kokoro: Test Kokoro fast synthesis speech.py Changes: - Added silero_wrapper class with tts() method - Added tts-1-silero model handler in generate_speech() - Registered tts-1-silero model in app - Added PCM media type for Silero (48000 Hz) - Global state: silero_model, silero_speakers dict Configuration: - Updated voice_to_speaker.default.yaml with tts-1-silero section - Mapped all 6 OpenAI voices to Silero speakers (en_0 through en_5) Documentation: - Updated docs/MODELS.md: Silero marked as ✅ INTEGRATED - Updated roadmap: Phase 1 task 3 completed - Updated status footer: 3 models rescued - Added integration examples and Makefile commands Next Steps: - Test Silero integration in Docker - Implement Chatterbox emotion control engine - Implement Kokoro fast decoder engine
32 lines
1.3 KiB
Text
32 lines
1.3 KiB
Text
fastapi
|
|
uvicorn
|
|
loguru
|
|
# OHF-Voice fork doesn't have installable Python package yet
|
|
# Stick with PyPI piper-tts but use absolute paths in config
|
|
piper-tts>=1.2.0
|
|
# 🦝 RACCOON TODO: Create our own PyPI package from OHF-Voice fork
|
|
# git+https://github.com/OHF-Voice/piper1-gpl.git@v1.3.0#subdirectory=src/python_run
|
|
coqui-tts[languages]
|
|
# Silero TTS - actively maintained, small efficient models
|
|
# Note: Silero models are loaded via torch.hub, no package install needed
|
|
# Models: ~50-100MB each, CPU-friendly, real-time capable
|
|
# Chatterbox - emotion control, 23 languages (Resemble AI)
|
|
# Install from git since no PyPI package exists yet
|
|
git+https://github.com/resemble-ai/chatterbox.git
|
|
langdetect
|
|
pyyaml
|
|
# Kokoro TTS - fast decoder-only architecture
|
|
# Install from Hugging Face transformers
|
|
transformers>=4.35.0
|
|
# Hugging Face Hub for model downloads
|
|
huggingface-hub[cli]
|
|
# Creating an environment where deepspeed works is complex, for now it will be disabled by default.
|
|
#deepspeed
|
|
|
|
torch; sys_platform != "darwin"
|
|
torchaudio; sys_platform != "darwin"
|
|
# for MPS accelerated torch on Mac - doesn't work yet, incomplete support in torch and torchaudio
|
|
torch; --index-url https://download.pytorch.org/whl/cpu; sys_platform == "darwin"
|
|
torchaudio; --index-url https://download.pytorch.org/whl/cpu; sys_platform == "darwin"
|
|
|
|
# ROCM (Linux only) - use requirements.amd.txt
|