INTEGRATED: Silero TTS (tts-1-silero)
- Added silero_wrapper class to speech.py for PyTorch Hub integration
- CPU-friendly, no GPU required (48kHz sample rate)
- Supports 5 languages: English (117 speakers), Russian, German, Spanish, French
- Loads on-demand via torch.hub from snakers4/silero-models
- Added 6 OpenAI-compatible voice mappings (alloy, echo, fable, etc.)
PREPARED: Chatterbox & Kokoro TTS
- Added dependencies to requirements.txt:
* git+https://github.com/resemble-ai/chatterbox.git
* transformers>=4.35.0 (for Kokoro)
* huggingface-hub[cli] (for model downloads)
- Created Makefile targets for downloading models
- Created test targets for all three new engines
Makefile Enhancements:
- make voices-silero: Download Silero models (en, ru, de, es, fr)
- make test-silero: Test Silero TTS endpoint
- make voices-chatterbox: Download Chatterbox models via HF CLI
- make test-chatterbox: Test Chatterbox with emotion control
- make voices-kokoro: Download Kokoro models via HF CLI
- make test-kokoro: Test Kokoro fast synthesis
speech.py Changes:
- Added silero_wrapper class with tts() method
- Added tts-1-silero model handler in generate_speech()
- Registered tts-1-silero model in app
- Added PCM media type for Silero (48000 Hz)
- Global state: silero_model, silero_speakers dict
Configuration:
- Updated voice_to_speaker.default.yaml with tts-1-silero section
- Mapped all 6 OpenAI voices to Silero speakers (en_0 through en_5)
Documentation:
- Updated docs/MODELS.md: Silero marked as ✅ INTEGRATED
- Updated roadmap: Phase 1 task 3 completed
- Updated status footer: 3 models rescued
- Added integration examples and Makefile commands
Next Steps:
- Test Silero integration in Docker
- Implement Chatterbox emotion control engine
- Implement Kokoro fast decoder engine
- Expanded Piper TTS and Coqui XTTS sections with full details
- Added Mozilla TTS (historical reference, skip in favor of Coqui)
- Added Chatterbox (voice assistant framework)
- Added Mimic 3 (Mycroft TTS, at-risk from shutdown)
- Added eSpeak NG (legacy formant synthesis, 100+ languages)
- Added Kokoro TTS (new 2024 project, StyleTTS2-based)
- Expanded Silero TTS as HIGHEST priority (actively maintained)
- Documented licenses, repositories, model hubs for all engines
- Added integration effort estimates and raccoon priorities
This update provides comprehensive tracking of all TTS engines for
the raccoon mission to rescue and integrate abandoned models.
🦝 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <noreply@anthropic.com>
Makefile improvements:
- Add voices-xtts target to download speaker samples
- Add test-xtts target for testing HD model
- Split voices into voices-piper and voices-xtts
- Update help text with all new targets
speech.py:
- Fix threading import scope issue for XTTS
- Remove redundant 'import threading' inside Piper block
docs/CLAUDE.md:
- Complete guide for Claude Code contributors
- Makefile-first development philosophy
- Never create dirs manually, always use Makefile
- Documentation requirements and testing philosophy
- Common mistakes to avoid
- Raccoon mission values and principles
This ensures consistent, repeatable deployments and makes it easy
to add new TTS engines following the same pattern.
🦝 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <noreply@anthropic.com>
Created docs/AUDIT.md with:
- Complete file inventory and assessment
- Analysis of 10+ abandoned TTS models to integrate
- Multi-tier binary mirror strategy
- Proposed refactoring with engine abstraction
- License clarification (AGPL v3, not MIT)
This audit identifies all non-essential files for removal and documents
the plan to rescue abandoned TTS projects (Silero, StyleTTS2, Bark, etc.)
into a unified resilient system.
🦝 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <noreply@anthropic.com>
