F5-TTS cloning quality depends on ref_text matching the prosody of ref_audio (commas, periods, casing). Previous ref_texts were LibriSpeech ground-truth labels: ALL CAPS, no punctuation — wrong signal for a flow-matching TTS conditioned on text. Whisper hears what F5 will hear. - scripts/whisper_refs.py — transcribe all wavs, rewrite voice_to_speaker.default.yaml + cloned-voices/voices_metadata.json in place. Also writes cloned-voices/whisper_refs.json sidecar. - Makefile: whisper-refs target. Idempotent, rerun whenever cloned-voices/ changes. Run on a GPU host (4090/3090). ~30s for 40 short clips on a 4090. |
||
|---|---|---|
| .. | ||
| add_voice.py | ||
| download_diverse_voices.py | ||
| download_diverse_voices.sh | ||
| download_samples.sh | ||
| download_voice_samples.sh | ||
| fetch_voices.py | ||
| say.py | ||
| test_voices.sh | ||
| whisper_refs.py | ||