@Jinyu_Chai
A step-by-step guide to building a TTS training dataset at the scale of tens of millions of samples. Over the past few months, we've been working on ways to collect and build high-quality TTS training datasets at scale. Compared to collecting text data for LLMs, working with speech data is significantly more complicated, with plenty of engineering challenges along the way. There's surprisingly little public discussion about this, especially when it comes to the practical challenges of collecting speech data at scale. So I wanted to share what we've learned over the past few months: the problems we've run into, the lessons learned, and how we designed and built our data engine from scratch. Hopefully, this will be useful to others working on TTS and large-scale speech datasets. We're also hoping to open-source the full codebase down the road so others can build on it. I also put together a video to make the article easier to follow.