Deep Learning Scientist, Speech Synthesis
Catapult Federal Services · Santa Clara, CA · 2 wk ago
EngineeringFull-time
Key Responsibilities
- Train and optimize speech synthesis models, including mel spectrogram and vocoder models.
- Analyze training metrics, validation losses, and model performance to identify root causes of model issues and recommend improvements.
- Benchmark and optimize speech models across multiple use cases.
- Develop and refine high-quality training datasets for speech AI models.
- Measure and characterize model accuracy, quality, and bias.
- Collaborate with cross-functional teams to develop and deliver new speech AI features.
- Participate in software development, design reviews, testing, and code reviews.
- Troubleshoot technical issues and contribute to continuous model improvements.
Required Qualifications
- Master's degree or Ph.D. in Computer Science, Electrical Engineering, Artificial Intelligence, Applied Mathematics, Linguistics, Computational Linguistics, or a related field (or equivalent experience).
- 3+ years of relevant industry experience.
- Strong Python programming skills.
- Strong understanding of machine learning and deep learning concepts.
- Experience with Text-to-Speech (TTS), Speech Synthesis, or Speech-to-Text (STT) technologies.
- Hands-on experience training deep learning models using PyTorch.
- Ability to analyze training behavior, validation losses, and model performance to troubleshoot and improve machine learning models.
- Knowledge of speech signal processing concepts, including FFT, MFCC, and mel spectrograms.
- Strong understanding of software development fundamentals.
- Experience using version control systems such as Git, Gerrit, or GitLab.
- Excellent communication and collaboration skills.
Preferred Qualifications
- Experience with deep learning architectures such as CNNs, RNNs, LSTMs, and Transformers.
- Experience with voice cloning or multilingual speech systems.
- Knowledge of text normalization (TN), inverse text normalization (ITN), or grapheme-to-phoneme (G2P) systems.
- Fluency in one or more languages such as Spanish, Mandarin, German, Japanese, Russian, French, Arabic, Hindi, Korean, Italian, or Portuguese.
- Interest in linguistics, phonetics, and speech technologies.
- Strong C++ programming skills.
- Familiarity with GPU technologies such as CUDA, cuDNN, or TensorRT.
- Experience deploying machine learning models to cloud, data center, or embedded environments.