AI & Test Automation Lead
Alstom · Pittsburgh, PA · 6 days ago
EngineeringFull-time
About the role
You'll ensure the quality, reliability, and performance of software applications, driving impactful QA transformation from manual to automated methods at scale. Day-to-day, you’ll work closely with teams across the business (developers, AI experts, and cross-functional stakeholders), analyze software test results to provide actionable insights, and refine AI models to improve test generation accuracy, and much more.
Responsibilities
- Developing and implementing automated testing frameworks (e.g., Robot Framework or similar) and writing robust automated test scripts.
- Applying AI/ML techniques, such as natural language processing and machine learning, to generate test cases/scripts and improve test generation accuracy.
- Refining AI models or collaborating with AI experts to enhance test automation capabilities.
- Building and deploying applications using LLM APIs (e.g., OpenAI, Ollama) and leveraging transformer architectures, attention mechanisms, and embedding models for semantic search.
- Proficiency in Python development with strong software engineering fundamentals and experience with ML frameworks like PyTorch, TensorFlow, and the Hugging Face ecosystem.
- Employing MLOps practices, including model versioning, monitoring, and deployment, to ensure seamless integration of AI models into testing pipelines.
- Leading testing teams or initiatives, providing training, and driving QA transformation from manual to automated methods at scale.
- Communicating complex AI and testing concepts effectively to both technical and non-technical stakeholders.
- Collaborating with cross-functional teams to identify and resolve software defects and ensure software meets required standards before release.
Requirements
- Degree in Engineering, Computer Engineering, Computer Science, or similar field.
- Experience or understanding of applying AI/ML for test automation, such as using machine learning or natural language processing to generate test cases/scripts.
- Knowledge of software testing methodologies, including manual and automated testing.
- Familiarity with programming languages like Python, Java, or C++.
- Strong communication skills to explain complex AI concepts to various stakeholders.
- Proficiency in developing automated testing frameworks (e.g., Robot Framework) and writing robust automated test scripts.
- Hands-on experience with LLM APIs (e.g., OpenAI, Ollama) and a deep understanding of transformer architectures, attention mechanisms, and model capabilities.
- Experience with vector databases, embedding models for semantic search, and prompt engineering techniques.
- Strong knowledge of DevOps practices and MLOps, including model versioning, monitoring, and deployment.
- Able to collaborate effectively with cross-functional teams and lead testing teams or initiatives.
Qualifications
- Experience with AI/ML for test automation.
- Strong background in software testing methodologies.
- Programming proficiency in Python and other relevant languages.
- Effective communication skills for explaining complex concepts.
- Experience with automated testing frameworks and scripting.
- Hands-on experience with LLM APIs and related technologies.
- Understanding of DevOps and MLOps practices.
- Leadership and team management experience.
Skills
- Python development
- Robotic Framework
- Machine Learning (ML)
- Transformer Architectures
- Attention Mechanisms
- Embedding Models
- MLOps
- DevOps Practices
- LLM APIs (e.g., OpenAI, Ollama)
- Vector Databases
- Semantic Search
- Prompt Engineering
Benefits
Explore our benefits package, which includes:
- Flexible working arrangements
- Competitive compensation and benefits
- Professional development opportunities
- Health and wellness programs
- Employee recognition and awards
Pay
Competitive salary based on experience and qualifications.
Schedule
Full-time hybrid schedule available.