Jobs · Engineering · Pennsylvania

AI & Test Automation Lead

Alstom · Pittsburgh, PA · 6 days ago
EngineeringFull-time

About the role

You'll ensure the quality, reliability, and performance of software applications, driving impactful QA transformation from manual to automated methods at scale. Day-to-day, you’ll work closely with teams across the business (developers, AI experts, and cross-functional stakeholders), analyze software test results to provide actionable insights, and refine AI models to improve test generation accuracy, and much more.

Responsibilities

  • Developing and implementing automated testing frameworks (e.g., Robot Framework or similar) and writing robust automated test scripts.
  • Applying AI/ML techniques, such as natural language processing and machine learning, to generate test cases/scripts and improve test generation accuracy.
  • Refining AI models or collaborating with AI experts to enhance test automation capabilities.
  • Building and deploying applications using LLM APIs (e.g., OpenAI, Ollama) and leveraging transformer architectures, attention mechanisms, and embedding models for semantic search.
  • Proficiency in Python development with strong software engineering fundamentals and experience with ML frameworks like PyTorch, TensorFlow, and the Hugging Face ecosystem.
  • Employing MLOps practices, including model versioning, monitoring, and deployment, to ensure seamless integration of AI models into testing pipelines.
  • Leading testing teams or initiatives, providing training, and driving QA transformation from manual to automated methods at scale.
  • Communicating complex AI and testing concepts effectively to both technical and non-technical stakeholders.
  • Collaborating with cross-functional teams to identify and resolve software defects and ensure software meets required standards before release.

Requirements

  • Degree in Engineering, Computer Engineering, Computer Science, or similar field.
  • Experience or understanding of applying AI/ML for test automation, such as using machine learning or natural language processing to generate test cases/scripts.
  • Knowledge of software testing methodologies, including manual and automated testing.
  • Familiarity with programming languages like Python, Java, or C++.
  • Strong communication skills to explain complex AI concepts to various stakeholders.
  • Proficiency in developing automated testing frameworks (e.g., Robot Framework) and writing robust automated test scripts.
  • Hands-on experience with LLM APIs (e.g., OpenAI, Ollama) and a deep understanding of transformer architectures, attention mechanisms, and model capabilities.
  • Experience with vector databases, embedding models for semantic search, and prompt engineering techniques.
  • Strong knowledge of DevOps practices and MLOps, including model versioning, monitoring, and deployment.
  • Able to collaborate effectively with cross-functional teams and lead testing teams or initiatives.

Qualifications

  • Experience with AI/ML for test automation.
  • Strong background in software testing methodologies.
  • Programming proficiency in Python and other relevant languages.
  • Effective communication skills for explaining complex concepts.
  • Experience with automated testing frameworks and scripting.
  • Hands-on experience with LLM APIs and related technologies.
  • Understanding of DevOps and MLOps practices.
  • Leadership and team management experience.

Skills

  • Python development
  • Robotic Framework
  • Machine Learning (ML)
  • Transformer Architectures
  • Attention Mechanisms
  • Embedding Models
  • MLOps
  • DevOps Practices
  • LLM APIs (e.g., OpenAI, Ollama)
  • Vector Databases
  • Semantic Search
  • Prompt Engineering

Benefits

Explore our benefits package, which includes:

  • Flexible working arrangements
  • Competitive compensation and benefits
  • Professional development opportunities
  • Health and wellness programs
  • Employee recognition and awards

Pay

Competitive salary based on experience and qualifications.

Schedule

Full-time hybrid schedule available.

Similar jobs

Test Automation Lead

BAE Systems, Inc.Merrimack, NH· 1 wk ago
Engineeringapply on jobs.baesystems.com

Test Automation Lead

Infinite Computer SolutionsTexas, United States· 4 mo ago
Engineeringapply on sjobs.brassring.com