AI Engineer (AI Accelerator Program)
UCSF Health · San Francisco, CA · 1 mo ago
EngineeringFull-time
Responsibilities
- Build and maintain data integration (with SQL databases or APIs) and data processing and transformation pipelines to support the development and implementation of AI/ML tools
- Identify and build systems for implementation, monitoring, and maintenance of AI/ML tools using modern MLOps practices including CI/CD, model versioning, and cloud-native deployment
- Collaborate with data scientists and researchers to design and implement highly complex metrics and processes to automatically monitor AI/ML tools for safety, potential bias or drift, performance, and validity
- Design and develop APIs, services, or lightweight web applications to enable integration of AI/ML and generative AI capabilities into clinical and operational workflows
- Develop and deploy generative AI solutions (e.g., LLM-based systems), including prompt engineering, retrieval-augmented generation (RAG), and evaluation frameworks for unstructured data
- Design and implement highly complex real-time or near real-time data processing and inference systems to support AI/ML and generative AI applications
- Develop scalable, event-driven architectures and ensure reliable, low-latency integration of AI capabilities into production clinical and operational workflows
Qualifications
- Bachelor's degree in related area and / or equivalent experience / training
- 5 years of experience in positions of increasing responsibility designing, implementing, and maintaining complex AI/ML applications
- Experience with data analysis and machine learning tools such as Jupyter, Pandas, scikit-learn, Numpy/Scipy, PyTorch, etc.
- Demonstrated advanced knowledge of full software development lifecycle
- Advanced experience with Python; ability to write clean, efficient, and production-level Python code
- Advanced experience with SQL (e.g., SQLServer, PostgreSQL)
- Demonstrated experience deploying, monitoring, and maintaining AI/ML models and pipelines
- Experience designing and developing APIs or microservices to support AI/ML applications
- Familiarity with web application development frameworks (e.g., React, JavaScript/TypeScript) or integrating backend systems with user-facing applications
- Experience with large language models (LLMs), including prompt engineering, evaluation, and production deployment
- Experience with real-time or streaming data processing systems and low-latency inference architectures
- Demonstrated effective communication and interpersonal skills
- Demonstrated ability to communicate technical information to technical and non-technical personnel at various levels in the organization
- Self-motivated and works independently and as part of a team
- Able to learn effectively and meet deadlines
- Demonstrated broad problem-solving skills
- Demonstrated ability to interface with management on a regular basis
- Excellent project leadership and management skills