AI/ML Engineer (Mid-level)

About The Role

We are seeking a highly skilled and visionary AI Systems Engineer to own the intelligence layer at Prophecy. In this pivotal role, you will be responsible for developing and optimizing the AI systems that enable our agents to understand data schemas, generate accurate transformations, and reason over complex enterprise knowledge. This is not a role focused on implementing predefined specifications; instead, it requires making strategic decisions on agent architecture, model selection, quality evaluation, and build versus buy considerations. The scope of your influence will be broad, offering significant leverage regardless of your title.

You will work at the forefront of AI-native data technology, shaping the future of enterprise data workflows and AI automation.

Qualifications

• 4-6+ years of experience in software engineering with a strong focus on AI/ML systems
• Proficiency in Python programming language
• Experience designing and deploying multi-step AI agents and systems
• Strong understanding of retrieval and knowledge systems, including vector databases and knowledge graphs (e.g., Neo4j)
• Hands-on experience with natural language processing, code generation, and data transformation techniques
• Familiarity with cloud platforms such as AWS and orchestration tools like Kubernetes
• Knowledge of data processing and analytics platforms such as Databricks, Snowflake, BigQuery, DuckDB, and Spark
• Ability to make architectural decisions under uncertainty and operate effectively in a fast-paced environment
• Excellent problem-solving skills and a strategic mindset for evaluating and improving AI systems
• Experience with additional languages such as Scala and Go is a plus

Responsibilities

• Design and develop end-to-end multi-step AI agents, including problem decomposition, context retrieval, error recovery, and output quality management
• Establish performance standards, build evaluation frameworks, and lead the continuous improvement loop for AI agents
• Own the retrieval and knowledge systems, including RAG pipelines, vector and graph-based retrieval, and knowledge representations
• Develop and refine the AI layer responsible for natural language to production-grade data transformations, including prompt design, model selection, and output validation
• Ensure AI systems operate efficiently at scale, managing latency, throughput, and observability, while optimizing models and system architecture as needed
• Collaborate with cross-functional teams to integrate AI solutions with existing data platforms and workflows
• Stay abreast of the latest AI/ML advancements and incorporate innovative techniques into Prophecy’s platform
• Provide technical leadership and mentorship to team members, fostering a culture of innovation and excellence

Benefits

• Prophecy covers 99% of employee health insurance premiums and 75% for dependents
• Monthly allowance of $200 towards remote work expenses, wellness programs, gym memberships, massages, facials, and more
• Flexible paid time off policy to support work-life balance
• Professional development allowance to support continuous learning and growth
• Company-sponsored Long Term Disability and Life Insurance
• FSA/HSA options for healthcare savings
• Comprehensive dental and vision coverage
• Opportunity to work on innovative, impactful AI-native data platform solutions
• End-to-end ownership of projects, fostering professional growth and leadership