AI Agent Engineer
Prodigal · San Francisco, CA · 2 mo ago
On-siteEngineeringFull-time
About the role
At Prodigal, we’re reshaping the future of consumer finance. Founded in 2018 by IITB alumni, our journey began with one bold mission: to eradicate the inefficiencies and confusion that have plagued the lending and collections industry for decades.
Responsibilities
- Design, test, and refine prompts for voice AI agents handling complex financial conversations
- Develop systematic prompt engineering methodologies and best practices for voice interactions
- Ability to meta-prompt and run experiments with different LLMs
- Bring in new agent architectures to bring in the lowest latencies possible while maintaining high accuracy
- Create prompt templates and frameworks that scale across different use cases and customer segments
- Implement A/B testing strategies to measure and improve prompt effectiveness
- Analyze conversation transcripts and performance metrics to identify improvement opportunities
- Use our Simulation Platform and existing call corpus of our customers to tune and improve AI Agent performance
- Develop automated evaluation frameworks for AI agent quality assessment
- Create feedback loops (semi or fully automated) between production data and prompt refinements
- Optimize prompts for latency, accuracy, and natural conversation flow
- Collaborate with ML engineers to improve voice recognition and synthesis quality
- Design conversation flows that handle edge cases and error recovery gracefully
- Implement context management strategies for multi-turn conversations
- Develop domain-specific language models for financial services
- Travel to customer sites to learn from human agents and gather requirements
- Conduct on-site prompt optimization based on customer-specific needs to deliver rapid iterations of prototype versions
Requirements
- B.E/B.Tech/M.Tech in Computer Science, AI/ML, Linguistics, or equivalent
- Strong Python programming skills and experience with ML frameworks
- Ability to work with large-scale conversation data
- Excellent analytical and problem-solving skills
- Strong verbal and written communication skills and ability to explain technical concepts clearly
- Willingness to travel in the US for customer engagements
- Proficiency in prompt engineering techniques (few-shot learning, chain-of-thought meta-prompting, etc.)
- Knowledge of SQL and data analysis tools (Pandas, NumPy)
- Experience with experiment tracking and MLOps tools
- Understanding of real-time system constraints and latency optimization
- Familiarity with voice biometrics and authentication
- Experience with real-time streaming architectures
- Published research or blog posts on prompt engineering or conversational AI
- Experience with multilingual voice AI systems
Qualifications
- GenAI Experience – Work at the cutting edge of voice AI and prompt engineering, shaping the future of conversational AI in consumer finance
- World-class Team – Learn from and collaborate with experts from BCG, Deloitte, Meta, Amazon, and top institutes like IIT and IIM
- Continuous Education – Full sponsorship for courses, certifications, conferences, and learning materials related to AI and prompt engineering
- Travel Opportunities – Gain exposure to diverse customer environments and real-world AI implementations
- Health Insurance – Comprehensive coverage for you and your family
- Flexible Schedule – Work when you're most productive, with core collaboration hours
- Generous Leave Policy – Unlimited PTO to ensure you stay refreshed and creative
- Food at Office – All meals provided when working from office
- Recreation & Team Activities – Regular team bonding through sports, games, and social events
Benefits
- AI/ML: GPT, Claude, Gemini, Custom LLMs
- Languages: Python
- Infrastructure: AWS (Lambda, SageMaker, EKS), LiveKit for Real-time streaming
- Data: MongoDB, PostgreSQL, Databricks, Redis
- Tools: MLflow, Custom prompt management platforms
Schedule
Work when you're most productive, with core collaboration hours.
Pay
₹3M - ₹5M INR