Prompt Engineer
Virtusa · New York, United States · 3 days ago
EngineeringFull-time
Job Requirements Having 8+ years of experience on the following: Prompt Design & Optimization – Craft, test, and refine prompts for LLMs to maximize accuracy, relevance, and consistency across use cases (chatbots, agents, RAG systems). Evaluation & Experimentation – Design evaluation frameworks (A/B testing, benchmarking, rubric-based scoring) to measure prompt performance and iterate systematically. LLM & Tooling Expertise – Deep understanding of LLM behavior (GPT, Claude, etc.), context windows, tokenization, fine-tuning vs. prompting trade-offs, and frameworks like LangChain or similar orchestration tools. Cross-functional Collaboration – Work closely with product, engineering, and data science teams to translate business requirements into effective prompt/agent workflows. Technical & Analytical Skills – Strong Python scripting, API integration, data analysis, and familiarity with prompt security/safety practices (jailbreak prevention, bias mitigation, guardrails). Work Experience 10-15Years