Senior Prompt Engineer: LLM Migration & Optimization
Arcitecture Migration
Take full ownership of the end-to-end technical migration of templates to LLM autoraters.
Optimization Leadership
- Utilize Automatic Prompt Generation (APG) and supervise Automated Prompt Optimization (APO) tools to push model performance past plateaus and deadlocks.
Metrics-Driven Excellence
- Continuously measure quality against "gold data" baselines, tracking precision, recall, and $F_1$ scores to justify launch readiness.
Edge-Case Engineering
Manually draft and refine complex prompts to overcome anti-patterns and architecture gaps that automated tools can't solve.
Job Title
Senior Prompt Engineer (LLM Migration)
Schedule
Part-Time (Set your own hours within project milestones)
Location
100% Remote (Must be based in the United States)
Employment Type
Freelance / Independent Contractor
Educational Foundation
Bachelor’s, Master’s, or PhD in Computer Science, Data Science, Computational Linguistics, or a related analytical field.
Prompt Engineering Mastery
- 4+ years of experience tuning LLMs for strict, structured outputs, complex classification, and few-shot learning.
Analytical Power
- High proficiency in identifying error patterns and using SQL or data analytics tools to monitor performance.
Technical Agility
- Fast learner capable of mastering proprietary internal tools and "Goose API" style interfaces with minimal oversight.
Familiarity with Shadowbot Monitoring and Disagreement Tracking
- Experience in AI model evaluation and software engineering.
Deep Understanding of Semantics, Logic, and Chain-of-Thought (CoT) Prompting
- Proven ability to draft high-level Launch Certification Documentation.
Technical Review
Submit your CV and portfolio of LLM optimization work.
Prompt Assessment
Demonstrate your ability to navigate complex template clusters and APO deadlocks.
Tooling Deep-Dive
Get access to our internal technical suite and migration workflows.
Launch
Begin your part-time engagement and lead the shift to LLM-driven autorating.