Jobs · Engineering · North Carolina

Senior Data Scientist II – Generative AI / RAG / Agentic AI

hackajob · Raleigh, NC · 1 wk ago
On-siteEngineering$105k–$175k/yrFull-time

About the role

You will join a multidisciplinary team of data scientists, engineers, and product partners focused on building intelligent, reliable, and responsible AI solutions for legal and business professionals. You work collaboratively, value thoughtful experimentation, and prioritize high-quality, production-ready outcomes.

Responsibilities

  • Design, build, and optimize Generative AI, RAG, and agentic RAG systems for drafting, search, and reasoning use cases
  • Improve LLM-generated outputs through prompt design, retrieval optimization, evaluation, and experimentation
  • Develop and maintain scalable data science and machine learning components for production environments
  • Build and enhance retrieval pipelines, including query processing, document retrieval, ranking, reranking, and grounding strategies
  • Apply text search and relevance tuning techniques using platforms such as OpenSearch and Solr
  • Use embeddings, hybrid retrieval, semantic search, and reranking methods to improve answer quality and system performance
  • Write high-quality, maintainable, production-ready Python code following strong software engineering practices
  • Collaborate closely with partners across data science, engineering, product, and domain teams

Requirements

  • Proven experience building and improving Generative AI and LLM-based solutions in production or near-production settings
  • Strong experience with RAG frameworks, retrieval-based AI architectures, and agentic workflows
  • Advanced Python skills, including modular design, testing, debugging, and clean coding practices
  • Strong understanding of information retrieval, text search methods, and retrieval architectures
  • Hands-on experience with OpenSearch, Solr, or similar search platforms
  • Experience with embeddings, semantic retrieval, reranking, and relevance optimization
  • Proven ability to work effectively in a monorepo environment with disciplined version control and code review practices
  • Experience collaborating in cross-functional teams and contributing to CI/CD and deployment workflows

Qualifications

  • Master's degree in Computer Science, Artificial Intelligence, Statistics, or related field
  • Minimum of 5 years of relevant experience in data science, machine learning, or related fields
  • Experience with large-scale data processing and analysis tools
  • Knowledge of legal and business domains, and familiarity with legal and business terminology

Skills

  • Python programming
  • Information retrieval and text search methods
  • RAG frameworks and retrieval-based AI architectures
  • OpenSearch, Solr, or similar search platforms
  • Embeddings, semantic retrieval, reranking, and relevance optimization

Benefits

We promote flexible ways of working that support collaboration, focus, and personal wellbeing, while meeting the needs of our teams and customers.

Pay

The U.S. National Base Pay Range is $104,900 - $174,700. Geographic differentials may apply in some locations to better reflect local market rates.

Schedule

This role supports flexible working arrangements, balancing individual productivity with team collaboration.

Similar jobs