Principal AI/ML Software Engineer
Octave · Greater Houston · 1 wk ago
RemoteRemoteEngineeringFull-time
Responsibilities
Position Overview: We are seeking a motivated AI/ML Engineer to build reliable, scalable systems and Generative AI and Agentic AI features, and build and deploy data-driven solutions for our document-based compliance management platform. This role requires a technical expert who can develop, deploy, and maintain ML systems in production environments.
- Build and deploy Generative AI features using foundation models (AWS Bedrock, OpenAI, Anthropic Claude) and inference pipelines with optimization of latency and cost
- Design agentic AI systems that autonomously handle compliance workflows, document review, regulatory mapping, and multi-step reasoning tasks
- Integrate comprehensive LLM evaluation frameworks with development and production systems
- Build and operate end-to-end MLOps pipelines, deployment systems, monitoring, and rollbacks workflows
- Implement explainability frameworks (SHAP/LIME) and monitoring dashboards ensuring transparency and regulatory adherence
- Collaborate with cross-functional teams to translate business needs into ML solutions and communicate insights to stakeholders
Technical Skills
- Python (5+ years): Production-level experience with Pandas, NumPy, scikit-learn, XGBoost, TensorFlow/PyTorch, Hugging Face Transformers, FastAPI/Flask, MLflow, and pytest
- SQL: Advanced proficiency with complex queries, window functions, and optimization
- Machine Learning & NLP: Strong foundation in supervised/unsupervised learning, deep learning, document understanding, text classification, and semantic analysis
- Generative AI & LLMs: Hands-on experience with foundation models (GPT, Claude, Llama), prompt engineering, RAG architectures, and vector databases (Pinecone, Weaviate, Chroma)
- MLOps & ModelOps: End-to-end experience with ML pipelines, model versioning, feature stores, drift detection, CI/CD for ML, and Docker containerization
- LLM