AI Software Engineer (Python, LangChain, LLMs)

About the role

ACA Group is the leading governance, risk, and compliance (GRC) advisor in financial services. We're building innovative, AI-powered technology solutions that help financial institutions manage compliance, reduce risk, and improve operational efficiency. We are seeking an AI Software Engineer to design and build intelligent applications leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and AI agents. This role will work closely with product, engineering, and compliance teams to develop scalable AI-powered solutions that solve complex business challenges in the financial services industry.

Responsibilities

• Design and develop AI-powered applications using Python
• Build and maintain RAG-based solutions and AI agent workflows
• Integrate and optimize commercial LLMs such as GPT, Claude, Gemini, Llama, and DeepSeek
• Develop APIs, services, and integrations that support AI-powered workflows
• Design and optimize solutions using SQL, NoSQL, and vector databases
• Collaborate with product, compliance, and engineering teams to deliver innovative solutions
• Evaluate emerging AI technologies and recommend improvements to the platform

Requirements

• 7+ years of professional software development experience with Python
• Experience with LangChain or similar AI orchestration frameworks
• Experience working with commercial LLMs (GPT, Claude, Gemini, Llama, DeepSeek, etc.)
• Experience implementing Retrieval-Augmented Generation (RAG) solutions
• Experience building and deploying AI agents
• Strong knowledge of SQL, NoSQL, and vector databases
• Experience with REST APIs, HTTP, SSH, and SFTP
• Experience with AWS and/or Azure
• Experience with application performance monitoring and observability tools (e.g., New Relic, Datadog, Dynatrace, or similar)
• Experience with workflow/data-pipeline orchestration platforms (e.g., Airflow, Prefect, Dagster, or similar)
• Strong software design, architecture, and problem-solving skills
• Excellent communication and collaboration skills

Qualifications

• Experience with cloud-native application development and microservices
• Experience building enterprise SaaS applications
• Familiarity with Docker and Kubernetes
• Experience with CI/CD and release orchestration tools (e.g., Octopus Deploy, Azure DevOps Pipelines, Jenkins, GitHub Actions, or similar)
• Experience within financial services, compliance, or regulatory technology
• Experience with AI-powered search, NLP, or automation solutions

Benefits

• Medical and dental coverage
• 401(k) plans
• Wide range of paid time off options
• Flexible work environment
• Designated ACA Paid Holidays
• Summer Fridays
• Personal/Family Care leave
• Student Debt Forgiveness
• Pet Insurance

Schedule

Hybrid work model: 2 days per week in office (Durham, NC or Pittsburgh, PA)