Global AI/ML Engineer Senior Manager
About the role
Boston Consulting Group is seeking a Global IT Software Engineer Senior Manager to lead the development, deployment, and optimization of cutting-edge Generative AI (GenAI) tools and IT solutions. This role involves working closely with cross-functional teams to ensure the successful delivery of innovative and scalable software solutions that support BCG's business objectives.
Responsibilities
Leading the implementation and optimization of GenAI applications and IT tools to enhance productivity and operational efficiency.
Collaborate with Product Owners, Tribe Leaders, and other stakeholders to align technology solutions with business requirements.
Administer and configure AI-powered SaaS tools, ensuring secure deployment and smooth integration across the organization.
Identify opportunities for enhancements to enterprise AI tools, focusing on improving efficiency and user satisfaction.
Support proof-of-concept (POC) projects to explore and validate innovative technologies and solutions.
Continuously assess and optimize software architecture, focusing on scalability, reliability, and alignment with emerging trends.
Document designs, development processes, and best practices to promote knowledge sharing and operational efficiency.
Stay updated on emerging technologies such as LLMs, APIs, and cloud-based solutions, applying these innovations to drive impactful outcomes.
Requirements
A bachelor’s degree in Computer Science, Engineering, or a related field. Advanced degrees are a plus.
6-8 years of professional experience in software development or IT operations, with increasing responsibility.
Proven experience in implementing AI-driven applications and SaaS (multi-tenant) solutions.
Strong technical proficiency in both frontend and backend development (e.g., React, Python, Java, Typescript).
Proven experience with systems design, design patterns, architectural trade-offs, and integration best practices.
Proven experience with automated testing frameworks (e.g. Zypher, Pytest).
Experience with cloud technologies, cloud native application and infrastructure as code (e.g., AWS/Azure/CGP, Kubernetes, Helm, Terraform).
Knowledge of DevOps culture and practices.
Experience And Skills (Nice To Have): Previous experience building a user-facing GenAI/LLM software application, Knowledge of LLM RAG/Agent core concepts and fundamentals, Experience with Neo4J, GraphQL for efficient data querying for APIs, CI/CD tools (e.g. Github Actions, Gitlab CI) for automating deployments, Other AWS Managed Services (RDS, Batch, Lambda, Fargate, Step Functions, SQS/SNS, etc.), FastAPI and NextJS experience (if we’re still using the latter), Websockets, Server-Side Events, Pub/Sub (RabbitMQ, Kafka, etc.).
Qualifications
Leveraging expertise in GenAI, SaaS integrations, cloud technologies, and security to deliver impactful solutions.
Driving the adoption and optimization of SaaS tools and AI-driven applications to meet organizational needs.
Solving technical challenges and developing scalable, innovative solutions.
Applying Change Management disciplines to ensure successful technology rollouts.
Proactively identifying and implementing automation capabilities to reduce manual effort and errors.
Collaborating effectively with diverse stakeholders, including technical teams and business leaders.
Adapting to fast-paced environments and evolving priorities with high energy and autonomy.
Skills
Previous experience with vectors and embeddings (pgvector, chromadb).
Experience with Neo4J, GraphQL for efficient data querying for APIs, CI/CD tools (e.g. Github Actions, Gitlab CI) for automating deployments.
Knowledge of LLM RAG/Agent core concepts and fundamentals.
Experience with AWS Managed Services (RDS, Batch, Lambda, Fargate, Step Functions, SQS/SNS, etc.).
FastAPI and NextJS experience (if we’re still using the latter).
Websockets, Server-Side Events, Pub/Sub (RabbitMQ, Kafka, etc.).
Who You'll Work With
Squad members of a specific squad, led by a Product Owner. Tribe Leaders, Product Owners, and other Chapter Leads to align resources and priorities. Agile Coaches and Scrum Masters to embed Agile practices and principles into daily operations. Cross-functional IT teams to ensure alignment with BCG’s overall IT strategy and architecture.
Additional Info
For US locations only, BCG offers a compensation transparency approach. Total compensation for this role includes base salary, annual discretionary performance bonus, retirement contribution, and a market leading benefits package described below. The base salary range for this role in Boston is $153,000 - $186,300. This is an estimated range, however, specific base salaries within the range depend on various factors such as experience and skill set. It is not common for new BCG employees to be hired at the high-end of the salary range. BCG regularly reviews its ranges to ensure market competitiveness. In addition to your base salary, your total compensation will include a bonus of up to 20% and a generous retirement contribution that starts at 5% and moves to 10% after 2 years. All Of Our Plans Provide Best In Class Coverage Zero dollar ($0) health insurance premiums for BCG employees, spouses, and children Low $10 (USD) copays for trips to the doctor, urgent care visits and prescriptions for generic drugs Dental coverage, including up to $5,000 in orthodontia benefits Vision insurance with coverage for both glasses and contact lenses annually Reimbursement for gym memberships and other fitness activities Fully vested Profit Sharing Retirement Fund contributions made annually, whether you contribute or not, plus the option for employees to make personal contributions to a 401(k) plan Paid Parental Leave and other family benefits such as elective egg freezing, surrogacy, and adoption reimbursement Generous paid time off including 12 holidays per year, an annual office closure between Christmas and New Years, and 15 vacation days per year (earned at 1.25 days per month) Paid sick time on an as needed basis
Who You'll Work With
Squad members of a specific squad, led by a Product Owner. Tribe Leaders, Product Owners, and other Chapter Leads to align resources and priorities. Agile Coaches and Scrum Masters to embed Agile practices and principles into daily operations. Cross-functional IT teams to ensure alignment with BCG’s overall IT strategy and architecture.
Additional Info
For US locations only, BCG offers a compensation transparency approach. Total compensation for this role includes base salary, annual discretionary performance bonus, retirement contribution, and a market leading benefits package described below. The base salary range for this role in Boston is $153,000 - $186,300. This is an estimated range, however, specific base salaries within the range depend on various factors such as experience and skill set. It is not common for new BCG employees to be hired at the high-end of the salary range. BCG regularly reviews its ranges to ensure market competitiveness. In addition to your base salary, your total compensation will include a bonus of up to 20% and a generous retirement contribution that starts at 5% and moves to 10% after 2 years. All Of Our Plans Provide Best In Class Coverage Zero dollar ($0) health insurance premiums for BCG employees, spouses, and children Low $10 (USD) copays for trips to the doctor, urgent care visits and prescriptions for generic drugs Dental coverage, including up to $5,000 in orthodontia benefits Vision insurance with coverage for both glasses and contact lenses annually Reimbursement for gym memberships and other fitness activities Fully vested Profit Sharing Retirement Fund contributions made annually, whether you contribute or not, plus the option for employees to make personal contributions to a 401(k) plan Paid Parental Leave and other family benefits such as elective egg freezing, surrogacy, and adoption reimbursement Generous paid time off including 12 holidays per year, an annual office closure between Christmas and New Years, and 15 vacation days per year (earned at 1.25 days per month) Paid sick time on an as needed basis