Senior Data Engineer

Senior Data Engineer Beacon Job Description ABOUT BEACON DATA As a full stack data and growth consulting firm, Beacon leverages machine and human intelligence to clients seeking breakthrough performance. Organizations don’t just call us to architect smart data strategy – they call us to implement it. As their expert data partner, our cross-functional team optimizes client data environments, cleans inconsistent data, and operationalizes AI / ML use cases that accelerate growth. At Beacon, impact means more than improving the bottom line: one in four clients are mission-based organizations. BEACON PROJECTS No Beacon project is ever the same; we work across multiple sectors, providing unique learning and development opportunities. Examples include: deduping and stitching together millions of airline customer records to increase FFP membership; decreasing idle rates for a supply chain services company by predicting optimal inventory levels; leveraging data signals to optimize fundraising efforts for the leading children’s hospital charity; architecting and implementing expert data strategy for the largest online theater ticketing company; and using ML to optimize each dial attempt and improve credit cardholder debt collection efforts for a global contact center. What You'll Do Beacon is seeking a talented Senior Data Engineer to join our data team and help solve complex and interesting data-centric problems for our diverse clients. As a Senior Data Engineer, You Will Develop Modern Data Architecture Approaches To Meet Key Business Objectives And Provide End-to-end Data Solutions. No Two Days Will Be The Same, And You Should Anticipate Supporting Multiple Clients And Projects Concurrently In a Fast-paced And Highly Collaborative Environment. You Will Formulate technical roadmaps and technology solutions that address client needs and challenges and support their business strategies and goals.Engage with business partners as a technology consultant and provide technical leadership in an enterprise environment to ensure delivery of exceptional technical solutions.Become a trusted and valued partner of the client C-suite executives and team.Understand business context and transfer that knowledge to solution design, recommended next steps, and approaches around data to support business needs.Provide architectural recommendations, solutions, approaches, inherent tradeoffs, and communicate these concepts clearly to the client.Architect and oversee delivery of large-scale ELT pipelines, cloud data warehouses, and containerized services across client environments, guiding engineers through implementation.Establish infrastructure-as-code standards and oversee their implementation.Set and enforce security standards for client data — access controls, role-based permissions, and data isolation across environments.Maintain strong expertise and knowledge of current and emerging technologies and products.Improve Beacon teams through code review, documentation, technical guidance, and mentoring as a technical data lead. Qualifications Required Experience building large-scale batch and/or streaming data pipelines and data-centric applications in production.Fluency in SQL and Python for building production-grade data systems.Hands-on experience architecting cloud infrastructure — compute, networking, storage, security, and cost considerations.Meaningful experience across multiple database technologies — relational, cloud MPP warehouses, and NoSQL — including migrating workloads from legacy or on-prem systems to cloud platforms.Experience building data extraction and integration workflows across diverse sources — REST and GraphQL APIs, webhooks, flat files, and vendor systems.Experience delivering machine learning solutions — data pipelines for model training, model deployment, and production operations (MLOps).Ability to advise clients on AI strategy — identifying high-value AI/ML use cases and translating them into data architecture and delivery plans.Experience shaping enterprise data strategy — data governance, data quality, and stewardship across the data lifecycle.Deep working knowledge of data security and privacy practices — RBAC, row/column-level security, data masking, PII handling, and encryption, with familiarity with regulations such as GDPR, HIPAA, and CCPA.Comfortable leading technical delivery teams, with the ability to dive into code when needed — and a track record of delivering data engineering solutions across multiple industries and organizations. Tools & technologies we work with Cloud platforms: AWS, Azure, GCP.Data platforms and warehouses: Snowflake, Databricks, Redshift, BigQuery, Microsoft Fabric.Databases: PostgreSQL, MySQL, SQL Server, Oracle, DynamoDB or similar.Pipeline and orchestration tools: dbt, Airflow, Fivetran, Spark.Streaming and messaging: Kafka, Kinesis, or similar.ML platforms: SageMaker, Azure ML, or similar.Containerization: Docker, Kubernetes, AWS ECS/Fargate.Infrastructure as code: Terraform, Ansible, CloudFormation.BI and reporting tools: Power BI, Tableau, Looker, or similar. Requirements Need to be eligible to work in the USA.Willing to commute periodically to client work sites. Who You'll Work With You will work with the Beacon technical team daily, and with client representatives as needed. In some projects, you may spend 2-3 weeks with a new client on a deep technical review or helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you may act as the architect, leading the design of technical solutions, or overseeing a program from inception to building a new product. It may also be a delivery project where you're equally happy coding and tech-leading the team to implement the solution. Anticipate a dynamic environment with active cross-team communication and collaborative problem solving focused on building tools for improving client effectiveness with data. Who You Are You are a highly collaborative individual who can lay aside your own agenda, listen to and learn from colleagues, thoughtfully challenge and prioritize impact. You search for ways to improve outcomes and work collaboratively with colleagues. You believe in iterative change, experimenting with new approaches, learning, and improving to move forward quickly. You also like to have fun and value authenticity. As an equal opportunity employer, Beacon Data encourages applications from all backgrounds regardless of gender, race, disability, pregnancy, marital status, age, sexual orientation, gender reassignment, religion, or belief. We maintain a sense of community rooted in respect and consideration for all employees where any evaluation is based simply upon individual work and team performance.