Associate Data Engineer

Primary Responsibilities

• Architect, design, and implement scalable data platforms, pipelines, and ETL/ELT workflows
• Lead end to end data engineering efforts, ensuring reliability, performance, and cost efficient data systems
• Mentor and guide junior and senior data engineers, fostering a culture of technical excellence and collaboration
• Collaborate with cross functional teams (analytics, product, engineering, business) to align data solutions with business goals

Data Engineering & Pipeline Development

• Build, optimize, and maintain robust data pipelines using Python, SQL, and Apache Airflow
• Manage large-scale data ingestion, transformation, and orchestration frameworks
• Optimize database queries, stored procedures, and schema design in MSSQL and other SQL/NoSQL systems

Cloud & Infrastructure

• Develop and manage cloud native data platforms using AWS services (S3, Glue, Lambda, RDS, Redshift, EC2, Step Functions, etc.)
• Ensure high availability, disaster recovery, and monitoring of critical data workflows
• Implement CI/CD, infrastructure as code, and DevOps practices for data engineering workloads

Data Warehousing & Modeling

• Design and enhance enterprise data warehouses and data marts following industry best practices
• Drive dimensional modeling, data partitioning, performance tuning, and metadata management
• Ensure consistency and quality across analytical datasets and data sources

Data Governance & Quality

• Establish data quality frameworks, lineage tracking, validation checks, and documentation
• Implement governance standards including security, compliance, and access controls
• Partner with business stakeholders to define and enforce master data and reference data strategies

Required Qualifications

• Bachelor's degree or equivalent experience
• 4+ years: Data Engineering experience, including 3+ years in a dedicated data engineering role
• 2+ years: Hands-on experience with AWS Cloud for data architecture and pipeline development
• 4+ years: Expertise in MSSQL, including query optimization, indexing strategies, stored procedures, and performance tuning
• 4+ years: Experience using Apache Airflow for workflow orchestration and pipeline scheduling
• 3+ years: Experience working with big data processing frameworks and distributed data systems
• 2+ years: Experience building Machine Learning models, Generative AI solutions, and Multi-Agent Systems (Google ADK preferred)
• 4+ years: Knowledge of data management principles, including governance, data quality, lineage, and security
• 3+ years: Experience translating business requirements into scalable technical data solutions

Pay

The hourly pay for this role will range from $60,200 to $107,400 per hour based on full-time employment. We comply with all minimum wage laws as applicable.