Data Engineering Team Lead

About the role

We are seeking a highly skilled Data Engineering Team Lead at Smadex, a leading advertising technology company. The position is based in Austin, TX, or New York, NY.

Responsibilities

• Lead and scale two specialized sub-teams (Data Quality and Feature Engineering), managing performance, career development, and hiring.
• Design scalable, highly available data pipelines bridging big data storage and real-time machine learning inference.
• Establish rigorous standards for data observability, implementing automated monitoring and alerting for complex data ingestion services.
• Define and enforce policies for data privacy, security, and lifecycle management, ensuring compliance with relevant regulations and company standards.
• Oversee the development and optimization of high-throughput features using Scala to aggregate data for our Redis Cluster.
• Coordinate with the infrastructure team ensuring the execution of complex data workflows and DAGs using Apache Airflow.
• Maintain operational excellence across our distributed systems, monitoring global deployments and ensuring the stability, reliability, and performance of production systems.
• Partner with the CDO to align technical strategies with business objectives and Machine Learning roadmaps.
• Collaborate closely with the CTO for technical solutions and strategy, and partner with the CPO on product integration and transversal projects.

Requirements

• 6+ years of experience in software or data engineering, with at least 2 years in a formal leadership or management role building high-throughput distributed systems.
• Advanced knowledge of Spark and the ability to conduct deep code reviews.
• Proven track record of designing and optimizing complex batch and streaming pipelines using Apache Spark.
• Advanced SQL knowledge and experience with cloud environments (AWS), particularly EMR, EC2, Athena, and S3.
• Strong ability to debug complex distributed systems and drive root-cause analysis for production issues.
• Excellent communication skills in English, with the ability to translate technical complexity for stakeholders.
• Previous experience in the AdTech industry or working with Real-Time Bidding (RTB) ecosystems, ideally Demand Side Platforms (DSP) side.
• Direct experience building Feature Stores or working closely with Data Science teams on the ML lifecycle.
• Experience with containerization and orchestration (Docker, Kubernetes) at scale.
• Master’s degree in Computer Science, Engineering, or Applied Mathematics.

Skills

• Languages: Python, Scala and Bash.
• Frameworks: Spark.
• Databases: MySQL, Redis.
• Cloud & DevOps: AWS, Jenkins, Docker, Airflow.
• Tools: Git, Jira, Notion.

Benefits

Be part of a leading, fast-growing, innovative company shaping the future of mobile advertising. Join a highly motivated and young team. Possibility of traveling to the Barcelona HQ for collaboration and team-building activities after your first year. Great compensation package tailored to the U.S. market. Medical, dental, and vision benefits plans. Exposure to leading global app publishers and media partners in the digital advertising industry. Learning and training opportunities to grow your career.

Pay

$300,000.00 - $400,000.00 per year

Schedule

This is a Full Time position. Actual schedule and hours may vary.

Supervisory Responsibility

Reports directly to Smadex Chief Data Officer