Staff Data Engineer-AI Platform

About the Role

As a Staff Data Engineer, you'll lead, coach, and mentor engineers and teams while providing technical direction and support. You'll collaborate with Product, Data Science, Application, and Analytics teams to understand data and infrastructure needs, resolve technical issues, and ensure optimal data design and efficiency.

Responsibilities

• Lead the design and development of data integrations supporting application engineering and system integration.
• Design, develop, and maintain large-scale data pipelines, including diagnosing and solving complex production issues.
• Provide expertise in designing algorithms for large/complex datasets, implementing calculations, cleansing data, and ensuring standardization.
• Map and link data from multiple sources to enable analytics and new capabilities.
• Lead engineers across one or more squads to deliver initiatives and mentor junior data engineers.
• Build and support complex data pipelines, APIs, data integrations, streaming solutions, and predictive model implementations.
• Identify and integrate complex data from upstream sources.
• Design and build large-scale batch and real-time data pipelines using big data processing frameworks.
• Architect monitoring capabilities based on business SLAs and data quality requirements.
• Maintain and streamline existing data pipelines end-to-end.
• Perform full SDLC processes, including planning, design, development, certification, implementation, and support for complex projects.
• Establish team operational plans, develop new processes, standards, and technical roadmaps.
• Recommend improvements for data platforms, workflows, architecture, security, scalability, reliability, and performance.
• Propose changes to processes and tools at the group/department level based on industry standards.
• Test technical solutions to ensure data integrity and system functionality.
• Design scalable, efficient data models for integration, storage, and retrieval across complex systems.
• Develop and implement a data quality framework for accuracy, consistency, and completeness.
• Collaborate with Product, Business, and Analyst stakeholders to confirm data quality, discuss requirements, and support testing.
• Create team documentation and training related to technology stacks and standards.
• Diagnose and troubleshoot complex issues independently.
• Perform data validation and quality assurance for your work and that of junior engineers.
• Collaborate with external technical teams to ensure timely, high-quality solutions.
• Engage with shared services teams and vendors as needed.
• Influence technical decision-making and technology adoption in your domain.
• Apply knowledge of machine learning concepts where applicable.

Requirements

• Extensive experience in data engineering, including leadership roles.
• Experience working with large-scale infrastructure, large datasets, and mission-critical SLAs.
• Comprehensive knowledge of Lean Startup and Agile development methodologies.
• Familiarity with business intelligence, analytics/reporting, and application integration.
• Understanding of data architectures such as data warehouse, data lake, and data mesh, and when to apply them.
• Expertise in coding standards, design principles, data architecture, and data modeling best practices.

Skills

• Advanced verbal and written communication, including data presentation.
• Strong prioritization and ability to deliver on ambiguous projects with incomplete information.
• Ability to act as a thought leader and mentor to junior team members.
• Willingness to learn new technologies as they emerge.
• Ability to work calmly under pressure and collaborate across multiple locations.
• Team-oriented mindset with a willingness to take feedback from peers and mentors.

Qualifications

• A related degree or comparable formal training, certification, or work experience.

Working Conditions

• Fast-paced environment with extended hours and prolonged sitting.
• Flexible schedule as needed to meet business demands.
• Reasonable accommodations may be made for individuals with disabilities.