Principal Data Engineer

About the role

This position will be responsible for building scalable, high-performance data pipelines and data-driven predictive analytics applications using automation, artificial intelligence (AI), and machine learning (ML) models to provide actionable recommendations and insights. The role is part of Caterpillar's Legal, Security, and Public Policy team, tackling challenges critical to realizing business value and mitigating high-impact enterprise risks. You will collaborate with data scientists, business analysts, and others to assemble large, complex data sets, automate processes, build models, and deliver insights to key stakeholders.

Responsibilities

• Design, build, and maintain a scalable Snowflake-based data platform supporting analytics, reporting, and AI/ML workloads.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, and re-designing data pipelines for greater scalability.
• Perform debugging, troubleshooting, modification, and testing of integration solutions.
• Operationalize developed jobs, processes, and models.
• Create solutions and methods to monitor systems and solutions.
• Review and optimize code; automate code testing and pipelines.
• Design, develop, and maintain efficient and scalable AI and ML solutions.
• Implement systems and processes to support data governance capabilities.
• Engage with business partners to design and develop data integration/transformation solutions per functional requirements.
• Actively seek industry perspectives through continuous learning and peer groups.

Requirements

• BS in Computer Science, Computer Engineering, Data Engineering, Data Science, or a related field.
• 5+ years of development experience with modern languages and frameworks, preferably Python and SQL.
• Understanding of data structures, algorithms, profiling, and optimization.
• Familiarity with data governance standards, data quality dimensions, and data security.
• Experience managing a Snowflake database/environment, including SQL, ETL/ELT design, data modeling, change data capture, indexing, partitioning, and query optimization.
• Experience building ETL/ELT pipelines using industry platforms (Snowflake, EMR, Glue, Snap Logic, or similar).
• Experience building medallion, data lake, or lakehouse architectures.
• Experience with version control in GitHub and DevOps practices like CI/CD.
• Strong communication, interpersonal, and collaboration skills; ability to explain technical concepts clearly and prioritize cross-functionally.
• Ability to guide and mentor others in coding and design best practices.

What will set you apart

• MS in Computer Science, Computer/Data Engineering, Data Science, or related fields.
• Experience in agent-assisted programming.
• Experience building and deploying machine learning (ML), artificial intelligence (AI), and/or agentic AI solutions in a business context.
• Deep Snowflake expertise, including Cortex, Snowpipe, Snowpark, and Snowsight.
• Deep experience in AWS EMR, Glue, Lambda, or similar.
• Experience with modern agentic AI platforms (Cortex, Bedrock/Agent core, Dataiku, etc.).
• Experience with trade and/or compliance data.
• Experience in PowerBI, Power Apps, Streamlit, or similar visualization and app development tools.

Benefits

• Medical, dental, and vision benefits (subject to plan eligibility, terms, and guidelines).
• Paid time off (vacation, holidays, volunteer time, etc.).
• 401(k) savings plans.
• Health Savings Account (HSA).
• Flexible Spending Accounts (FSAs).
• Health lifestyle programs.
• Employee Assistance Program.
• Voluntary benefits and employee discounts.
• Career development opportunities.
• Incentive bonus.
• Disability benefits.
• Life insurance.
• Parental leave.
• Adoption benefits.
• Tuition reimbursement.

These benefits also apply to part-time employees.

Pay

Pay range: $128,470.00 – $208,770.00. Compensation and benefits may vary depending on job level, market location, job-related knowledge, skills, individual performance, and experience.

Schedule

This position requires working onsite five days a week. Relocation is available for this position.