Senior GCP Data Engineer
RXO, Inc. · Chicago, IL · 2 wk ago
Information Technology$130k/yrFull-time
About the role
RXO is a leading provider of transportation solutions. This role is fully onsite at our Chicago, IL office.
Responsibilities
- Design and build large-scale automated and cost-efficient data pipelines that are integrated across multi-platform and disparate data sources using GCP native services (e.g., BigQuery, Dataflow, Dataproc)
- Make key architectural decisions related to data modeling, storage, real-time processing and orchestration
- Work with multi-statement complex queries and enhance performance or troubleshoot issues related to performance
- Implement scalable, reusable and efficient data frameworks that ensure data quality, data integrity and performance consistently
- Create and maintain intermediate to advanced Terraform scripts
- Mentor junior and mid-level engineers, conduct code reviews and provide technical guidance on best practices
- Translate business requirements into technical design documents and implementation plans
- Participate in support rotation and proactively identify issues while implementing issue resolutions as appropriate
- Monitor and optimize GCP resources to manage costs effectively
- Stay updated with latest GCP services and features
- Evaluate and recommend new tools and technologies to improve data engineering practices
Requirements
- Bachelor of Science in Information Technology, Computer Science or a related technical field or equivalent related work or military experience
- 7 years of experience as a data engineer or comparable business intelligence role
- 5 years of experience with Datalake architecture and implementation
- 5 years of experience with relational databases such as MS-SQL, Postgres or Oracle
- 4 years of experience with NoSQL databases such as Capella or MongoDB
- 10+ years of Python experience or similar
- Proficiency with Cloud offerings primarily with GCP (Azure or AWS is acceptable)
Qualifications
- 1 year of logistics or transportation experience
- A Professional Data Engineer certification with Google Cloud
Skills
- Experience with GCP services (BigQuery, Dataflow, Dataproc)
- Experience with relational databases (MS-SQL, Postgres, Oracle)
- Experience with NoSQL databases (Capella, MongoDB)
- Python experience
- Experience with Terraform
- Experience with data modeling and architecture
- Experience with data governance and quality practices
- Experience with cloud-based solutions
Benefits
Competitive pay, paid time off, diversity days, 401(k) retirement plan with company match, insurance benefits, EAP, tuition reimbursement, adoption assistance, tax-advantaged accounts, and more.