Data Engineer

Associated Wholesale Grocers · Kansas City, KS · 4 mo ago

HybridInformation Technology$12.1/hrFull-time

Troubleshoot and develop solutions to problems, including using AWG approved AI tools such as Gemini, CoPilot and NotebookLM.
Collaborate with other developers and support engineers to resolve production, enhancement or development issues.
Participate in an on-call rotation for integration and transformation pipelines, legacy systems, and modern data platforms that may involve occasional off-hours and weekend support.
Maintain documentation for legacy systems, jobs, modern pipelines, and modernization implementation.
Understand and implement change control procedures (including RFC, CAB, CI/CD).
Deliver Solutions

Build real-time and batch data integrations from disparate source systems into the data lake/data warehouse/delta lake.
Build and maintain scalable ETL processes using workflow automation tools.
Provide documentation (including Technical Design Documents) for installations and deliverables.
Design dimensional models and be able to cleanse and transform raw data into structured formats.
Administer and maintain data pipelines used for loading data into the data warehouse or lakehouse.
Scale and tune data pipelines, data sets, and SQL queries.
Responsible for Unit testing, support of Integration testing, and User Acceptance Testing.

Develops timely and proper change documentation.
Proactively communicates status to key stakeholders to diagnose and ensure delivery is on track.
Takes ownership of assignments.
Proactively drives results and seeks support when hitting barriers.
Exhibits curiosity to understand how changes fit into the overall scope.

Responsible for understanding and adoption of IT Architecture practice.
Continuous learning of existing and future data technologies and tools.
Apply standard methodologies to analyze, design, develop, test, and deploy data management solutions.
Participate in agile story authoring, sizing, and demo sessions for developed features.
Participate in code reviews and receive feedback from the team.
Propose process improvements for continuous department maturity.

Collaborate with business partners to understand their business problems or needs and desired outcomes.
In collaboration with other members of the team and user community, configure cloud-based capabilities that enable the AWG community.
Communicate priorities to the technology organization to drive effective business solutions.

Experience: 1-3 years of data engineering or related experience (Associate Analyst level).
Basic understanding of data modelling, mapping and data quality/governance practices.
Education: Bachelor’s degree in software engineering, computer science, computer information systems, or related degree, or equivalent professional experience.
SQL Skills: Must be able to read/write SQL in the following environments (SQL Server, Oracle, DB2).
Cloud Experience: Experience working in cloud data environments (AWS, Azure).
Experience working with AWS or Azure workflow orchestration tools.
Data Systems: Experience working with one or more columnar storage systems (Snowflake, Redshift, BigQuery, etc.).
Process: Must have completed at least one full cycle of building a data lake and/or a data warehouse.
Analytical Skills: Knowledge and skills with Power BI will be important, not critical.
Soft Skills: Strong business communications skills for requirements gathering and development. Ability to multi-task and change priorities.

Worked with or built Data Lakes, Data Warehouse in a hybrid environment (cloud / on-premises).
Experience working with CRM systems like Salesforce.
Experience with end-to-end supply chain or merchandising.
Exposure to data streaming tools and technologies like Kafka, TensorFlow or similar.
Basic knowledge and understanding of statistics and awareness of data science methodologies.

Similar jobs