Data Engineer
Responsibilities
- Design, build, and maintain scalable ETL/ELT pipelines and datasets in Databricks using Python, Spark, and SQL.
- Develop and support batch and streaming data architectures for reporting, analytics, and AI/ML workloads.
- Troubleshoot and optimize Databricks and existing data integration processes for performance, reliability, and data latency.
- Support and enhance existing SQL Server, SSIS, and SSRS solutions while contributing to ongoing platform modernization.
- Implement data quality checks, validation, cleansing, and data warehousing best practices across data pipelines and reporting environments.
- Integrate Databricks with enterprise applications, databases, and other data sources.
- Partner with business users, analysts, and IT teams to translate reporting and data needs into scalable technical solutions.
- Contribute to continuous improvement through emerging data engineering practices, AI-assisted development tools, documentation, and ongoing learning.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, or a related field.
- Strong hands-on experience with Databricks, including Python, Spark, and Delta Lake.
- Strong SQL Server and data warehousing experience, including T-SQL.
- Experience with SSIS and SSRS.
- Experience with Microsoft Azure; Microsoft Fabric is a plus.
- Experience using AI-assisted development tools as part of the engineering workflow.
- Strong analytical, problem-solving, communication, and collaboration skills.
About the Role
VAS, a URUS Group company, is seeking a Data Engineer to design, build, and improve data solutions supporting the global business. The role involves working with Databricks, developing pipelines, and enhancing existing data integration processes. The ideal candidate should have a strong background in data engineering, hands-on experience with Databricks, and proficiency in SQL Server and data warehousing.
About Us
We are VAS, a URUS Group company dedicated to supporting the agricultural sector since 1980. Our mission is to provide innovative farm management solutions and information systems to help producers make informed decisions. We operate through multiple brands in 17 countries, employing over 2,800 people globally. URUS, our parent company, comprises various businesses focused on dairy and beef genetics, reproductive services, and management information systems.