Data Engineer

Location: USA

About Us

Datavail is a leading provider of data management, application development, analytics, and cloud services, with more than 1,000 professionals helping clients build and manage applications and data via a world-class tech-enabled delivery platform and software solutions across all leading technologies. For more than 17 years, Datavail has worked with thousands of companies spanning different industries and sizes. Datavail is an AWS Advanced Tier Consulting Partner, a Microsoft Solutions Partner for Data & AI and Digital & App Innovation (Azure), an Oracle Partner, and a MySQL Partner.

About The Team

Datavail’s Data Management and Analytics practice is made up of experts who provide a variety of data services including initial consulting and development, designing and building complete data systems, as well as ongoing support and management of database, data warehouse, data lake, data integration, and virtualization and reporting environments. The team consists of experienced, knowledgeable, and certified BI & analytics consultants. We ascertain your business objectives, goals, and requirements, assess your environment, and recommend the tools that best fit your unique situation. Our proven methodology ensures project success at any stage, combining a robust delivery model with top-notch expertise.

Responsibilities

• Design, implement, and manage Databricks solutions for enterprise data warehouses and lakehouse platforms.
• Integrate data platforms with applications using APIs, services, or event-driven patterns.
• Apply deep knowledge of data modeling, data warehousing, and lakehouse patterns.
• Implement Unity Catalog, data governance, and enterprise security controls.
• Develop and maintain CI/CD pipelines and DevOps practices for Databricks workloads.
• Engage with technical and business stakeholders to gather requirements, design solutions, and communicate effectively.
• Work in client-facing or consulting environments, delivering Databricks solutions from discovery to execution.

Requirements

• 5–7+ years of IT experience, with 8–12+ years in data engineering or architecture.
• 4–5+ years delivering Databricks solutions in a consulting or client-facing role.
• Deep hands-on experience with the Databricks Lakehouse Platform and Apache Spark.
• Strong proficiency in PySpark, SQL, Delta Lake, and Databricks SQL.
• Experience with cloud platforms: Azure Databricks, AWS Databricks, or GCP Databricks.
• Solid understanding of cloud architecture concepts (security, networking, scalability, cost management).
• Familiarity with CI/CD, DevOps, and automation for Databricks workloads.
• Bachelor’s Degree in Computer Science, Information Technology, Engineering, Business, or a related field.
• 4+ years of experience in cloud/infrastructure technologies, IT consulting, systems administration, or software development.
• Proven experience in requirements discovery, solution design, and executive communication.

Nice to Have

• Experience with Fabric, Snowflake, Synapse, or BigQuery.