Senior Data Engineer – Databricks & GenAI @ Austin, TX // Warren, MI - W2 ONLY
HYR Global Source Inc · Austin, TX · 1 wk ago
HybridInformation TechnologyContract
About the role
We are looking for a Senior Data Engineer with strong hands-on experience in Databricks, PySpark, Python, and SQL. The candidate will build and maintain data pipelines, organize large amounts of data, and prepare data for AI and Generative AI applications. Candidates must have experience working with Databricks on Azure or GCP, with strong practical knowledge of data engineering and data processing. Interview process: one technical video interview followed by an offer decision.
Responsibilities
- Build and maintain data pipelines using Databricks, PySpark, Python, and SQL.
- Process, clean, and organize data from different sources.
- Work with Delta Lake and Unity Catalog to manage and organize data.
- Build reliable data pipelines with proper testing, monitoring, and data quality checks.
- Prepare data for Machine Learning and Generative AI applications, including embeddings and RAG‑based solutions.
- Work with cloud services, especially Azure data storage and security tools.
- Collaborate with data, application, and AI teams.
- Write technical documentation and participate in code reviews.
Requirements
- Education: Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Experience: Minimum 12 years of total IT experience.
- Work authorization: Any work authorization can apply.
- Location: Must be willing to work onsite 4 days per week in Warren, MI or Austin, TX.
- Duration: 6‑month contract with potential to convert to full‑time hire.
- Strong hands‑on experience with Databricks, PySpark, and SQL.
Skills
Required Skills:
- 5+ years of experience