Senior Data Engineer- US Citizen
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Apache Spark (PySpark and/or Scala)
- Build and optimize data workflows on Databricks, including Delta Lake, notebooks, and scheduled jobs
- Ingest, transform, and curate large-scale structured and semi-structured datasets
- Perform performance tuning and cost optimization of Spark workloads and Databricks clusters
- Implement data quality checks, monitoring, and error handling
- Collaborate with analytics and business stakeholders to deliver well-modeled, analytics-ready data
- Support batch processing and, where applicable, streaming data pipelines
- Follow best practices for testing, documentation, security, and version control
Required Qualifications
- 5+ years of experience in Data Engineering or related roles
- Strong hands-on experience with Apache Spark (PySpark or Scala)
- Proven experience working in Databricks environments
- Strong SQL skills and experience with relational and analytical databases
- Experience building and maintaining ETL/ELT pipelines at scale
- Familiarity with modern data lake architectures (Delta Lake preferred)
- Experience with Git-based version control
Benefits
- Flexible work from home options available
Pay
Depends on experience
Schedule
Hybrid - US
Qualifications
Must be a U.S. Citizen
Skills
Strong hands-on experience with Apache Spark (PySpark or Scala)
Proven experience working in Databricks environments
Strong SQL skills and experience with relational and analytical databases
Experience building and maintaining ETL/ELT pipelines at scale
Familiarity with modern data lake architectures (Delta Lake preferred)
Experience with Git-based version control
Benefits
- Flexible work from home options available
Pay
Depends on experience
Schedule
Hybrid - US
Company Information
Vytwo Technologies is a global leader in enterprise application integration, delivering end-to-end IT consulting and business services for mid to large-scale organizations.
We offer a comprehensive suite of solutions including business and technology consulting, Cloud, e-business and digital transformation services, system integration, custom application development, re-engineering, and long-term application support.
(if you already have a resume on Indeed)
Or apply here.
Career Flexibility & Growth