Data Infrastructure Engineer
Bayside Solutions · Seattle, WA · 1 mo ago
RemoteRemoteEngineering$55–$65/hrContract
Duties and Responsibilities
- Develop and maintain a batch orchestration platform that runs 100,000+ jobs per day
- Create migration tooling to facilitate the transfer of job configurations to a new data platform
- Write efficient, high-performance code in Scala
- Design and implement distributed data systems for high availability, reliability, and performance
- Collaborate with stakeholders and other software engineers to build robust platform features
- Ensure data integrity, governance, and security within the infrastructure
Requirements and Qualifications
- Strong programming skills in Scala
- Deep understanding of data structures, algorithms, and distributed computing principles
- Experienced in API development
- General SQL knowledge
- Experience deploying production applications to Kubernetes
- Experience with relational databases (such as PostgreSQL)
Preferred Qualifications
- In-depth experience with Kubernetes
- Proficiency in Scala
- Strong problem-solving skills with the ability to debug and optimize large-scale distributed systems
- Experience with cloud-based data solutions (AWS)
- Experience with Yarn and Spark jobs
Desired Skills and Experience
- Data Infrastructure Engineering
- Batch Orchestration
- Data Platform Migration
- Scala
- Distributed Systems
- Distributed Computing
- API Development
- Software Engineering
- Data Structures
- Algorithms
- High Availability
- System Reliability
- Performance Optimization
- Large-Scale Job Processing
- Migration Tooling
- SQL
- Kubernetes
- Production Application Deployment
- Relational Databases
- PostgreSQL
- AWS
- Apache Spark
- YARN
- Data Integrity
- Data Governance
- Data Security
- Debugging
- Problem Solving
- Stakeholder Collaboration