Data Engineer
About the role
As a Data Engineer at Absolute Business Solutions Corp (ABSC), you will play a crucial part in designing scalable data pipelines, optimizing Spark workloads, and delivering high-performance cloud solutions in support of our IC customer's Data Modernization Services. This role involves working closely with our sister company, Syntasa, and collaborating with cross-functional teams.
Responsibilities
- Optimize large-scale data pipelines for ingestion, transformation, and processing.
- Develop robust, reusable code in Python and Spark to support distributed data workflows.
- Manage and tune Spark jobs on cloud-based platforms with Kubernetes orchestration.
- Implement scalable data solutions for storage and retrieval.
- Drive reliability, performance, and cost efficiency across cloud infrastructure.
Requirements
- Bachelor’s Degree with at least five years’ relevant experience. Will consider additional years’ experience in lieu of degree.
- Strong Python experience.
- Experience with automation of job monitoring, optimization, and debugging at scale.
- Experience working with any of the major cloud providers.
- Excellent communication skills with the ability to work in cross-functional teams.
Desired Skills
- Apache Spark
- Background in building and maintaining CI/CD pipelines
- Knowledge of Kubernetes and containerization
- Experience building dashboards
- Using notebook-based tools such as Jupyter and Databricks
- Knowledge of Scala, SQL and R
Benefits
Salary is commensurate with experience. Salary range for this requisition is: $150k-$175k annual. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.
Pay
$150k-$175k annual
Schedule
This role is a hybrid role (on-site Syntasa, customer site, and telework) in Herndon, VA; St. Louis, MO; or Aurora, CO.