Software Developer

Responsibilities

• Design, develop, and maintain robust ETL pipelines to extract, transform, and load data from various sources into target systems.
• Optimize data pipelines for performance, scalability, and data quality.
• Create and maintain data models, schemas, and data warehouses to support business intelligence and analytics.
• Implement data quality checks, validation rules, and data governance policies.
• Integrate data from diverse sources, including databases, APIs, and flat files.
• Develop and maintain data mapping rules and transformations.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.
• Provide technical guidance and mentorship to junior developers.
• Participate in code reviews and ensure adherence to coding standards and best practices.
• Effectively communicate technical concepts to both technical and non-technical audiences.
• Stay current with industry trends and best practices in data engineering and data management.
• Troubleshoot and resolve data pipeline issues.
• Affiliate with system testing and validation to ensure data consistency and accuracy.
• Maintain data pipeline performance and identify areas for improvement.

Qualifications

• Proficiency in Linux, Java, Spring Boot, and Python.
• Expertise in Elasticsearch, MongoDB, HBase, Gradle, Avro, Parquet, Git, and relational databases.
• Demonstrated experience with Amazon Web Services (AWS), including S3, RDS, CloudWatch, and EC2.
• Familiarity with Terraform and Splunk for infrastructure management and logging.
• Demonstrated knowledge of NoSQL and relational databases.
• Amazon Web Services DevOps Professional certification or equivalent.
• Active TS/SCI with Polygraph clearance.
• A Master’s degree in Computer Science, Information Systems, Engineering, or specialized experience in a scientific or technical discipline.