Data Engineer

Key Responsibilities

• Design, develop, and maintain scalable ETL pipelines using Python, SQL, and Palantir (or similar ETL platforms).
• Extract, transform, and integrate data from a variety of sources, including relational databases, APIs, and flat files.
• Develop data transformation, enrichment, and modeling workflows to support business and analytics requirements.
• Optimize data structures and pipelines for performance, scalability, and maintainability.
• Implement data validation, quality assurance, and monitoring processes to ensure data accuracy and consistency.
• Support the effective use of Palantir tools by providing technical guidance and collaborating across engineering teams.
• Troubleshoot data integration issues and continuously improve data processing workflows.

Required Qualifications

• 3+ years of experience in Data Engineering or a related field.
• Strong proficiency with Python for scripting, automation, and data processing.
• Experience writing and optimizing SQL for querying, transformation, and data analysis.
• Experience integrating data from multiple sources, including APIs, relational databases, and file systems.
• Strong analytical and problem-solving skills with exceptional attention to detail.
• Excellent communication and collaboration skills with the ability to work across technical and business teams.

Preferred Qualifications

• Bachelor's degree in Computer Science, Data Engineering, or a related technical field.
• Hands-on experience with Palantir.
• Experience working with cloud platforms such as AWS, Azure, or GCP.
• Familiarity with big data technologies including Apache Spark and Hadoop.
• Experience with workflow orchestration tools such as Apache Airflow, Prefect, or similar technologies.