Data Engineer

About the Role

We are seeking an experienced Data Engineer with 8-15 years of experience to design, build, and optimize large-scale data solutions. This role is open to independent VISA holders only.

Responsibilities

• Design and build large-scale data pipelines using Python.
• Build and support data ingestion, processing, indexing, and retrieval pipelines for structured and unstructured data.
• Lead the architecture of cloud-native data lakes and warehouses.
• Optimize big data processing jobs for speed and cost.
• Mentor junior data engineers and lead code reviews.
• Set up data governance, data quality, and monitoring systems.
• Partner with data scientists to deploy machine learning models.

Requirements

• Bachelor’s or master’s degree in computer science or a related field.
• 8+ years of experience in data engineering.

Skills

Primary Skills

• Python
• SQL
• Data Ingestion and ETL
• API development and Integration
• MongoDB
• Oracle or Relational Databases
• Elastic or Solr Search
• Vector Database
• Linux/Bash
• OpenShift containers
• Git
• Jenkins
• CI/CD
• Data Modelling

Secondary Skills

• Fast API
• Data Quality and Validation
• Performance Tuning