Member of Technical Staff (Data Intelligence)

Here's the reformatted job posting for the **Member of Engineering (Pre-training / Data Engineering)** role at Poolside:

Job type: Full-time
Location: Remote (EMEA/East Coast)

About the role

We are looking for a Member of Engineering to join our Pre-training / Data Engineering team. This role focuses on building and optimizing the data pipelines and infrastructure that power our large-scale model training.

Responsibilities

• Design, develop, and maintain scalable data pipelines for pre-training datasets.
• Optimize data processing workflows for efficiency and reliability.
• Collaborate with research and engineering teams to improve data quality and model performance.
• Work with distributed systems and cloud infrastructure to handle large-scale data.
• Implement monitoring, logging, and alerting for data pipelines.

Requirements

• Proficiency in Python and experience with data engineering tools.
• Strong experience with Docker and Kubernetes for containerization and orchestration.
• Hands-on experience with cloud platforms (AWS, GCP, or Azure).
• Familiarity with distributed data processing frameworks (e.g., Spark, Dask).
• Experience with workflow orchestration tools like Airflow or similar.
• Knowledge of PyTorch or other deep learning frameworks is a plus.
• Ability to work remotely in the EMEA or East Coast time zones.