Senior Data Engineer / Data Curator

Responsibilities

• Design and implement data pipelines for processing, cleaning, and curating large datasets used in model training and fine-tuning.
• Automate data cleaning processes (e.g., removing noise, duplicates, irrelevant content) and ensure datasets are appropriately labeled and structured.
• Collaborate with model teams to ensure data aligns with model requirements and performance goals.
• Assess and mitigate bias in datasets, ensuring that models are trained on diverse and representative data.
• Manage data storage and retrieval strategies, ensuring scalability and data consistency across different environments.
• Conduct regular audits to ensure data integrity, privacy, and security compliance.

Qualifications

• Education: Minimum degree required: Bachelor's degree in Computer Science, Data Science, or a related field.
• Technical Skills:
  • 5+ years of experience in data engineering, data wrangling, or data curation, particularly in machine learning or AI-driven environments.
  • Strong proficiency in Python (Pandas, NumPy) and SQL for data manipulation and querying.
  • Familiarity with cloud-based data storage (AWS S3, Google Cloud Storage, etc.) and distributed systems for managing large datasets.
  • Experience with data annotation tools and platforms for manual or semi-automated labeling.
  • Experience with NLP data formats, such as JSONL, text, or embeddings, and an understanding of tokenization.
  • Experience managing data pipelines with tools like Apache Kafka, Apache Airflow, or similar ETL tools.
  • Strong knowledge of AI ethics, data privacy, and compliance standards (GDPR, CCPA, etc.).
• Bonus: Experience with vector databases and indexing for LLMs (e.g., FAISS, Pinecone).

Interpersonal Skills

• Communication
• Computer proficiency
• Presentation skills
• Listening
• Teamwork

Work Location

5088 W. Innovation Circle, Phoenix, AZ 85083

About the Role

TSMC Arizona’s first fab will operate its leading-edge semiconductor process technology (N4 process), starting production in the first half of 2025. The second fab will utilize its leading edge N3 and N2 process technology and be operational in 2028. The recently announced third fab will manufacture chips using 2nm or even more advanced process technology, with production starting by the end of the decade. America’s leading technology companies are ready to rely on TSMC Arizona for the next generations of chips that will power the digital future.