Data Engineer

Role Description

UST is seeking a Data Engineer with Spark & Streaming skills to build real-time, scalable data pipelines using tools like Spark, Kafka, and cloud services (GCP) to ingest, transform, and deliver data for analytics and ML.

Opportunity

• Design, develop, and maintain ETL/ELT data pipelines for batch and real-time data ingestion, transformation, and loading using Spark (PySpark/Scala) and streaming technologies (Kafka, Flink).
• Build and optimize scalable data architectures, including data lakes, data warehouses (BigQuery), and streaming platforms.
• Perform performance tuning on Spark jobs, SQL queries, and data processing workflows for speed, efficiency, and cost-effectiveness.
• Implement data quality checks, monitoring, and ingestion systems to ensure data accuracy and consistency.

What You Need

• Programming: Strong proficiency in Python, SQL, and potentially Scala/Java.
• Big Data: Expertise in Apache Spark (Spark SQL, DataFrames, Streaming).
• Streaming: Experience with messaging queues like Apache Kafka, or Pub/Sub.
• Cloud: Familiarity with GCP, Azure data services.
• Databases: Knowledge of data warehousing (Snowflake, Redshift) and NoSQL databases.
• Tools: Experience with Airflow, Databricks, Docker, Kubernetes is a plus.

Experience Level

• Total IT Experience - Minimum 8 years
• GCP - 4 + years of recent GCP experience

Pay & Benefits

• Compensation can differ depending on factors including but not limited to the specific office location, role, skill set, education, and level of experience.
• Full-time, regular employees accrue a minimum of 10 days of paid vacation per year, receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year), 10 paid holidays, and are eligible for paid bereavement leave and jury duty.
• Eligible to participate in the Company’s 401(k) Retirement Plan with employer matching.
• Eligible to participate in the following Company-paid Employee Only benefits: basic life insurance, accidental death and disability insurance, and short- and long-term disability benefits.
• Benefits offerings vary in Puerto Rico.

Company Culture

We believe in building a culture of Humility, Humanity, and Integrity. We foster a people-first, human-centric culture that nurtures diversity, prioritizes sustainable solutions, and keeps our people and clients at the forefront of all decisions.

EEO Statement

UST is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other applicable characteristics protected by law.