Data Engineer

About the role

The New York Post is one of America’s most iconic and recognizable news brands, delivering bold headlines, unforgettable scoops, and sharp commentary since 1801. Today, the New York Post Digital Network reaches over 80 million unique users each month across NYPost.com, PageSix.com, and Decider.com, offering breaking news, sports, entertainment, pop culture, and lifestyle coverage. We’re looking for a hands-on Data Engineer to build and maintain the foundational data services that power analytics, machine learning, and cutting-edge digital experiences for our newsroom and product teams.

Responsibilities

• Design, build, and operate cloud-based data pipelines supporting consumer websites, native mobile apps, and information services.
• Work daily with compute, query, storage, and big-data services (Vertex AI, Lambdas, DynamoDB, Cloud Functions, S3, Kubernetes, Glue, BigQuery) inside AWS and GCP.
• Develop and maintain ETL pipelines for real-time and batch processing of large-scale content and event data.
• Write clean, testable, and maintainable code (Python preferred).
• Collaborate with product, editorial, and data-science teams to deliver infrastructure that meets business needs.
• Monitor, optimize, and improve the reliability, security, and cost efficiency of cloud-based systems.
• Document functional requirements for both technical and non-technical audiences.
• Participate in code reviews, architecture discussions, and agile sprint ceremonies.

Requirements

• MS or BS in computer science or related field.
• 2+ years of professional software engineering experience.
• Proficiency in Python, SQL, and PySpark.
• Working knowledge of common AWS and/or GCP services.
• Experience building and deploying data pipelines (Airflow, Dataflow, Glue, or similar).
• Knowledge of data warehouse technologies (BigQuery, Snowflake, Redshift, etc.).
• Firm grasp of AI tooling, IDEs, Git, JIRA, and agile methodologies.
• Familiarity with web standards and protocols.
• Comfort with code reviews, unit tests, QA/UAT processes, and end-to-end testing frameworks.
• Strong problem-solving skills, attention to detail, and eagerness to learn.
• Proactive approach to problem-solving and ability to manage multiple priorities in a fast-paced environment.

Skills

• Familiarity with content-management systems, media, news, publishing, video technology, or high-traffic consumer-facing industries.
• Exposure to personalization and recommendation systems.
• Comfort with CLI, Linux administration, shell scripting, ssh, and crontabs.
• Hands-on experience with generative-AI models, LLM prompting, and/or machine learning.
• Experience with monitoring, logging, dashboard, and alarming tools (CloudWatch, Datadog, Splunk, etc.).
• Familiarity with REST and GraphQL APIs, authentication/authorization, and API best practices.
• Scaling techniques in cloud environments.
• Troubleshooting and debugging experience with internet services.
• Understanding of CI/CD workflows and containerization (Docker, Kubernetes a plus).

Schedule

Hybrid work model requiring a minimum of 3 days per week in the office (subject to change).

Pay

Base pay range: $100,000 – $115,000. Competitive and flexible compensation based on experience, skills, location, and other relevant factors. Bonus-eligible roles include targets determined by market benchmarks and individual contributions.

Benefits

Comprehensive and competitive benefits package covering health, retirement, wellbeing, and more, along with optional benefits to meet diverse employee needs.