Senior Software Engineer

About the role

Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. We are seeking a Senior Software Engineer to join our Development Team in our Data Practice.

Responsibilities

• Design, develop, and maintain scalable data processing solutions across on-premises and cloud environments using Python and Apache Spark on Databricks.
• Optimize and fine-tune Spark jobs for performance, including resource utilization, shuffling, partitioning, and caching, to ensure maximum efficiency in large-scale big data environments.
• Design and implement scalable, fault-tolerant data pipelines with end-to-end monitoring, alerting, and logging.
• Leverage AWS cloud services (2+ years preferred) to build and manage data pipelines and distributed processing workloads.
• Develop and optimize SQL queries across relational and data warehouse systems (RDBMS/Data Warehouse).
• Apply design patterns and best practices for efficient data modeling, partitioning, and distributed system performance.
• Use Git (or equivalent) for source control and maintain strong unit and integration testing practices.
• Collaborate with Product Owners, partners, and cross-functional teams to translate business requirements into technical solutions.
• Demonstrate strong analytical skills with the ability to extract actionable insights from large datasets and support data-driven decision-making.
• Mentor junior engineers, conduct code reviews, and contribute to establishing engineering best practices and standards.

Qualifications

• 5+ years of software development experience in a scalable, distributed, or multi-node environment.
• Proficient in programming with Scala, Python, or Java; comfortable building data-driven solutions at scale, with Databricks preferred.
• Significant experience with Apache Spark and exposure to Hadoop, Hive, and related big data technologies.
• Demonstrated experience with cloud platforms (AWS, preferred) and an interest in cloud migration projects.
• Exposure to modern data tools and frameworks such as Kubernetes, Docker, and MWAA/Airflow.
• Strong problem-solving skills with the ability to own problems end-to-end and deliver results.
• Consultative mindset — comfortable taking initiative, building relationships, communicating broadly, and tackling challenges head-on.
• Collaborative team player with an eagerness to learn from peers and mentors while contributing to a culture of growth.
• Motivated to grow your career within a dynamic, innovative company.