Data Engineer

Department: Engineering • Location: New York • Hybrid schedule (3 days on-site, 2 days remote)

About the role

We are looking for a Data Engineer with strong Microsoft SQL Server and Snowflake experience to join our Data & Analytics engineering team. This role is ideal for an engineer who enjoys working with large-scale data, complex SQL, data pipelines, and production systems and wants to play a key role in modernizing a large SQL Server-based data platform to Snowflake and AWS. You will work across both our existing SQL Server environment and our modern cloud data platform, developing new capabilities while helping migrate and optimize existing data processing.

Tech stack

• Languages: SQL, Python, C#; scripting experience
• Databases: Microsoft SQL Server, Snowflake
• Data Engineering: ETL/ELT, Apache Airflow, data pipelines
• Cloud: AWS, including S3 and other AWS data services
• Development: Git, CI/CD, Liquibase, automated testing and deployment
• Data domains: Market data, trade data, transaction cost analysis, and financial data

Responsibilities

• Develop, maintain, and optimize complex SQL Server queries, stored procedures, functions, views, and data processing workflows.
• Design and develop scalable Snowflake data solutions, including data models, SQL transformations, loading processes, and analytical workloads.
• Participate in the migration of large volumes of data and processing from SQL Server to Snowflake.
• Analyze existing SQL Server logic and translate or redesign it for Snowflake where appropriate.
• Build and maintain ETL/ELT pipelines using SQL, Python, and workflow orchestration tools such as Apache Airflow.
• Develop data ingestion and processing workflows using AWS, including S3.
• Perform SQL Server and Snowflake performance tuning, including query optimization, execution plans, indexing, statistics, warehouse sizing, and workload optimization.
• Build data validation and reconciliation processes to ensure migrated and transformed data is accurate and complete.
• Troubleshoot production data issues, identify root causes, and implement reliable long-term solutions.
• Implement monitoring, logging, alerting, and operational controls for critical data pipelines.
• Collaborate with software engineers, service managers and implementation team, product teams, and DevOps.
• Support and enhance existing Transaction Cost Analysis (TCA) products and develop new functionality.
• Work with large-scale trade, market, benchmark, and financial data.

Qualifications

Essential

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.
• Hands-on experience with Snowflake and AWS Cloud services (particularly S3 and data services).
• Strong hands-on SQL development experience.
• Python & C# scripting experience.
• Strong experience with Microsoft SQL Server, including complex queries, stored procedures, performance tuning, and troubleshooting.
• Experience working with large datasets and production data systems.
• Strong analytical and problem-solving skills.

Desirable

• Experience migrating SQL Server workloads to Snowflake or another cloud data platform.
• Experience with Apache Airflow or similar orchestration technologies.
• Experience with Git, CI/CD, Liquibase and automated deployment processes.
• Experience with data quality, reconciliation, and data governance.
• Knowledge of capital markets, trading, market data, or financial systems.
• Experience with Transaction Cost Analysis (TCA) or other financial analytics.
• Snowflake or AWS certification.

AI-assisted development

We encourage engineers to use modern AI-assisted development tools, such as Claude Code to accelerate development, debugging, testing, refactoring, and migration work. Candidates should understand how to use AI effectively while independently validating generated code for correctness, security, performance, and maintainability.

Benefits

• Health & Financial Security: Medical, Dental, and Vision insurance; Flexible Spending Accounts (FSA) & Health Savings Accounts (HSA); 401(k) retirement plan; Pre-tax transit and parking benefits.
• Time Off & Flexibility: 22 days of Paid Time Off (PTO) per year with option to roll over unused days; one dedicated volunteering day per year; two professional development days per year; additional PTO day during milestone anniversary years; robust paid holiday schedule with early dismissal; generous parental leave for all parents (including adoptive parents). Hybrid model: three days in-office collaboration per week, two days remote.
• Work-Life Support & Resources: Budget for tech accessories (monitors, headphones, keyboards, office equipment); backup child and pet care, tutoring services; milestone anniversary bonuses.
• Wellness & Lifestyle Perks: Stipend and subsidy contributions toward personally-owned cell phones; contributions for gym memberships and health/wellness initiatives; discounted healthcare premiums; healthy meal delivery program subsidies.

Compensation

$94,500 – $115,000 per year

Schedule

Hybrid: three days per week in the New York office, two days remote.