Data Engineering Team Lead/Manager
Quanta Search · New York, NY · 13 mo ago
Information TechnologyFull-time
Responsibilities
- Lead data engineering team
- Partner with business stakeholders and teams to develop data pipelines
- Drive digital innovation: work with teams across the business to generate innovative solutions for services and processes
- Partner with broader technology organization to rationalize data flows, application connectivity and smooth integration with various systems
- Ensure transparency and accountability of teams and vendors in delivering new systems and capabilities
- Ensure sustainable operations and ongoing monitoring/alerting of environment
Requirements
- 8-10 years' experience in developing technology solutions, with an emphasis on data-intensive applications, market data and reference data
- Significant experience in technology project management including collaborative business partnerships, cross functional leadership/influence, vendor management and issue resolution
- Supervisory and team management experience
- Strong system design skills
- Experience with hands-on development in one of the major languages (Java, C#, Python)
- Experience with at least one of the mainstream relational databases (SQL Server, Oracle, Postgres, MySQL or Sybase) and advanced knowledge of SQL
- Experience with ETL processing and concepts of dataflow programming
- Strong knowledge in micro services architecture: Open specifications: Swagger/OpenAPI/OpenTracing, Security: Kerberos/OAuth, Observability: ELK, Zipkin
- Knowledge of modern technology stacks (AWS/GCP), including build and automation, containers, messaging and cloud managed services