Data Engineer for a Hedgefund
Quanta Search · New York, NY · 13 mo ago
Information TechnologyFull-time
Mandatory Skills
- 8+ years solid server-side development
- Solid Java/JEE knowledge (Core Java, Multithreading, JDBC, JMS, Web Services)
- Frameworks/Tools (Spring Boot/Spring/Hibernate/Maven/JUnit)
- Data structures/algorithms
- Experience with at least one of the mainstream relational databases (SQL Server, Oracle, Postgres, MySQL or Sybase) and advanced knowledge of SQL
- Experience with Big Data technologies and Hadoop ecosystem (MapReduce, Hive, Hbase)
- Familiarity with at least one NoSQL database (MongoDB, Redis)
- Familiarity with distributed processing frameworks such as Spark/Flink/Apex
- Strong Linux (or Unix) knowledge and at least basic ability to do bash scripting
- Familiarity with Service-oriented architectures – Microservices in particular
- Experience with ETL processing and concepts of dataflow programming
- Experience with version control systems (Git/SVN)
- Understanding of messaging, concurrent programming and highly distributed software
- Experience with AWS or one of the mainstream public cloud providers (GCP, Azure)
Nice To Have Skills
- Knowledge of Python and related frameworks
- Basic understanding of containerization technology and Kubernetes in particular
- Familiarity with Elastic Search stack (former ELK)
- Familiarity with Kafka