Senior Software Engineer - Hadoop Infrastructure

Description

The Team Bloomberg runs on data! It's our business and our product. Financial institutions need timely, accurate data to capture opportunities and evaluate risk in fast-moving markets, from the biggest banks to elite hedge funds. Bloomberg's application teams face complex challenges - large-scale data storage, low-latency retrievals, high-volume requests, and high availability over a distributed computing and storage environment. Hadoop Infrastructure's mission is to provide a multi-tenant, observable, and highly available infrastructure backed by the open-source Apache Hadoop platform (HDFS, HBase, Hive, Oozie, YARN/Spark, etc.) to support large-scale data applications across Bloomberg. The Hadoop Infrastructure team manages clusters that handle 10s of PB of storage spread across 1000s of servers running 100s of billions of requests per day and running 10s of thousands of jobs hitting 100s of thousands of tables every day. We also provide standard methodologies and domain expertise on Hadoop services to applications across various product domains at Bloomberg.

Requirements

• 4+ years of demonstrated experience working with an object-oriented programming language (Java) and associated technologies (eg. Spring/JMX/JDBC)
• A degree in Computer Science, Engineering or similar field of study or equivalent work experience
• 3+ years of experience in the Hadoop ecosystem and related technologies (HBase, Hive 3, HDFS, Spark, Oozie)
• Solid understanding of Linux Operating system, Shell scripting, OS troubleshooting
• Strong problem-solving and communication skills

Qualifications

• Experience working with open-source software/community
• Knowledge of modern development methodologies and tools (Jenkins/Maven/Jira)
• Knowledge of Ansible
• Experience with workflow automation tools like Airflow, Argo, etc.

Skills

• Experience with distributed systems architecture and system design

Benefits

We offer one of the most comprehensive and generous benefits plans available and offer a range of total rewards that may include merit increases, incentive compensation (exempt roles only), paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k) +match, life insurance, and various wellness programs, among others.

Pay

Salary Range = 160,000 - 240,000 USD Annual + Benefits + Bonus