Java/Spark Developer

Responsibilities

• Design, develop, optimize, and maintain scalable data pipelines for processing and analyzing large scale financial data built on Core Java and Apache Spark.
• Lead projects for developing batch pipeline processes for credit risk analytics including, but not limited to, stress loss (GSST, CCAR) and expected credit loss (CECL, IFRS9, ICAAP).
• Ensure the efficient storage and retrieval of all risk data in our big data platform systems (Hadoop, Hive, Impala, Spark, etc.).
• Implement best practices for Spark performance tuning including, but not limited to, partitioning, caching, and memory management.
• Maintain code quality through high-efficiency testing, CI/CD pipelines (Tekton, Harness), and version control (GitHub).

Requirements

• Minimum 7 years of experience in software development, specifically Core Java & Java 8 concepts (OOP, OOD, Collections, Exception Handling, JDBC, Multithreading, Streams, Lambda Expressions, Functional Interfaces, etc.).
• Minimum 5 years of experience in SQL/NoSQL database management systems (Oracle, MySQL, Postgres, MongoDB, Couchbase, Neo4j).
• Minimum 3 years of experience leading/owning software development projects from beginning to end with multiple team members.
• Minimum 2 years of experience in Apache Spark (Java API) with good knowledge of Apache Spark concepts (RDD, DataFrame, Dataset, etc.).
• Experience working in financial market and credit risk enterprise software systems including, but not limited to, scenario analysis and stress testing.
• Experience with GitHub, Tekton, Harness, and other CI/CD pipeline technologies.
• Ability to work in a fast-paced TechFin environment.
• Experience with agentic AI tools (Devin, Claude, or Copilot).