Senior Java Spark Developer - Credit Risk & Big Data (Financial Services)
Job Description
Design, develop, optimize, and maintain scalable data pipelines for processing and analyzing large-scale financial data built on Core Java and Apache Spark.
Lead projects for developing batch pipeline processes for credit risk analytics, including but not limited to stress loss (GSST, CCAR) and expected credit loss (CECL, IFRS9, ICAAP).
Ensure the efficient storage and retrieval of all risk data in big data platform systems (Hadoop, Hive, Impala, Spark, etc.).
Implement best practices for Spark performance tuning, including but not limited to partitioning, caching, and memory management.
Maintain code quality through high-efficiency testing, CI/CD pipelines (Tekton, Harness), and version control (GitHub).
Required Qualifications/Skills/Experience
- 7+ years of experience in software development, specifically Core Java & Java 8 concepts (OOP, OOD, Collections, Exception Handling, JDBC, Multithreading, Streams, Lambda Expressions, Functional Interfaces, etc.).
- 5+ years of experience in SQL/NoSQL database management systems (Oracle, MySQL, Postgres, MongoDB, Couchbase, Neo4j).
- 3+ years of experience leading/owning software development projects from beginning to end with multiple team members.
- 2+ years of experience in Apache Spark (Java API) with good knowledge of Apache Spark concepts (RDD, DataFrame, Dataset, etc.).
- Experience working in financial markets and credit risk enterprise software systems, including but not limited to scenario analysis and stress testing.
- Experience with GitHub, Tekton, Harness, and other CI/CD pipeline technologies.
- Ability to work in a fast-paced Technology Finance environment.
Preferred Qualifications/Skills/Experience
- Experience with agentic AI tools (Devin, Claude, or Copilot).
Overview
Seeking a Core Java and Apache Spark Engineer with expertise in big data processing, particularly within the Technology Finance industry. Candidate should have experience working with financial enterprise technologies and large-scale distributed computing systems. This role involves developing and optimizing data pipelines for credit risk calculations and regulatory reporting.
Job Duties
Design, develop, optimize, and maintain scalable data pipelines for processing and analyzing large-scale financial data built on Core Java and Apache Spark.
Lead projects for developing batch pipeline processes for credit risk analytics, including but not limited to stress loss (GSST, CCAR) and expected credit loss (CECL, IFRS9, ICAAP).
Ensure the efficient storage and retrieval of all risk data in big data platform systems (Hadoop, Hive, Impala, Spark, etc.).
Implement best practices for Spark performance tuning, including but not limited to partitioning, caching, and memory management.
Maintain code quality through high-efficiency testing, CI/CD pipelines (Tekton, Harness), and version control (GitHub).
Benefits
For information and details on employment benefits offered with this position, please visit here.
If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department via our secure website.
California Pay Equity For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.
Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.