Senior Developer

About the role

Bachelor’s or master’s degree in computer science or related field.

Primary Skills

• Data Engineering
• Platform Engineering
• Architecture roles

Required Hard and Soft Skills / Experience

• Deep expertise in PySpark, including performance tuning and optimization
• Strong Python development experience in large-scale distributed environments
• Solid knowledge of the Hadoop ecosystem (HDFS, Hive/Impala, YARN)
• Proven experience designing and governing enterprise, regulatory-facing data platforms
• Expertise in designing data lakes, ELT/ETL pipelines, and batch and real-time data processing solutions
• Proficiency in programming languages such as Java, Scala, and SQL
• Strong understanding of non-functional requirements and production support models
• Clear written and verbal communication skills with ability to influence across organizations

Preferred Skills / Experience

• Financial services experience, particularly in Market Surveillance, AML, Fraud, or Risk Technology
• Technology experience supporting regulatory or audit-facing platforms
• Kafka and Spark Structured Streaming exposure
• Familiarity with orchestration tools (Airflow, Control-M, Oozie)
• Knowledge of data governance, lineage, and data quality controls

Responsibilities

• Enterprise & Surveillance Architecture:
  • Define target state architecture and strategic roadmap for surveillance data processing platforms leveraging Hadoop, Spark, PySpark, and Python
  • Establish standard architectural patterns for alert generation, enrichment, aggregation, and reporting pipelines
  • Ensure architecture aligns with enterprise technology standards and Surveillance control expectations
• Solution Design and Delivery Support:
  • Translate surveillance business requirements (e.g., market misconduct detection, regulatory coverage) into scalable technical designs
  • Review and approve detailed technical designs, ensuring alignment with functional intent, regulatory requirements, and architectural standards
  • Provide hands-on architectural guidance to engineering teams during development, testing, and implementation
  • Design and standardization of Spark/PySpark frameworks supporting surveillance alert generation and enrichment
  • Modernization and optimization of large-scale Hadoop surveillance workloads to improve performance, stability, and control coverage
  • Implementation of enterprise-consistent architecture patterns enabling audit readiness, lineage, and regulatory traceability
  • Support end-to-end delivery across the SDLC, minimizing rework and technical debt
• Architecture Governance & Leadership:
  • Participate in and lead architecture review forums and design walkthroughs
  • Mentor senior engineers and promote adoption of standard frameworks and best practices
  • Influence enterprise surveillance platform strategy through architecture governance
• Documentation & Communication:
  • Maintain high-quality documentation, including business requirements, data definitions, and process flows
  • Proactively communicate risks, dependencies, and potential timeline impacts to stakeholders
• Non-Functional Requirement and Product Readiness:

Pay

$110,000–$120,000 a year

Benefits

• Discretionary Annual Incentive
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans
• Family Support: Maternal & Parental Leaves
• Insurance Options: Auto & Home Insurance, Identity Theft Protection
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement
• Time Off: Vacation, Sick Leave & Holidays
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing