Senior/Staff/Principal Backend Engineer, Platform & Data Ingestion
Job Summary
We are seeking a Senior/Staff/Principal Backend Engineer to join our Platform & Data Ingestion team at Verana Health. As part of the Oncology Platform, you will build and optimize data ingestion pipelines, index and query OpenSearch clusters, and implement complex OCR processing workflows.
About the Role
This role is critical to scaling our clinical platforms and advancing oncology care. It involves working closely with the Core Engineering and Data Ingestion teams to ensure efficient data processing and integration into our core oncology platform architecture.
Responsibilities
- Build and optimize resilient data ingestion pipelines that process high volume streams of clinical data and integrate them into our core oncology platform architecture.
- Own the indexing, querying, and performance tuning of our OpenSearch cluster to ensure fast text and data discovery across our oncology data layers.
- Implement and refine complex OCR (Optical Character Recognition) processing workflows to transform raw, unstructured patient timelines into clean, structured data.
- Expand our core oncology data model by maintaining and enhancing microservices that run automated, medically defined quality checks.
- Use AI tools to automate routine setup and boilerplate, keeping your day-to-day focus on building robust, high-impact backend systems.
- Design and implement impactful ETL pipelines and high-performance RESTful APIs/microservices.
- Participate in thorough code and design reviews, and guide technical decisions for system components while mentoring peer engineers.
- Lead the charge in investigating data and quality issues, getting into the weeds of the code to understand why things don't work as expected, and then patching the problem.
Requirements
- 4+ years of professional experience building scalable, robust APIs, microservices, and high-volume ETL/ingestion processes.
- Strong professional experience with Functional Programming languages (Scala and Elixir) and/or experience in mainstream typed languages (Java, C#, or C++).
- Demonstrated experience working with OpenSearch (or Elasticsearch) for complex indexing, alongside exposure to OCR pipelines, document parsing, or natural language text processing.
- 4+ years of experience with data modeling techniques for structured/unstructured datasets, strong SQL coding, and query optimization skills. Proven ability to design for and navigate both transactional (OLTP via Postgres, MySQL, etc.) and analytical (OLAP via Databricks, Snowflake, BigQuery, etc.) data systems.
- Comfort using coding assistants, automated scripts, or agentic tools to streamline your daily development workflow and cut down on repetitive tasks.
- Deep understanding of distributed server-side architectures, reactive principles, and cloud integrations (AWS and/or GCP), including messaging/streaming infrastructure (Amazon SQS, Kafka, and Google PubSub).
- Exceptional written and verbal communication skills, with a proven ability to collaborate cross-functionally across multiple engineering and product teams.
Qualifications
- Real world experience with libraries within the Scala Typelevel ecosystem such as Cats, Shapeless, Circe, and Doobie among others.
- Willingness to occasionally work with reactive front-end technologies (TypeScript, Angular, or React) to enhance internal project management user interfaces.
- Prior experience in healthcare technology, clinical data environments, or a deep passion for improving patient outcomes in healthcare.
Benefits
- 100% health, vision, and dental coverage for employees
- 401K Match
- Flexible vacation plans
- $700 learning and wellness annual stipend
- Headspace meditation app access
Pay and Schedule
Base Salary: $150,000 - $236,000 USD
Geographic Premium May Apply
Schedule
This is a hybrid role. Applicants must be able and willing to work from our offices in San Francisco, CA or New York City, NY three days per week and the remaining days from home.
Benefits
- 100% health, vision, and dental coverage for employees
- 401K Match
- Flexible vacation plans
- $700 learning and wellness annual stipend
- Headspace meditation app access