Software Architect

About the role

The Software Architect will own the design and implementation of Machinify's intelligent document processing and agentic evaluation framework. This role is responsible for setting the architectural direction for how our platform ingests, understands, and reasons over complex healthcare documents at scale. The ideal candidate will bring deep expertise in system design, strong convictions about abstraction boundaries, and a commitment to producing high-quality, production-ready code.

Responsibilities

• Own the architecture of Machinify's intelligent document processing platform and agentic evaluation framework — from API design to implementation
• Design abstractions and interfaces that enable agentic workflows to reason over medical records, claims data, and unstructured healthcare documents
• Define the boundaries between orchestration, retrieval, LLM interaction, and domain logic — creating a framework that is principled yet pragmatic
• Ensure the system scales
• Write performant production code — this is a hands-on role where you lead through implementation, not solely through design documents
• Mentor engineers on system design, API design, and building production-grade AI systems
• Reduce technical debt and establish architectural patterns that scale with the platform
• Collaborate closely with Data Science, Data Engineering, and Product teams to translate complex domain requirements into clean system design

Requirements

• 10+ years of software engineering experience with a proven track record of owning system architecture at scale
• Experience with Python & Scala/Java — deep experience designing Python-based frameworks and writing idiomatic, well-structured APIs in Python and Scala/Java
• Demonstrated ability to design effective abstractions: knowing when to generalize, when to keep things concrete, and where to draw boundaries in complex systems
• Experience architecting agentic or multi-step reasoning systems that integrate LLMs into production workflows — framework-agnostic design thinking is valued over familiarity with any specific tool
• Strong background in designing large-scale systems that process unstructured data such as documents, medical records, and images
• Deep understanding of API design principles and building platforms that other engineers build upon
• Proven ability to productionize AI/ML systems with a focus on reliability, observability, and maintainability
• Strong experience with designing with system performance and scaling trade-offs in mind
• Strong CS fundamentals — data structures, distributed systems, asynchronous programming
• Bachelor's or Master's degree in Computer Science, or equivalent experience

Qualifications

• Nice to have: Experience with Spark, Flink, Kafka, Airflow, or Ray
• Knowledge of Prometheus, Grafana, and observability tooling
• Background in healthcare, fintech, or other regulated industries
• Cross-functional collaboration experience with data scientists and ML engineers

Benefits

• Work from anywhere in the US!
• Top Medical/Dental/Vision offerings
• FSA/HSATuition reimbursement
• Competitive salary, 401(k) with company match
• Unlimited PTO
• Additional health and wellness benefits and perks
• A flexible and trusting environment where you’ll feel empowered to do your best work

Pay

The salary for this position is based on an array of factors unique to each candidate: such as years and depth of experience, set skills, certifications, etc. We are hiring for different levels and the base salary can range from $230k-$280k+ based on your assessed level. Compensation also includes meaningful equity, healthcare, unlimited PTO, and more.

Schedule

Remote - US