DirectJobHub
Jobs · Engineering · New York

Software Engineer, LLM & Automation

Basis Research Institute · New York, NY · 1 mo ago
EngineeringFull-time

About the role

Basis is a nonprofit applied AI research organization with two primary goals: understanding and building intelligence, and advancing society's ability to solve complex problems. To achieve these goals, they are developing a new technological foundation inspired by human reasoning and creating a collaborative organization that prioritizes human values.

Core Responsibilities

  • Architect and maintain automation pipelines combining internal tools with GPT/Claude and other LLMs
  • Integrate data across third-party APIs (e.g., ATS platforms, Slack, Google) into unified, automated workflows
  • Leverage structured generation (JSON schemas, function calling, etc.) to ensure robust, correct LLM outputs
  • Collaborate with Ops and R&D to identify high-impact automation opportunities
  • Write production-grade code, emphasizing modularity, reliability, and error handling
  • Deploy, scale, and optimize solutions in a secure, cloud-based environment
  • Document solutions for both technical and non-technical audiences, ensuring easy updates and maintenance

Qualifications and Attributes

  • Experience programming in Julia and/or Python (3+ years of production-level coding, or equivalent)
  • Understanding of how to integrate LLMs using structured prompts, scaffolding frameworks (LangChain-like), or advanced text generation approaches
  • Comfortable with complex API orchestration: dealing with rate limits, OAuth, error retries, etc.
  • Good collaboration and communication skills, especially when gathering requirements from non-technical staff
  • Flexible and creative problem solvers, comfortable with iterative, experimental development cycles
  • Embrace data-security best practices (e.g., handling PII, encryption, secrets management)
  • Excited to learn quickly and adapt to new developments in the LLM/AI ecosystem

Technical Skills Preferred (not all required)

  • Julia: Type-driven or multiple-dispatch approaches; performance tuning, HPC, or scientific computing workflows
  • Python: Building microservices with FastAPI, Flask, or other frameworks; advanced concurrency (async, multiprocessing)
  • LLM Tools & Frameworks: Familiarity with LangChain, open source LLM clients, or custom chain-of-thought integrations
  • Cloud Infrastructure: Docker/Kubernetes, CI/CD pipelines, AWS/GCP/Azure deployment patterns
  • Distributed Systems & Queues: Experience with concurrent processing, task queues (Celery, Sidekiq), or event-driven systems
  • Database Interaction: Ability to design schemas and queries in PostgreSQL or similar databases
  • Security & Privacy: Understanding of OAuth flows, secrets management, data encryption, and role-based access controls

Non-Discrimination Notice

Basis Research Institute provides equal employment opportunities without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or genetics and prohibits discrimination based on all protected characteristics.

Privacy Notice

By submitting your application, you grant Basis permission to use your materials for both hiring evaluation and recruitment-related research and development purposes. Your information may be processed in different countries, including the US. You retain copyright while providing Basis a license to use these materials for the stated purposes. Read our full Global Data Privacy Notice here.

Similar jobs