Senior Software Engineer
Underdog.io -Apply to top tech jobs in 60 seconds. A place where companies apply to you · United States · 4 days ago
RemoteRemoteInformation Technology$30/hrFull-time
Key Responsibilities
- Design, develop, and maintain high-performance, distributed backend services in Golang.
- Arcitect and implement robust APIs and data pipelines for processing and serving data to and from our LLM-based inference systems.
- Integrate with various LLM providers (e.g., OpenAI, Anthropic) and open-source models, optimizing for latency, cost, and reliability.
- Contribute to the entire software development lifecycle, including concept, design, build, deployment, and operational excellence.
- Collaborate closely with ML researchers and engineers to productionize machine learning models and algorithms.
- Write clean, well-tested, and maintainable code, and participate in rigorous code reviews.
- Proactively identify and address performance bottlenecks, scalability challenges, and system vulnerabilities.
Qualifications & Experience
- Must-Haves:
- 3+ years of professional software development experience with a strong focus on backend systems.
- Proven, hands-on experience building and shipping production-level services in Python or Golang.
- Solid understanding of computer science fundamentals: data structures, algorithms, and system design.
- Experience with cloud platforms (AWS, GCP, or Azure) and containerization technologies (Docker, Kubernetes).
- A genuine passion for and understanding of the modern AI/ML landscape, specifically Large Language Models.
- Excellent problem-solving skills and the ability to work independently in a fast-paced, early-stage startup environment.
- Nice-to-Haves:
- Hands-on experience fine-tuning, deploying, or managing open-source LLMs (e.g., Llama, Mistral).
- Experience with vector databases (e.g., Pinecone, Weaviate, pgvector) and RAG (Retrieval-Augmented Generation) architectures.
- Knowledge of MLOps practices and tools for model deployment and monitoring.
- Familiarity with data engineering and processing large-scale, unstructured datasets.
- Previous experience in an early-stage, venture-backed startup.
What We Offer
- Foundational Impact: Your code and architectural decisions will have an outsized impact on the product and the company's trajectory.
- Equity Ownership: A significant equity grant, ensuring you share directly in the value you create.
- Competitive Compensation: A competitive salary and benefits package, reflective of our recent funding.
- Cutting-Edge Tech Stack: The opportunity to work exclusively with modern technologies on challenging, green-field projects.
- A-Player Team: Collaborate with a small, dedicated, and highly skilled team that values learning and excellence.