Senior Software Engineer
Weekday AI (YC W21) · United States · 2 days ago
RemoteRemoteOTHRContract
This role is for one of our clients Pay: 30-100/hour Job Type: Contractor (:15 hrs a week) Location: Remote Schedule: Flexible, you pick the hours and days (including weekends if desired) Required Skills: Python3, Java, Rust, Algorithms, Basics of C++, TypeScript, Bug fixing, Feature implementation, Codebase refactoring, Performance optimization We are seeking an experienced Senior Software Engineer to contribute to the training and evaluation of next-generation artificial intelligence systems. This role is ideal for engineers with strong backend development expertise, excellent problem-solving abilities, and a proven track record of building reliable, scalable, and high-performance software. You will design realistic and challenging coding tasks that assess AI systems' ability to implement features, fix bugs, refactor existing code, and optimize application performance. You will also develop deterministic verification mechanisms that accurately validate solutions, accepting reasonable implementations that meet the requirements while rejecting incorrect or incomplete submissions. The role requires strong software engineering judgment, extensive debugging experience, and a solid understanding of testing methodologies. Previous AI experience is not required; your technical expertise and independent judgment are what matter most. Requirements Key Responsibilities Coding Task Development: Design challenging, real-world software engineering problems involving feature implementation, bug fixes, code refactoring, and performance optimizationReference Solution Development: Create high-quality reference implementations that demonstrate correct, efficient, and maintainable approaches to solving technical problemsAutomated Verification: Build deterministic verifiers, validation scripts, and comprehensive test cases to evaluate solution correctness and ensure reliable task assessmentBackend Engineering: Apply expertise in backend development, scalable services, APIs, asynchronous processing, and distributed systems to create realistic engineering challengesDebugging and Troubleshooting: Analyze complex software defects, investigate system bottlenecks, and identify root causes of unexpected behaviorTesting Strategy and Quality Assurance: Design effective testing strategies, develop and maintain large test suites, diagnose flaky tests, and improve overall software qualityCode Review: Evaluate code for correctness, readability, maintainability, performance, security, and adherence to engineering best practicesRefactoring and Optimization: Develop tasks that assess an AI system's ability to improve legacy code, simplify complex implementations, and optimize resource utilizationTechnical Reasoning Assessment: Evaluate AI-generated reasoning related to architecture, debugging, algorithms, system design, and implementation decisionsTechnical Documentation: Document task requirements, expected behavior, test coverage, solution approaches, and verification criteria clearly and consistentlyContinuous Improvement: Analyze model failures and refine coding tasks and evaluation methods to improve the quality and reliability of AI-generated software Required Qualifications Strong professional experience in software engineering, particularly backend development and production-grade systemsProficiency in one or more programming languages, including Java, Node.js, Go, Rust, TypeScript, Python, C++, or similar technologiesProven experience designing, building, and maintaining scalable services and APIsStrong understanding of data structures, algorithms, system design, and fundamental computer science conceptsExtensive experience with debugging, troubleshooting, performance optimization, and code reviewPractical experience with automated testing, test design, and software quality assuranceAbility to identify implementation defects, edge cases, inefficient algorithms, and architectural weaknessesStrong understanding of code maintainability, refactoring, reliability, and software engineering best practicesExcellent analytical, problem-solving, and technical communication skillsAbility to work independently and exercise sound technical judgment when evaluating complex engineering problems Must-Have Skills Senior Software EngineeringBackend DevelopmentScalable Services and API DesignJava, Node.js, Go, Rust, TypeScript, Python, or C++Data Structures and AlgorithmsDebugging and Root-Cause AnalysisAutomated Testing and Test StrategyCode Review and RefactoringPerformance OptimizationTechnical Problem-Solving Good-to-Have Skills Large-Scale Test Suite Design and MaintenanceFlaky Test Diagnosis and ResolutionTest Automation FrameworksContinuous Integration and Continuous Delivery (CI/CD)Distributed Systems and MicroservicesSystem Architecture and Design PatternsRegression, Integration, and Unit TestingDeterministic Evaluation and Automated VerificationAI Coding Agent EvaluationLegacy System ModernizationProduction Reliability and Performance Engineering Preferred Qualifications Demonstrated success delivering scalable, reliable, and high-performance backend applicationsExperience resolving complex software defects and improving system performanceProven ability to implement complex features and refactor large codebasesStrong background in test strategy, automated validation, and improving engineering quality standardsExperience establishing testing best practices across engineering teamsAbility to translate complex engineering requirements into clear, reproducible coding tasks and evaluation criteria Selection Process Application: Submit your application and complete the required screening questionsAI Interview: Complete an approximately 30-minute interview focused on your technical expertise and problem-solving approachTechnical Assessment: Complete a technical assessment if requiredHiring Manager Review: Your technical background, assessment results, and suitability for the project will be reviewedOnboarding: Selected candidates receive the necessary instructions and resources to begin their assignments Candidates are expected to complete interviews and assessments independently, without assistance from AI tools or other individuals. The same principle applies to project assignments, where the quality of the work depends on each engineer's own expertise and judgment. Compensation Structure Compensation is output-based, with payment provided for tasks that meet the defined project specifications and acceptance criteria. Completion time may vary based on task complexity, individual experience, and workflow. Minimum submission requirements apply, and participants are expected to complete a specified minimum number of tasks per week. Start Timeline and Availability The selection process typically moves quickly, with roles often filled within approximately 48 hours. Successful candidates should be prepared to begin their first tasks within 24-48 hours of completing onboarding.