Software Engineer (Python, Databricks, AWS, Terraform, Redis) [AQ-10697]

What You’ll Do

• Architect and propose new AWS/Databricks solutions and updates to existing backend systems that ingest, cache, and process terabyte and petabyte level environmental data from external sources.
• Work closely with the product management team and end users to understand customer experience and system requirements, build backlog, and prioritize work.
• Create and update REST APIs and backend processes (e.g., AWS Chalice/Lambda) for current, historical, and forecast data.
• Build/support solutions involving containerization (e.g., Docker), caching (Redis), and databases (e.g., PostgreSQL/PostGIS).
• Migrate and maintain CI/CD pipelines (e.g., GitHub Actions).
• Enhance monitoring and alerting for critical systems (e.g., Datadog).
• Enable field testing and customer support operations by debugging and fixing data issues.
• Work with data scientists to scalably fetch and manipulate large datasets for models and analysis.

What You’ll Bring

• Excellent coding skills (Python) with production software deployment experience.
• Big data experience (terabyte or petabyte level data sources).
• Core understanding of cloud computing (e.g., AWS services like IAM, Lambda, S3, RDS).