Senior Software Engineer - Python and Data Ecosystem

About Our Client

ClickHouse operates in the cloud data analytics industry, addressing the challenge of real-time data processing and analytics at scale. The organization provides a platform used by over 3,000 customers for data warehousing, observability, and AI workloads, supporting rapid growth and high adoption from global brands and AI innovators. Their products enable companies to handle massive datasets efficiently, facilitating real-time analytics and AI-powered data applications.

About the Opportunity

The Senior Software Engineer - Python and Data Ecosystem is responsible for owning and advancing critical components of the data engineering ecosystem. This role focuses on developing high-performance Python tools and integrations that enable data practitioners to leverage the platform's capabilities within their existing frameworks. The position contributes to shaping the integration strategy with orchestration, transformation, and AI/LLM tools, enhancing how data engineers and scientists work with data at scale.

Responsibilities

• Own and improve the Python connector and SDK ecosystem, focusing on performance, reliability, and API design
• Build and maintain integrations with orchestration platforms (e.g., Airflow, Dagster, Prefect) and transformation tools (e.g., dbt) to enterprise standards
• Lead AI/LLM integration strategy by designing connectors for vector stores, feature pipelines, and LLM-powered applications
• Engage with the open-source community by triaging issues, supporting contributors, and incorporating user feedback into the roadmap
• Collaborate with Product, Cloud, and engineering teams to align integration work with platform goals
• Apply practical data engineering and science experience to guide roadmap priorities

Requirements

• 7+ years of software development experience, including roles as Data Engineer, Data Scientist, or ML Engineer
• Proven experience designing and maintaining production-grade Python connectors or SDKs for major platforms
• PRACTICAL experience deploying AI/ML in production data engineering contexts such as embedding generation and vector search
• Strong knowledge of the Python data ecosystem (Pandas, NumPy, Pydantic) and database fundamentals (SQL, data modeling, OLAP)
• Experience with concurrent Python programming (threading, multiprocessing, async)
• Excellent communication skills and collaboration experience with engineering teams and open-source communities

Pay

The typical starting salary range for this position in the United States is $141,000 to $208,000 USD

The typical starting salary range for this position in US Premium Markets is $157,000 to $232,000 USD