Senior Software Engineer, Platform - Data + AI (Back-End)

About the role

C3 AI is looking for Senior Software Engineers to join the rapidly growing Data org within the Platform Engineering department. Successful candidates will work on high-value technologies at the intersection of large-scale distributed systems, data infrastructure, and machine learning. You will design, develop, and maintain features in a highly scalable and extensible AI/ML platform for large-scale applications, involving data science, distributed systems, and multi-cloud strategy. You will take ownership of components, collaborate to drive technical direction, and work on impactful projects that power some of the world’s largest companies in Energy, Financial Services, Utilities, Health Care, Aerospace, Defense, and more.

Responsibilities

• Design and develop infrastructure and services to enable data pipelines for petabyte-level scale and beyond.
• Design and develop abstractions over datastores such as Cassandra, PostgreSQL, Snowflake, etc.
• Design and develop file system abstractions over AWS S3, Azure Blobs, HDFS, etc.
• Design and develop connectors to various external data stores.
• Design and develop distributed system components for stream processing, queueing, batch processing, and analytics engines.
• Develop and maintain industry-leading, high-performance APIs for AI/ML applications.
• Develop and maintain features for distributed computations over large-scale data for ML workflows.
• Design and develop ML-specific data systems such as feature stores and behavioral frameworks like recommendation engines.
• Design and develop integrations with distributed computing technologies such as Apache Spark, Ray, etc., for data exploration and ML workload orchestration.
• Design and develop integrations with data analysis libraries such as Pandas, Koalas, etc.
• Develop and productionize AI/ML models for failure prediction, data schema inferencing, etc.
• Work on frameworks for performance, scalability, and reliability tracking over different components of a highly extensible AI/ML platform.
• Collaborate with architects, product managers, and software engineers across teams in a highly collaborative environment.
• Participate and provide insights in technical discussions.
• Write clean code following a test-driven methodology.
• Deliver commitments promptly following agile software development methodology.

Requirements

• Bachelor of Science in Computer Science, Computer Engineering, or related fields.
• A minimum of 5 years of work experience in a fast-paced software company.
• Strong understanding of Computer Science fundamentals.
• High proficiency in coding with Java, C++, C#, or another compiled language. Python is also acceptable.
• Strong competency in object-oriented programming, data structures, algorithms, and software design patterns.
• Experience with version control systems such as Git.
• Experience with large-scale distributed systems.
• Experience with any public cloud platform (AWS, Azure, GCP).
• Familiarity with distributed computing technologies (e.g., Hadoop, Spark, Kafka) or their managed versions on public cloud platforms.
• Familiarity with technologies in the modern data science/analysis and engineering ecosystem (e.g., Pandas, Koalas).
• Good verbal and written technical communication ability to facilitate collaboration.
• Ability to thrive in a fast-paced, dynamic environment and value end-to-end ownership of components.
• Intellectually curious and open to challenges.

Preferred Qualifications

• Advanced degree in engineering, sciences, or related field.
• Experience with Agile development methodology.
• Experience developing and working with REST and/or GraphQL APIs.
• Experience building scalable and reliable data pipelines.
• Experience with integration of data from multiple sources.
• Experience working with analytics and/or data processing engines.
• Experience developing distributed computation over large-scale data.
• Experience working with distributed computing frameworks (e.g., Hadoop, Spark, Kafka).
• Experience with data science/analysis libraries (e.g., Pandas, Koalas).
• Experience with task schedulers in distributed computing (e.g., Spark, Ray, Dask).
• Familiarity with machine learning workload orchestration in a distributed computing environment.
• Familiarity with workflow execution and/or optimization using DAGs, ideally for machine learning use-cases.
• Conceptual understanding of orchestration and resource provisioning systems (Kubernetes).

Benefits

C3 AI provides excellent benefits, a competitive compensation package, and a generous equity plan.

Pay

California Base Pay Range: $145,000—$187,000 USD