Sr. Software Development Engineer
About the role
This is an onsite position in the San Jose office. Collaborate with a team of engineers & product managers in building high-performance data ingestion pipelines and data store to serve the use cases of Segmentation and Activation. Own responsibility for design and implementation of key components of ingesting and maintaining petabyte of Profile data.
Responsibilities
- Develop systems to support high volume data ingestion pipelines handling both streaming and batch processing.
- Leverage popular file and table formats to design storage models to support the required ingestion volumes and data access patterns.
- Explore tradeoffs across different formats and schema layouts driven by workload and application characteristics.
- Deploy production services and iteratively improve them based on customer feedback.
- Follow Agile methodologies using industry leading CI/CD pipelines.
- Participate in architecture, design & code reviews.
Requirements
- B.S. or M.S. in Computer Science or a related field or equivalent experiences required.
- Experience with distributed processing systems like Apache Spark, Hadoop Stack, or Apache Kafka;
- Experience with Data Lake cloud storages like Azure Data Lake Storage or AWS (Amazon Web Services) S3;
- Understanding of file formats like Apache Parquet and table formats such as Databricks Delta, Apache Iceberg or Apache Hudi is preferred;
- Understanding of NoSQL databases like Apache HBase, Cassandra, Mongo, or Azure Cosmos DB is a plus;
- Practical experience in building resilient data pipelines at scale is preferred;
- Strong programming skills with extensive experience in Java or Scala;
- Leadership skills to collaborate and drive cross-team efforts;
- Excellent communication skills;
- Adaptable to evolving priorities, accepting challenges outside one's comfort zone, learning new technologies, and delivering viable solutions within defined time boundaries.
Qualifications
- Employer will accept a Master’s degree in Information Systems Management, Computer Science, Computer Engineering, Information Technology, Software Engineering or related field and 5+ years of experience in the job offered or in a Software Development Engineer-related occupation.
Skills
- Experience with distributed processing systems like Apache Spark, Hadoop Stack, or Apache Kafka;
- Experience with Data Lake cloud storages like Azure Data Lake Storage or AWS (Amazon Web Services) S3;
- Understanding of file formats like Apache Parquet and table formats such as Databricks Delta, Apache Iceberg or Apache Hudi;
- Understanding of NoSQL databases like Apache HBase, Cassandra, Mongo, or Azure Cosmos DB;
- Practical experience in building resilient data pipelines at scale;
- Strong programming skills with extensive experience in Java or Scala;
- Leadership skills to collaborate and drive cross-team efforts;
- Excellent communication skills;
- Adaptable to evolving priorities, accepting challenges outside one's comfort zone, learning new technologies, and delivering viable solutions within defined time boundaries.
Benefits
At Adobe, you will be immersed in an exceptional work environment that is recognized throughout the world on the Best Companies lists. You will also be surrounded by colleagues who are committed to helping each other grow through our unique Check-In approach where ongoing feedback flows freely.
Pay
The U.S. pay range for this position is $159,200 -- $301,600 annually. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience.
Schedule
Our compensation reflects the cost of labor across several U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this position is $159,200 -- $301,600 annually.