Cloud Architect
Precodata · Indiana, United States · 1 wk ago
EngineeringFull-time
About the role
The purpose of a Big Data Architect is to design solutions and platforms that enable data scientists and analysts to gain insights into data using data-driven services and infrastructures. You will be responsible for stakeholder management and technical leadership for data ingestion and processing engagements.
Responsibilities
- Build technical solutions required for optimal ingestion, transformation, and loading of data from a wide variety of data sources using open source, multi-cloud solutions (AWS, Azure, GCP, etc.) and big data frameworks and services
- Understand and formulate processing pipelines of large, complex data sets that meet functional/non-functional customer business requirements
- Design, create, and maintain optimal data pipeline architecture
- Work alongside Business Analysts, Data Analysts, Data Scientists, and DevOps to implement Data Engineering solutions that answer customer business needs
- Collaborate with customer's data department during workshop sessions to uncover more detailed business requirements related to data engineering
- Maintain micro and macro vision of transversal architecture always related to clients' needs
- Confidently take responsibility for the technical output of a project
Requirements
- Demonstrable successful history of manipulating, processing, and extracting value from large disconnected datasets
- Delivering production-scale data engineering solutions leveraging one or more cloud services
- Ability to quickly pick up new skills and learn on the job
- Comfortably work with various stakeholders such as data scientists, architects, and DevOps
- Experience in building scalable end-to-end data ingestion and processing solutions
- Good understanding of data infrastructure and distributed computing principles
- Proficient at implementing data processing workflows using Hadoop and frameworks such as Spark, Flink, Storm along with solutions like Hive, Cassandra, and RGBD solutions
- Good understanding of data governance and how regulations such as GDPR and PCI can impact data storage and processing solutions
- Experience with object-oriented and/or functional programming languages, such as Python, Java, Scala, and Go
- Infrastructure as Code philosophy with Serverless Architecture as a first axiom
Benefits
- MacBook Pro and a smartphone (choose between Galaxy or iPhone)
- Diverse, passionate, and easy-to-work-with team culture
- Continuous learning program providing training and career development opportunities
- Weekly Thursday team lunch at a local restaurant (company-sponsored)
- Annual kick-off event in a cool secret location in Europe