Big Data Architect Contractor - Onsite
About the role
Position summary: As a Big Data Architect Contractor, you will support the Deloitte project team by designing and implementing large-scale data solutions to meet business needs. This includes designing and developing scalable big data architectures, collaborating with stakeholders to understand data requirements, implementing data integration, processing, and storage solutions using big data technologies, ensuring data security, quality, and governance standards, and optimizing data architectures for performance, scalability, and cost-efficiency.
Responsibilities
- Write Python and PySpark code for large-scale data processing and pipeline analysis.
- Investigate data pipelines and resolve issues in distributed processing workflows.
- Build and optimize Structured Query Language (SQL) queries and apply data modeling methods, including Slowly Changing Dimension (SCD) Type 1 and Type 2.
- Develop and deploy application programming interfaces (APIs) in Amazon Web Services (AWS) using Elastic Container Service (ECS).
- Build, test, and deploy solutions through continuous integration and continuous delivery (CI/CD) pipelines, using AI-assisted development tools where appropriate.
Qualifications
Required:
- Experience with Amazon Web Services (AWS), including Elastic Container Service (ECS), Lambda, Simple Notification Service (SNS), and DynamoDB.
- Experience writing Python and using PySpark for large-scale data processing and pipeline investigation.
- Experience writing Structured Query Language (SQL) queries and applying data modeling concepts, including Slowly Changing Dimension (SCD) Type 1 and Type 2.
- Experience building and deploying application programming interfaces (APIs) on Amazon Web Services (AWS).
- Experience with continuous integration and continuous delivery (CI/CD) pipelines and AI-assisted coding tools, including GitHub Copilot.
- Ability to travel 100%, on average, based on the work you do and the clients and industries/sectors you serve.
- Ability to work onsite in the Jersey City, New Jersey area 5 days per week.
Preferred:
- Experience troubleshooting performance issues in Amazon Web Services (AWS) applications or data pipelines.
- Experience with data warehousing environments.
- Experience supporting cloud infrastructure issue resolution across engineering teams.
Pay
The expected pay range for this contract assignment is $60 - $65 per hour. The exact pay rate will vary based on skills, experience, and location and will be determined by the third-party whose employees provide services to Deloitte.