Lead Bigdata Engineer, DC or MN (Hybrid)
Optum · Eden Prairie, MN · 4 wk ago
EngineeringFull-time
Primary Responsibilities
- Design, code, test, document, and maintain high-quality and scalable big data solutions
- Help drive agile processes and mentor junior level members of the team
- Research, evaluate, and deploy new tools, frameworks and patterns to help build a sustainable big data platform
- Identify gaps and opportunities for improvement of existing solutions
- Define and develop APIs for integration with various data sources in the enterprise
- Translate customer requirements into solution design
- Participate with prototypes as well as design and code reviews
- Make accurate development effort estimates to assist management in project and resource planning
- Keep skills up to date through ongoing self-directed training
- Collaborate with management, quality assurance, architecture, and other development teams
- Write technical documentation and participate in production support
- Leverage enterprise-approved AI tools to streamline workflows, automate tasks, and drive continuous improvement
Required Qualifications
- 10+ years of hands-on software development experience
- 5+ years of experience in distributed systems technologies like Spark and Hadoop
- 3+ years of experience in technologies like Databricks, and Snowflake
- 3+ years of experience with Agile/SCRUM methodology
- Bachelor's degree in CS or IT related field OR equivalent experience
- 5+ years of experience with Python, JSON and Web Services
- 4+ years of experience in Kafka streaming
- 2+ years with NoSQL databases (Cassandra preferred)
- 2+ years working with Docker and Kubernetes
- Experience in infrastructure services on at least one major cloud platform (Azure preferred)
- Demonstrated experience mentoring and helping others grow
- Thorough understanding of service-oriented architecture (SOA) concepts
Preferred Qualifications
- Master's degree in CS or IT related field
- Experience with machine learning and deep learning frameworks
- Experience with distributed systems and microservices architecture
- Experience with data warehousing and ETL processes
Benefits
Our mission of helping people live healthier lives extends to our team members. Learn more about our range of benefits designed to help you live well.
- Life: Resources and support to focus on what matters most to you, in every facet of your life.
- Emotional: Education, tools and resources to help you reduce and manage stress, build resilience and more.
- Physical: Health plans and other coverage to support wellness for you and your loved ones.
- Financial: Benefits for today and to help you plan for the future, including your retirement.
Pay
The pay for this role is competitive and commensurate with experience.
Schedule
This role is a hybrid position, allowing for both remote and in-office work.