Data Engineer - ITS4
About the role
In this dynamic, fast-paced role, you’ll serve as a technical expert on our data services team at Minnesota IT Services (MNIT), partnering with Minnesota Department of Health (MDH) to design, deploy, and maintain data pipelines that leverage the full power of Amazon Web Services (AWS). Your creativity and innovative thinking is not only appreciated but encouraged in our ever-evolving environment. Work where you live, contribute to something bigger than yourself, and be challenged every day. Come build technology that makes a real difference in Minnesotans life, join Minnesota IT Services and the Minnesota Department of Health!
Responsibilities
- Design, deploy, and maintain data pipelines leveraging Amazon Web Services (AWS)
- Serve as a technical expert on the data services team
- Support an agency that works to protect, maintain, and improve the health of all Minnesotans
Minimum Qualifications
Position requires a minimum of four (4) years of IT related experience in Amazon Web Service (AWS) or related data technologies. Experience must include:
- Automating AWS data pipeline/ETL technologies in a production data environment – S3, Glue, Lambda
- Working with a variety of relational data storage options (AWS data lake, AWS RDS, or Amazon Redshift)
- Writing and interpreting data transformations in Python or R
- Big Data processing utilizing PySpark
- Utilizing version control (SVN, Git, or other version control system) to build transparent data pipelines
- Demonstrated ability to communicate clearly and effectively in a manner that facilitates mutual understanding
- Customer-focused approach grounded in active listening, empathy, and solution-oriented problem-solving to deliver positive user experiences
Education in Information Technology (IT) or an IT related field may substitute for experience as follows: a master’s degree for eighteen (18) months of experience; a bachelor’s degree for one (1) year; and an associate’s degree for six (6) months.
Preferred Qualifications
- Working with non-relational data storage options (vector stores or NoSQL databases) to support machine learning and AI data pipelines
- An AWS Certification such as Cloud Practitioner or Data Engineer or Solutions Architect
- Knowledge of IAM Identity Center and Lake Formation
- Knowledge of containerization deployments utilizing Amazon ECS
- Comfort with troubleshooting data pipelines with little precedence and adjusting to multiple demands, shifting priorities, ambiguity and rapid changes
- Passion in one or more of the following aspects of data governance: quality, integration, security, lifecycle management, stewardship, metadata management
- Apply in-depth critical thinking and analytic thinking skills to a class of domain-specific problems and projects to provide practical assessment and solution generation
Additional Requirements
It is the policy of Minnesota IT Services that a successful candidate must pass all legally required checks prior to employment which may consist of the following:
- SEMA4 Records Check (applies to current and past state employees only)
- Criminal History Check
- Reference Check
- Social Security and Address Verification
- Education Verification
- Other legally required checks
Minnesota IT Services does not participate in the federal E-Verify program. Minnesota IT Services is unable to sponsor applicants for work visas, including F-1 STEM OPT extensions, and cannot complete Form I-9 or any other documentation requiring employer participation in E-Verify. All applicants must be legally authorized to work in the United States at the time of application.
Telework Information
This position is telework eligible for applicants who reside in Minnesota or in a bordering state, with supervisory approval and satisfactory performance. If you live in a state bordering Minnesota, you must live within 50 miles or less from the primary work location to be eligible for telework. Telework arrangements and policy updates may be adjusted based on business needs.
This response is AI-generated, for reference only.