Sr. Data Engineer

Primary Purpose Of Position

Lead the design, build, test, implementation, and ongoing maintenance of technology solutions, products, and processes that support business and IT needs. This role evaluates technology standards, market-available products, and associated risks and benefits to deliver effective, scalable solutions. The position operates independently with minimal guidance and coordinates the work of less experienced engineers while collaborating across teams to meet project objectives.

Responsibilities

• Build and support data warehouses, data lakes, and high-performance database objects including SQL scripts, stored procedures, and views.
• Implement automated data ingestion, transformation, validation, reconciliation, and monitoring processes to ensure reliable and accurate data delivery.
• Partner with business stakeholders and BI teams to translate requirements into technical solutions that support reporting and analytics.
• Analyze existing operational standards, processes, and/or governance to identify and implement improvements.
• Conduct technical discovery sessions with vendors and customers.
• Configure logging, reporting, and alerts for cloud services, applications and databases.
• Create documentation to install, replace, and upgrade network cloud components.
• Create requirements document, SOW, logical & physical network diagrams, and implementation plans to integrate in customers' environments.
• Design and recommend solutions to mitigate risks discovered through business impact analysis, site risk assessments and disaster recovery planning.
• Design, develop and/or review IaC code or configurations to ensure solutions meet the requirements of functional and technical specifications.
• Develop infrastructure as code (IaC) leveraging cloud native tooling to ensure automated and consistent platform deployments.
• Engage with business partners to gather information, analyze requirements and deliver practical, efficient and cost-effective solutions that satisfy business needs.
• Lead assigned network integration projects and deployments and ensure solutions are delivered to meet business requirements.
• Lead team members and provide oversight for less experienced engineers;
• Maintain and deploy infrastructure and services through templates and code.
• Document network configurations, layouts, business changes.
• Maintain relevancy and knowledge in current cloud, evolving, emerging networking technologies.
• Maintain technical knowledge and business acumen within own discipline or function and manage ongoing professional development.
• Manage security and access controls of cloud-based solutions.
• Overall responsibility for the evaluation of vendor quality programs and maintenance of Approved Vendors List in support Clearsight's Quality program.
• Participate on capital projects and champion key operational decisions.
• Perform custom network integration with cloud platform specific to the needs of the enterprise.
• Participate in potential refactoring, rebuild, or redesign required during Cloud migration.
• Provide Cloud product & service evaluation, testing, lab and mockup solutions as needed.
• Provide consulting, guidance and recommendations to senior leadership.
• Provide input into presentations and/or Engineering and Architecture Review Boards.
• Provide SME-level network analysis, design, consultation with leadership, project teams and end users to identify network runtime requirements and perform feasibility analysis on potential changes related to security and network architecture.
• Responsible for annual relationship meetings with firms.
• Serve as subject matter expert while leading in the Hybrid Cloud enterprise journey encompassing ongoing architecture, design, planning, configuration, implementation, testing, and documentation of the enterprise network.
• Solutions may include but are not limited to the development of various types of applications, web, mobile app, full stack or integrations hosted on premises data centers or in the cloud.
• Support and research cloud issues.
• Support development of version control principles (e.g. Git and working within an agile environment).
• Understand technologies and service offerings.
• Work closely with leadership to develop future plans, resource requirements, migrations strategies, and project schedules.

Minimum Qualifications

• Bachelor's degree in Information Systems with 5-years experience, in lieu of degree 9-years experience
• Technical knowledge and experience in relational database architecture, and/or HRMS systems including SQL, Oracle BI, Business Objects, Hyperion, etc.
• A thorough grasp of agile and lean delivery concepts and methodologies, and a history of successfully applying this knowledge to manage teams
• Understanding of network fundamentals: Firewalls, VPN tunnels; DNS; Load balancers; Subnets; VLANs; etc
• Experience in IaC development with ARM templates, Bicep, Terraform, Azure CLI or similar
• Ability to train and mentor teammates and cross functional partners
• Demonstrated proficiency in use of network routing, switching and security protocols
• Competence in a wide range of IT skills including networking, systems administration, data protection, information security and CI/CD tooling
• Cloud and services experience, with Azure cloud experience highly desirable
• Experience scripting with PowerShell
• Proficient with GIT (or similar) to perform source code management
• Ability to work in an operating environment that requires 24x7 rotating shift work, on-call, weekends, overtime, including holidays
• Demonstrated consulting, presentation, and project management skills, with the ability to champion and influence decisions
• 3-years experience with IaaS and PaaS solutions
• 3-years Microsoft Azure experience involving design, deployment, configuration and optimization
• 3-years professional experience as a data analyst, data engineer, or analytics engineer

Preferred Qualifications

• Master's degree in computer science or a related field and 5 years of relevant experience
• Design and maintain scalable ETL/ELT pipelines and optimize data integration solutions, automating data ingestion, and deployment processes.
• Build and support data warehouses and data lakes, developing optimized SQL and database objects to enable efficient data storage and access.
• Implement data engineering best practices and create technical documentation that translates business requirements into technical solutions.
• Support Agile development, sprint planning, and production operations. Perform data quality analysis, reconciliation, and issue resolution, and ensure data reliability, availability, and accuracy.