Sr Data Engineer, AI

We need to output HTML fragment with sections: Use

for section headings: About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule. We must not repeat job title. No Job ID. Remove boilerplate. Must preserve substantive info. We need to parse the posting. Sections present: - "Who We Are": description of company. Could be "About the role"? Actually "Who We Are" is about company, not role. But we can map to "About the role"? The instruction says use headings like About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule. So we need to decide which sections have content. We have: - "Who We Are": company description. Could be placed under "About the role"? Not exactly. But maybe we can treat as "About the role" (though it's about company). The instruction: "use

for section headings (e.g. About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule)." It says e.g., not limited to those? Probably we should use those headings only if content exists. So we need to map content to those headings. We have: - "Total Rewards": benefits and compensation. So we can have Benefits and Pay sections. - "Primary Purpose Of Position": description of role. Could be "About the role". - "Primary Duties And Accountabilities": responsibilities. - "Minimum Qualifications": qualifications. - "Preferred Qualifications": could be Skills or Qualifications? Might be "Skills" or "Qualifications". We have both Minimum and Preferred. Could combine into Requirements? Actually "Requirements" could be minimum qualifications. "Qualifications" could be preferred? But we have both. We could output sections: Requirements (minimum), Qualifications (preferred), Skills (maybe list of skills). But we need to avoid thin sections. Better: Use "Requirements" for minimum qualifications, "Qualifications" for preferred qualifications, "Skills" maybe not needed if covered. But we have many skill lists in qualifications. We also have Pay: "Expected salary range of $145,800 to $162,000, varies based on experience, along with comprehensive benefits package that includes bonus and 401(k)." Also earlier Total Rewards includes bonus, 401(k), medical, etc. So we can have Pay section with salary range, and Benefits section with list of benefits. Schedule: not mentioned, so omit. Now we need to preserve all substantive info, not invent. We need to remove boilerplate: cookie/navigation/legal/EEO etc. Not present. We need to output only HTML fragment. Let's craft:

About the role

Lead activities relating to designing, building, testing, implementing and maintaining AI solutions, products and processes. Provide IT teams and business personnel with technology solutions by evaluating technology standards, market availability of products, risks and benefits of technology to deliver solutions that meet business/IT needs. Coordinate the tasks of less experienced engineers and collaborate across teams as needed. Independence level: Works independently with minimal guidance. Works closely with scrum masters, project managers, QA, Creative, and UX team members to ensure compliance with project needs. Your role will be centered on the development and improvement of new and existing features. Additionally, you will be reviewing the code of your peers, advocating for standard development methodologies, and participating in an inclusive, energetic and highly cross-functional team. The role encompasses architect, design, implementation, and testing to ensure building products right and to release them with high quality. Maintain deep knowledge of technology and its application across our business areas or for our customers, promote knowledge via seminars, presentations and publications within IT and Constellation. Participate in technological innovation to drive new business opportunities and solve complex business problems. Shape and advance core team processes to increase operational efficiency and quality. Coach and lead other engineers assigned to their product or project team. Considered highly skilled and proficient in discipline. Conducts complex, important work under minimal supervision and with wide latitude for independent judgment.

That's from Primary Purpose Of Position. Next Responsibilities:

Responsibilities

• Produce high-quality, secure, and maintainable code/configurations
• Learn and understand business processes with limited guidance
• Work collaboratively as a member of the development team to build solutions in an agile environment
• Support and research issues across all application layers and database
• Identify areas to improve and scale our Azure architecture and design
• Ensure code can be deployed using Azure DevOps
• Design and query database tables, views, functions, stored procedures and batch processes
• Develop, implement, and support interfaces that connect our websites, back-end systems, and various 3rd party cloud solutions, vendors and customers.
• Engage with business partners to gather information, analyze requirements and deliver practical, efficient and cost-effective solutions that satisfy business needs.
• Design, develop and/or review complex code or configurations to ensure AI solutions meet the requirements of functional and technical specifications.
• Write product specifications and design documentation for assigned system components.
• Design and build large-scale AI data platforms/products & frameworks for processing high volumes of data, in real-time as well as batch, that will be used by teams across the organization
• Develop complex data algorithms for AI/ML, data analytics, machine learning, or scientific computing
• Utilize indicators to scope and respond proactively to emerging threats
• Lead team members and provide oversight for less experienced engineers; Stay on top of the latest technologies and trends.
• Support development of version control principles (e.g. Git and working within an agile environment)
• Enhance knowledge of and compliance with preferred technologies, methodologies, standards and policies.
• Assist in the development of white papers, conducting presentations as needed to explain why a technology is being recommended by IT.
• Maintain technical knowledge and business acumen within own discipline or function.
• Provide IT teams and business personnel with technology solutions by weighing advantages of technology trends, market availability of products, risks and benefits of technology to meet business/IT needs.
• Strong debugging and problem-solving skills; lead peer code reviews.

Now Requirements (minimum qualifications):

Requirements

• Bachelor's degree in Accounting with 5-years experience, in lieu of degree 9-years experience
• Experience with private and public cloud architectures, pros/cons, and migration considerations
• 5-years of RDBMS experience
• Experience with JSON, JSON-LD, XML data structures
• Experience implementing data pipelines using latest technologies and techniques
• Experience with Azure DevOps, Copado, GitHub, Heroku, ServiceNow or similar tools
• 3-years of hands-on experience in programming languages such as Java 8, c#, node.js, python, SQL, Unix shell/Perl scripting
• 5-years of industry experience data engineer, with involvement in the data component of the AI/ML lifecycle, and a solid understanding of applied machine learning topics
• 3-years of consulting or client service delivery experience on Azure
• Experience handling Structured and unstructured datasets
• Strong t-SQL skills with experience in Azure SQL DW
• Experience in data modeling and advanced SQL techniques
• Cloud migration methodologies and processes with tools like Azure Data Factory, Event Hub, etc.
• Analytical skills, attention to detail, critical thinking, problem solving and independent decision making
• Knowledge of ETL tools
• Experience with cloud-native Azure technologies like Azure Functions, Event Grids, Service Bus Queues, Cosmos DB, Azure Data Factory, or related is a plus
• Experience designing integration applications, both upstream and downstream applications
• Experience with git, Azure DevOps, build pipelines, code branching/merging, code management
• Experience writing technical reports and procedures

Now Qualifications (preferred):

Qualifications

• Advanced hands-on experience with Databricks and Spark (PySpark preferred) for building and optimizing workflows and pipelines.
• Hands-on proficiency in designing, building, and maintaining ETL/ELT pipelines using Python, PySpark, and related tools.
• Strong SQL skills and experience with data warehousing.
• Hands-on experience with cloud platforms such as AWS, Azure, or GCP, including cloud-native data tools.
• Expertise in big data systems and integrating data from diverse sources such as APIs, flat files, and databases.
• Experience configuring secure external data connections (e.g., Azure Data Lake Storage, On-prem SQL Server) using: Service Principals, SAS Tokens, OAuth, Mounting techniques
• Strong understanding of: Data security, Encryption, Compliance standards
• Experience implementing data governance frameworks to ensure and manage data quality.
• Proven expertise with Azure Data Factory (ADF) for orchestrating and automating data workflows across cloud and on-premises environments.

Now Skills: maybe we could combine some but we already have skill lists in qualifications. Could still add a Skills section summarizing key skills: but risk duplication. The instruction: prefer a few substantive sections over many thin ones. We already have many sections. Could we merge Skills into Qualifications? But we already have Qualifications (preferred). Could we rename Qualifications to Skills? But we need both Requirements and Qualifications. The instruction gave examples but not strict. We'll keep Requirements (minimum) and Qualifications (preferred). Skills maybe not needed. Now Benefits:

Benefits

• Bonus program
• 401(k) with company match
• Employee stock purchase program
• Comprehensive medical, dental and vision benefits, including robust wellbeing programs
• Disability and life insurance benefits
• Paid time off for vacation, holidays, and sick days

Now Pay:

Pay

Expected salary range of $145,800 to $162,000, varies based on experience.

We might also mention that compensation includes bonus and 401(k) but that's already in Benefits. Could add note: along with comprehensive benefits package that includes bonus and 401(k). But we already have those. Now Schedule: not present, omit. Also we might include an "About the company" section? Not required but we have "Who We Are". Could map to "About the role"? But we already used About the role for role description. Could we add another section "About the company"? Not in allowed headings but maybe allowed as e.g. The instruction says use

for section headings (e.g. About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule). It implies those are examples; we could also use other headings if needed? It says "use

for section headings (e.g. About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule)." Likely they want us to use those headings only. So we should not add extra headings like "Who We Are". We could incorporate that description into About the role? But that would be mixing company info with role. Might be okay but could be considered not accurate. However we have already used About the role for role description; we could add a brief paragraph about company within that same section? Might be okay but risk of misrepresenting. Alternatively we could treat "Who We Are" as "About the role" (though it's