Senior Data Engineer (Remote)
for section headings: e.g., About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule. We must not repeat job title. We must include sections only when posting has real specific content. We need to extract content.
Let's parse:
- Purpose: "The primary purpose of a Senior Data Engineer in Production Support is to maintain the seamless operation of data pipelines, databases, and analytics platforms in live environments. This includes monitoring and troubleshooting data workflows, resolving incidents, and proactively addressing performance bottlenecks to minimize downtime and ensure data availability for end users and business stakeholders." This could be "About the role" or "Purpose". Use heading "About the role".
- Essential Functions: list of duties. Use Responsibilities (or maybe "Responsibilities"). Provide - for each bullet.
- Supervisory Responsibility: mention no direct reports but guiding/mentoring, may lead a team of matrixed resources. Could be part of Responsibilities or separate "Leadership". But we have limited headings; we could include under Responsibilities.
- Qualifications: Education Level, Experience. Use heading "Qualifications". Provide
- .
- Knowledge, Skills And Abilities (KSAs): list many items. Could be heading "Skills". Provide
- .
- Salary Range: Provide Pay section with salary range. Use heading "Pay". Provide
with the range.
- Benefits: mention "In addition to your compensation, CareFirst offers a comprehensive benefits package, various incentive programs/plans, and 401k contribution programs/plans (all benefits/incentives are subject to eligibility requirements)." So we can have Benefits section with that sentence.
- Schedule: Not explicitly mentioned. There's "Flexible working long hours and on demand: Willingness and ability to adapt to varying work schedules, including evenings and weekends, to meet project deadlines and production support requirements. Able to respond promptly to urgent issues and provide support whenever needed to ensure business continuity and system reliability." That's schedule info. So we can have Schedule section with that.
We must not include boilerplate like EEO, etc. Remove those.
We must not repeat job title. Not include Job ID.
We must not include placeholder text.
We need to ensure we preserve all substantive information. Let's extract each piece.
Purpose paragraph: keep as is.
Essential Functions list: Let's extract bullet points from the text:
"Develops and maintains infrastructure systems (e.g., data warehouses, data lakes) including data access APIs.
Prepares and manipulates data using multiple technologies.
Interprets data, analyzes results using statistical techniques, and provides ongoing reports.
Executes quantitative analyses that translate data into actionable insights.
Provides analytical and data-driven decision-making support for key projects.
Designs, manages, and conducts quality control procedures for data sets using data from multiple systems.
Develops data models by studying existing data warehouse architecture; evaluating alternative logical data models including planning and execution tables; applying metadata and modeling standards, guidelines, conventions, and procedures; planning data classes and sub-classes, indexes, directories, repositories, messages, sharing, replication, back-up, retention, and recovery.
Creates data collection frameworks for structured and unstructured data.
Improves data delivery engineering job knowledge by attending educational workshops; reviewing professional publications; establishing personal networks; benchmarking state-of-the-art practices; participating in professional societies.
Applies data extraction, transformation and loading techniques in order to connect large data sets from a variety of sources.
Applies and implements best practices for data auditing, scalability, reliability and application performance."
Also supervisory: "Position does not have direct reports but is expected to assist in guiding and mentoring less experienced staff. May lead a team of matrixed resources."
We could include supervisory as part of Responsibilities.
Now Qualifications:
"Education Level: Bachelor's Degree in Computer Science, Information Technology or Engineering or related field OR in lieu of a Bachelor's degree, an additional 4 years of relevant work experience is required in addition to the required work experience.
Experience: 5 years Experience with database design and developing modeling tools.
Experience developing and updating ETL/ELT scripts.
Hands-on experience with application development, relational database layout, development, data modeling."
We need to preserve all. Might combine.
Now KSAs list: many items. Let's extract each line after "Knowledge, Skills And Abilities (KSAs)":
"Experience with Informatica IICS: Practical knowledge in using Informatica Intelligent Cloud Services (IICS) for building, managing, and optimizing cloud-based data integration workflows.
Knowledge of Kafka: Familiarity with Apache Kafka architecture and able to trouble shoot issues in a timely manner.
MDM SaaS Experience: Understanding and hands-on experience with Master Data Management (MDM) Software as a Service solution for ensuring data consistency, quality, and governance across enterprise systems.
Proficiency in GitHub: Demonstrated expertise in utilizing GitHub for version control, code collaboration, and managing development workflows within data engineering projects.
Extensive Experience with SQL: Advanced proficiency in writing complex queries, optimizing performance, and managing large datasets in Snowflake, Oracle, and SQL Server Databases.
Expertise in Microsoft Azure: Hands-on experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Blob Storage, Fabrics, and other relevant Azure cloud services.
Power BI Experience: Hands-on experience in developing, deploying, and maintaining data visualizations and dashboards using Power BI, including advanced DAX queries, and integrating with diverse data sources for actionable insights.
Control-M Knowledge: Familiarity with Control-M workload automation, including designing, scheduling, and monitoring data pipeline jobs to ensure reliable and efficient batch processing within enterprise environments.
Proficiency in Scripting Languages: Demonstrated ability to automate data workflows using Python, PowerShell, or similar scripting languages.
Experience with Version Control Tools: Strong understanding and practical use of Git, GitHub, Azure DevOps for collaborative development and CI/CD pipelines.
Strong Data Engineering Fundamentals: Solid understanding of ETL/ELT processes, data warehousing concepts, and best practices in data architecture and governance.
Flexible working long hours and on demand: Willingness and ability to adapt to varying work schedules, including evenings and weekends, to meet project deadlines and production support requirements. Able to respond promptly to urgent issues and provide support whenever needed to ensure business continuity and system reliability.
Incident Management: Quickly diagnose and resolve data-related issues in production, minimizing impact on business operations.
Monitoring & Alerting: Implement and maintain monitoring solutions to detect anomalies, failures, or performance degradation in data systems.
Root Cause Analysis: Investigate recurring problems, identify their root causes, and implement long-term solutions to prevent future incidents.
Performance Optimization: Analyze data workflows and infrastructure for inefficiencies, tuning systems for optimal performance and scalability.
Collaboration: Work closely with data engineers, analysts, software developers, and IT teams to ensure seamless integration and deployment of data solutions.
Documentation & Best Practices: Maintain clear documentation of production environments, issue resolutions, and standard operating procedures.
Change Management: Participate in the planning and execution of changes to data systems, including upgrades, patches, and configuration updates, while minimizing disruption to ongoing operations.
Security & Compliance: Ensure data systems adhere to organizational security policies and regulatory requirements, identifying and mitigating potential vulnerabilities.
Capacity Planning: Forecast future data storage and processing needs, recommending infrastructure enhancements to support growth and evolving business requirements.
User Support: Provide technical assistance to end users and business teams, addressing queries and enabling effective utilization of data resources.
Automation: Develop and maintain scripts and tools to automate repetitive support tasks, streamlining processes and reducing manual intervention."
Note: Some items like "Flexible working long hours and on demand" also appear in schedule; we might duplicate but okay.
Now Salary Range: "Salary Range: $99,000 - $196,625" plus disclaimer paragraph. We need to include Pay section with the range and maybe the disclaimer? The instruction: include Pay section only if posting actually states them. It does state salary range. We can include the range and maybe the disclaimer as part of Pay section (since it's about salary). Keep the disclaimer text.
Benefits: "In addition to your compensation, CareFirst offers a comprehensive benefits package, various incentive programs/plans, and 401k contribution programs/plans (all benefits/incentives are subject to eligibility requirements)." Also maybe mention "comprehensive benefits package". We'll put that.
Schedule: Already have flexible working hours etc. Could be separate Schedule section.
Now we need to output HTML fragment only, no /. Use
for each section heading. Use - for lists. Use
for prose.
We must not include empty sections.
Let's structure:
About the role
The primary purpose of a Senior Data Engineer in Production Support is to maintain the seamless operation of data pipelines, databases, and analytics platforms in live environments. This includes monitoring and troubleshooting data workflows, resolving incidents, and proactively addressing performance bottlenecks to minimize downtime and ensure data availability for end users and business stakeholders.
Responsibilities
- Develops and maintains infrastructure systems (e.g., data warehouses, data lakes) including data access APIs.
- Prepares and manipulates data using multiple technologies.
- Interprets data, analyzes results using statistical techniques, and provides ongoing reports.
- Executes quantitative analyses that translate data into actionable insights.
- Provides analytical and data-driven decision-making support for key projects.
- Designs, manages, and conducts quality control procedures for data sets using data from multiple systems.
- Develops data models by studying existing data warehouse architecture; evaluating alternative logical data models including planning and execution tables; applying metadata and modeling standards, guidelines, conventions, and procedures; planning data classes and sub-classes, indexes, directories, repositories, messages, sharing, replication, back-up, retention, and recovery.
- Creates data collection frameworks for structured and unstructured data.
- Improves data delivery engineering job knowledge by attending educational workshops; reviewing professional publications; establishing personal networks; benchmarking state-of-the-art practices; participating in professional societies.
- Applies data extraction, transformation and loading techniques in order to connect large data sets from a variety of sources.
- Applies and implements best practices for data auditing, scalability, reliability and application performance.
- Position does not have direct reports but is expected to assist in guiding and mentoring less experienced staff. May lead a team of matrixed resources.
Qualifications
- Education Level: Bachelor's Degree in Computer Science, Information Technology or Engineering or related field OR in lieu of a Bachelor's degree, an additional 4 years of relevant work experience is required in addition to the required work experience.
- Experience: 5 years Experience with database design and developing modeling tools.
- Experience developing and updating ETL/ELT scripts.
- Hands-on experience with application development, relational database layout, development, data modeling.
Skills
- Experience with Informatica IICS: Practical knowledge in using Informatica Intelligent Cloud Services (IICS) for building, managing, and optimizing cloud-based data integration workflows.
- Knowledge of Kafka: Familiarity with Apache Kafka architecture and able to trouble shoot issues in a timely manner.
- MDM SaaS Experience: Understanding and hands-on experience with Master Data Management (MDM) Software as a Service solution for ensuring data consistency, quality, and governance across enterprise systems.
- Proficiency in GitHub: Demonstrated expertise in utilizing GitHub for version control, code collaboration, and managing development workflows
- for each bullet.
- Supervisory Responsibility: mention no direct reports but guiding/mentoring, may lead a team of matrixed resources. Could be part of Responsibilities or separate "Leadership". But we have limited headings; we could include under Responsibilities.
- Qualifications: Education Level, Experience. Use heading "Qualifications". Provide
- .
- Knowledge, Skills And Abilities (KSAs): list many items. Could be heading "Skills". Provide
- .
- Salary Range: Provide Pay section with salary range. Use heading "Pay". Provide
with the range. - Benefits: mention "In addition to your compensation, CareFirst offers a comprehensive benefits package, various incentive programs/plans, and 401k contribution programs/plans (all benefits/incentives are subject to eligibility requirements)." So we can have Benefits section with that sentence. - Schedule: Not explicitly mentioned. There's "Flexible working long hours and on demand: Willingness and ability to adapt to varying work schedules, including evenings and weekends, to meet project deadlines and production support requirements. Able to respond promptly to urgent issues and provide support whenever needed to ensure business continuity and system reliability." That's schedule info. So we can have Schedule section with that. We must not include boilerplate like EEO, etc. Remove those. We must not repeat job title. Not include Job ID. We must not include placeholder text. We need to ensure we preserve all substantive information. Let's extract each piece. Purpose paragraph: keep as is. Essential Functions list: Let's extract bullet points from the text: "Develops and maintains infrastructure systems (e.g., data warehouses, data lakes) including data access APIs. Prepares and manipulates data using multiple technologies. Interprets data, analyzes results using statistical techniques, and provides ongoing reports. Executes quantitative analyses that translate data into actionable insights. Provides analytical and data-driven decision-making support for key projects. Designs, manages, and conducts quality control procedures for data sets using data from multiple systems. Develops data models by studying existing data warehouse architecture; evaluating alternative logical data models including planning and execution tables; applying metadata and modeling standards, guidelines, conventions, and procedures; planning data classes and sub-classes, indexes, directories, repositories, messages, sharing, replication, back-up, retention, and recovery. Creates data collection frameworks for structured and unstructured data. Improves data delivery engineering job knowledge by attending educational workshops; reviewing professional publications; establishing personal networks; benchmarking state-of-the-art practices; participating in professional societies. Applies data extraction, transformation and loading techniques in order to connect large data sets from a variety of sources. Applies and implements best practices for data auditing, scalability, reliability and application performance." Also supervisory: "Position does not have direct reports but is expected to assist in guiding and mentoring less experienced staff. May lead a team of matrixed resources." We could include supervisory as part of Responsibilities. Now Qualifications: "Education Level: Bachelor's Degree in Computer Science, Information Technology or Engineering or related field OR in lieu of a Bachelor's degree, an additional 4 years of relevant work experience is required in addition to the required work experience. Experience: 5 years Experience with database design and developing modeling tools. Experience developing and updating ETL/ELT scripts. Hands-on experience with application development, relational database layout, development, data modeling." We need to preserve all. Might combine. Now KSAs list: many items. Let's extract each line after "Knowledge, Skills And Abilities (KSAs)": "Experience with Informatica IICS: Practical knowledge in using Informatica Intelligent Cloud Services (IICS) for building, managing, and optimizing cloud-based data integration workflows. Knowledge of Kafka: Familiarity with Apache Kafka architecture and able to trouble shoot issues in a timely manner. MDM SaaS Experience: Understanding and hands-on experience with Master Data Management (MDM) Software as a Service solution for ensuring data consistency, quality, and governance across enterprise systems. Proficiency in GitHub: Demonstrated expertise in utilizing GitHub for version control, code collaboration, and managing development workflows within data engineering projects. Extensive Experience with SQL: Advanced proficiency in writing complex queries, optimizing performance, and managing large datasets in Snowflake, Oracle, and SQL Server Databases. Expertise in Microsoft Azure: Hands-on experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Blob Storage, Fabrics, and other relevant Azure cloud services. Power BI Experience: Hands-on experience in developing, deploying, and maintaining data visualizations and dashboards using Power BI, including advanced DAX queries, and integrating with diverse data sources for actionable insights. Control-M Knowledge: Familiarity with Control-M workload automation, including designing, scheduling, and monitoring data pipeline jobs to ensure reliable and efficient batch processing within enterprise environments. Proficiency in Scripting Languages: Demonstrated ability to automate data workflows using Python, PowerShell, or similar scripting languages. Experience with Version Control Tools: Strong understanding and practical use of Git, GitHub, Azure DevOps for collaborative development and CI/CD pipelines. Strong Data Engineering Fundamentals: Solid understanding of ETL/ELT processes, data warehousing concepts, and best practices in data architecture and governance. Flexible working long hours and on demand: Willingness and ability to adapt to varying work schedules, including evenings and weekends, to meet project deadlines and production support requirements. Able to respond promptly to urgent issues and provide support whenever needed to ensure business continuity and system reliability. Incident Management: Quickly diagnose and resolve data-related issues in production, minimizing impact on business operations. Monitoring & Alerting: Implement and maintain monitoring solutions to detect anomalies, failures, or performance degradation in data systems. Root Cause Analysis: Investigate recurring problems, identify their root causes, and implement long-term solutions to prevent future incidents. Performance Optimization: Analyze data workflows and infrastructure for inefficiencies, tuning systems for optimal performance and scalability. Collaboration: Work closely with data engineers, analysts, software developers, and IT teams to ensure seamless integration and deployment of data solutions. Documentation & Best Practices: Maintain clear documentation of production environments, issue resolutions, and standard operating procedures. Change Management: Participate in the planning and execution of changes to data systems, including upgrades, patches, and configuration updates, while minimizing disruption to ongoing operations. Security & Compliance: Ensure data systems adhere to organizational security policies and regulatory requirements, identifying and mitigating potential vulnerabilities. Capacity Planning: Forecast future data storage and processing needs, recommending infrastructure enhancements to support growth and evolving business requirements. User Support: Provide technical assistance to end users and business teams, addressing queries and enabling effective utilization of data resources. Automation: Develop and maintain scripts and tools to automate repetitive support tasks, streamlining processes and reducing manual intervention." Note: Some items like "Flexible working long hours and on demand" also appear in schedule; we might duplicate but okay. Now Salary Range: "Salary Range: $99,000 - $196,625" plus disclaimer paragraph. We need to include Pay section with the range and maybe the disclaimer? The instruction: include Pay section only if posting actually states them. It does state salary range. We can include the range and maybe the disclaimer as part of Pay section (since it's about salary). Keep the disclaimer text. Benefits: "In addition to your compensation, CareFirst offers a comprehensive benefits package, various incentive programs/plans, and 401k contribution programs/plans (all benefits/incentives are subject to eligibility requirements)." Also maybe mention "comprehensive benefits package". We'll put that. Schedule: Already have flexible working hours etc. Could be separate Schedule section. Now we need to output HTML fragment only, no /. Use
for each section heading. Use
- for lists. Use
for prose. We must not include empty sections. Let's structure:
About the role
The primary purpose of a Senior Data Engineer in Production Support is to maintain the seamless operation of data pipelines, databases, and analytics platforms in live environments. This includes monitoring and troubleshooting data workflows, resolving incidents, and proactively addressing performance bottlenecks to minimize downtime and ensure data availability for end users and business stakeholders.
Responsibilities
- Develops and maintains infrastructure systems (e.g., data warehouses, data lakes) including data access APIs.
- Prepares and manipulates data using multiple technologies.
- Interprets data, analyzes results using statistical techniques, and provides ongoing reports.
- Executes quantitative analyses that translate data into actionable insights.
- Provides analytical and data-driven decision-making support for key projects.
- Designs, manages, and conducts quality control procedures for data sets using data from multiple systems.
- Develops data models by studying existing data warehouse architecture; evaluating alternative logical data models including planning and execution tables; applying metadata and modeling standards, guidelines, conventions, and procedures; planning data classes and sub-classes, indexes, directories, repositories, messages, sharing, replication, back-up, retention, and recovery.
- Creates data collection frameworks for structured and unstructured data.
- Improves data delivery engineering job knowledge by attending educational workshops; reviewing professional publications; establishing personal networks; benchmarking state-of-the-art practices; participating in professional societies.
- Applies data extraction, transformation and loading techniques in order to connect large data sets from a variety of sources.
- Applies and implements best practices for data auditing, scalability, reliability and application performance.
- Position does not have direct reports but is expected to assist in guiding and mentoring less experienced staff. May lead a team of matrixed resources.
Qualifications
- Education Level: Bachelor's Degree in Computer Science, Information Technology or Engineering or related field OR in lieu of a Bachelor's degree, an additional 4 years of relevant work experience is required in addition to the required work experience.
- Experience: 5 years Experience with database design and developing modeling tools.
- Experience developing and updating ETL/ELT scripts.
- Hands-on experience with application development, relational database layout, development, data modeling.
Skills
- Experience with Informatica IICS: Practical knowledge in using Informatica Intelligent Cloud Services (IICS) for building, managing, and optimizing cloud-based data integration workflows.
- Knowledge of Kafka: Familiarity with Apache Kafka architecture and able to trouble shoot issues in a timely manner.
- MDM SaaS Experience: Understanding and hands-on experience with Master Data Management (MDM) Software as a Service solution for ensuring data consistency, quality, and governance across enterprise systems.
- Proficiency in GitHub: Demonstrated expertise in utilizing GitHub for version control, code collaboration, and managing development workflows
- for lists. Use
- .
- Salary Range: Provide Pay section with salary range. Use heading "Pay". Provide
- .
- Knowledge, Skills And Abilities (KSAs): list many items. Could be heading "Skills". Provide