Senior Data Engineer

We need to output HTML fragment with sections: About the role? The posting includes intro paragraph about company and goal. That could be "About the role" or maybe "About the company". The instruction: use

for section headings (e.g. About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule). We need to include sections only when posting has real specific content. We have: - Intro paragraph: Since 2012... At AMH, our goal... The Senior Data Engineer is responsible for designing, building, and managing the data platform... This is description of role. Could be "About the role". We'll put that as

About the role

then

with that paragraph. - Responsibilities: list of bullet points. We'll create

Responsibilities

then

• each bullet. - Requirements: list of bullet points. We'll create

  Requirements

  then
  • each bullet. - Benefits: there is "Perks and Benefits" paragraph describing medical, dental, vision, 401(k), etc. Also mention PTO accrual. So we can have

    Benefits

    then

    with that paragraph. - Pay: there is "Compensation The anticipated pay range/scale for this position is $121,116.00 to $151,395.00 Annually. Actual starting base pay within this range will depend on factors including geographic location, education, training, skills, and relevant experience. Additional Compensation This position is eligible to receive a discretionary annual bonus." So we can have

    Pay

    then

    with that. - Schedule: there is "May occasionally work evenings and/or weekends." That's schedule info. Could be

    Schedule

    then

    with that. We must not repeat job title as heading. No Job ID. Remove boilerplate: CA Privacy notice etc. Remove navigation/legal/EEO etc. Also remove duplicated lines. Ensure we preserve all substantive info. We need to output only HTML fragment, no /, no markdown fences. Let's extract content precisely. Intro paragraph: "Since 2012, we've grown to become one of the leading single-family rental companies and homebuilders in the country, recently recognized as a top employer by Fortune and Great Place To Work®. At AMH, our goal is to simplify the experience of leasing a home through professional management and maintenance support, so our residents can focus on what really matters to them, wherever they are in life. The Senior Data Engineer is responsible for designing, building, and managing the data platform and tools to allow for the efficient processing and analysis of large data sets. Develops and maintains scalable data pipelines, ensures data quality, and deploys machine learning models to production. Collaborates with business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization. Builds real-time and batch pipelines to handle large volumes of data efficiently. Collaborates with cross-functional teams and translate business requirements into scalable data solutions." We'll put that as one paragraph. Responsibilities list: after "Responsibilities:" we have: - Design, develop, and maintain real-time or batch data pipelines to process and analyze large volumes of data. - Designs and develops programs and tools to support ingestion, curation, and provisioning of complex first party and third-party data to achieve analytics, reporting, and data science. - Design and develop Advanced Data Products and Intelligent API’s. - Monitors the system performance by performing regular tests, troubleshoots, and integrates new features. - Lead in analysis of data and the design the data architecture to support BI, AI/ML and data products. - Designs and implements data platform architecture to meet organization analytical requirements. - Ensures the solution designs address operational requirements such as scalability, maintainability, extensibility, flexibility, and integrity. - Provide technical leadership and mentorship to team members. - Leads peer development and code reviews with focus on test driven development and Continuous Integration and Continuous Development (CICD). We need to ensure each bullet is a

  • . Some sentences have minor grammar issues but we keep as is. Requirements list: after "Requirements:" we have a long list. Let's extract each bullet separated by line breaks or periods? The text: "Bachelor’s degree in computer science, information systems, data science, management information systems, mathematics, physics, engineering, statistics, economics, and/or a related field required. Master’s degree in computer science, information systems, data science, management information systems, mathematics, physics, engineering, statistics, economics, and/or a related field preferred. Minimum of eight (8) years of experience as a data engineer with full-stack capabilities Minimum of ten (10) years of Experience in programming Minimum of five (5) years in Cloud technologies like Azure, Aws or Google. Strong SQL Knowledge Experience in ML and ML Pipeline a plus Experience in real-time integration, developing intelligent apps and data products. Proficiency in Python and experience with CI/CD practices Strong background in IAAS platforms and infrastructure Hands-on experience with Databricks, Spark, Fabric, or similar technologies Experience in Agile methodologies Hands-on experience in the design and development of data pipelines and data products Experience in developing data ingestion, data processing, and analytical pipelines for big data, NoSQL, and data warehouse solutions. Hands-on experience implementing data migration and data processing using Azure services: ADLS, Azure Data Factory, Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks Azure Data Catalog, Cosmo Db, ML Studio, AI/ML, etc. Extensive experience in Big Data technologies such as Apache Spark and streaming technologies such as Kafka, EventHub, etc. Extensive experience in designing data applications in a cloud environment. Intermediate experience in RESTful APIs, messaging systems, and AWS or Microsoft Azure. Extensive experience in Data Architecture and data modeling Expert in data analysis and data quality frameworks. Knowledgeable with BI tools such as Power BI and Tableau. May occasionally work evenings and/or weekends." Note: The last line about evenings/weekends is actually schedule, but it's placed under Requirements. We'll treat schedule separately. However the instruction says include a section only when posting has real specific content. We have schedule info: "May occasionally work evenings and/or weekends." We'll put that under Schedule section. So we should not include that line in Requirements. Thus Requirements list should exclude that line. Let's list each requirement as separate
  • . Ensure we keep the exact phrasing. Now Benefits: "Perks and Benefits Employees have the opportunity to participate in medical, dental and vision insurance; flexible spending accounts and/or health savings accounts; dependent savings accounts; 401(k) with company matching contributions; employee stock purchase plan; and a tuition reimbursement program. The Company provides 9 paid holidays per year, and, upon hire, new employees will accrue paid time off (PTO) at a rate of 0.0577 hours of PTO per hour worked, up to a maximum of 120 hours per year." We'll put that as

    . Pay: "Compensation The anticipated pay range/scale for this position is $121,116.00 to $151,395.00 Annually. Actual starting base pay within this range will depend on factors including geographic location, education, training, skills, and relevant experience. Additional Compensation This position is eligible to receive a discretionary annual bonus." We'll put as

    . Schedule: "May occasionally work evenings and/or weekends." We'll put as

    . Now ensure we don't include any boilerplate like CA Privacy notice. Now produce HTML:

    About the role

    Since 2012, we've grown to become one of the leading single-family rental companies and homebuilders in the country, recently recognized as a top employer by Fortune and Great Place To Work®. At AMH, our goal is to simplify the experience of leasing a home through professional management and maintenance support, so our residents can focus on what really matters to them, wherever they are in life. The Senior Data Engineer is responsible for designing, building, and managing the data platform and tools to allow for the efficient processing and analysis of large data sets. Develops and maintains scalable data pipelines, ensures data quality, and deploys machine learning models to production. Collaborates with business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization. Builds real-time and batch pipelines to handle large volumes of data efficiently. Collaborates with cross-functional teams and translate business requirements into scalable data solutions.

    Responsibilities

    • Design, develop, and maintain real-time or batch data pipelines to process and analyze large volumes of data.
    • Designs and develops programs and tools to support ingestion, curation, and provisioning of complex first party and third-party data to achieve analytics, reporting, and data science.
    • Design and develop Advanced Data Products and Intelligent API’s.
    • Monitors the system performance by performing regular tests, troubleshoots, and integrates new features.
    • Lead in analysis of data and the design the data architecture to support BI, AI/ML and data products.
    • Designs and implements data platform architecture to meet organization analytical requirements.
    • Ensures the solution designs address operational requirements such as scalability, maintainability, extensibility, flexibility, and integrity.
    • Provide technical leadership and mentorship to team members.
    • Leads peer development and code reviews with focus on test driven development and Continuous Integration and Continuous Development (CICD).

    Requirements

    • Bachelor’s degree in computer science, information systems, data science, management information systems, mathematics, physics, engineering, statistics, economics, and/or a related field required.
    • Master’s degree in computer science, information systems, data science, management information systems, mathematics, physics, engineering, statistics, economics, and/or a related field preferred.
    • Minimum of eight (8) years of experience as a data engineer with full-stack capabilities
    • Minimum of ten (10) years of Experience in programming
    • Minimum of five (5) years in Cloud technologies like Azure, Aws or Google.
    • Strong SQL Knowledge
    • Experience in ML and ML Pipeline a plus
    • Experience in real-time integration, developing intelligent apps and data products.
    • Proficiency in Python and experience with CI/CD practices
    • Strong background in IAAS platforms and infrastructure
    • Hands-on experience with Databricks, Spark, Fabric, or similar technologies
    • Experience in Agile methodologies
    • Hands-on experience in the design and development of data pipelines and data products
    • Experience in developing data ingestion, data processing, and analytical pipelines for big data, NoSQL, and data warehouse solutions.
    • Hands-on experience implementing data migration and data processing using Azure services: ADLS, Azure Data Factory, Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks Azure Data Catalog, Cosmo Db, ML Studio, AI/ML, etc.
    • Extensive experience in Big Data technologies such as Apache Spark and streaming technologies such as Kafka, EventHub, etc.
    • Extensive experience in designing data applications in a cloud environment.
    • Intermediate experience in RESTful APIs, RESTful APIs, messaging systems, and AWS or Microsoft Azure.
    • Extensive experience in Data Architecture and data modeling
    • Expert in data analysis and data quality frameworks.
    • Knowledgeable with BI tools such as Power BI and Tableau.