Sr. Software and Data Engineer (API)
for section headings. Use - for any list of duties/requirements/benefits. Use
for prose.
We must not repeat job title as heading. Do not put Job ID etc. Remove boilerplate.
We need to preserve all substantive info. So we need to include About the role (the paragraph after "About Your Role:"), Responsibilities (list), Qualifications (list), Benefits (list maybe), Pay (salary range), Schedule (office hours). Ensure we only include sections if posting has real specific content.
We need to format responsibilities as list items. The responsibilities paragraph includes many sentences separated by line breaks? It's a paragraph with many responsibilities separated by line breaks? Actually it's a block: "Design, develop, and maintain high-performance RESTful APIs that handle large-scale data operations with optimal efficiency and minimal latencyStay current with emerging API technologies, standards, and best practices, including GraphQL, gRPC, OpenAPI 3.0+, and modern authentication/authorization frameworksImplement performance optimization strategies for APIs, including caching, rate limiting, pagination, and asynchronous processing, to ensure scalability and reliabilityIntegrate with third-party API vendors and external systems, managing authentication, data transformation, and error handling, and ensuring seamless interoperabilityDevelop comprehensive API documentation using industry standards (Swagger/OpenAPI) and implement robust monitoring, logging, and observability solutionsDesign and implement data privacy features and services to enable secure multi-party collaboration, including query constraints, data clean room construction, deployment, and monitoring at scaleUphold data governance standards and practices, ensuring compliance with data quality standardsImplement and enforce data security measures to protect sensitive data, including personally identifiable information (PII) and financial dataLeverage SQL and Python programming proficiency to extract, transform, clean, and interpret large data volumes (200BIL+ records)Design highly performant data structures to ensure optimal storage and retrieval of dataUtilize advanced database technologies to enhance data storage and processing capabilitiesParticipate in code reviews to maintain code quality and consistency; collaborate with the infrastructure team to plan and execute deploymentsLead and manage integration projects, including: - LiveRamp XMI Integration and Salesforce integration - Additional clean rooms (AWS/AMC) modeling integration - CAPI integrations with walled gardens on behalf of brands - MadConnect integration pipes and buildout - Opening new integration channels based on client demand"
We need to split into list items. Likely each sentence before a capital letter? We can break at each verb phrase. But we can also keep as a single
with each responsibility as - . We'll need to parse manually.
Let's list responsibilities:
1. Design, develop, and maintain high-performance RESTful APIs that handle large-scale data operations with optimal efficiency and minimal latency
2. Stay current with emerging API technologies, standards, and best practices, including GraphQL, gRPC, OpenAPI 3.0+, and modern authentication/authorization frameworks
3. Implement performance optimization strategies for APIs, including caching, rate limiting, pagination, and asynchronous processing, to ensure scalability and reliability
4. Integrate with third-party API vendors and external systems, managing authentication, data transformation, and error handling, and ensuring seamless interoperability
5. Develop comprehensive API documentation using industry standards (Swagger/OpenAPI) and implement robust monitoring, logging, and observability solutions
6. Design and implement data privacy features and services to enable secure multi-party collaboration, including query constraints, data clean room construction, deployment, and monitoring at scale
7. Uphold data governance standards and practices, ensuring compliance with data quality standards
8. Implement and enforce data security measures to protect sensitive data, including personally identifiable information (PII) and financial data
9. Leverage SQL and Python programming proficiency to extract, transform, clean, and interpret large data volumes (200BIL+ records)
10. Design highly performant data structures to ensure optimal storage and retrieval of data
11. Utilize advanced database technologies to enhance data storage and processing capabilities
12. Participate in code reviews to maintain code quality and consistency; collaborate with the infrastructure team to plan and execute deployments
13. Lead and manage integration projects, including:
- LiveRamp XMI Integration and Salesforce integration
- Additional clean rooms (AWS/AMC) modeling integration
- CAPI integrations with walled gardens on behalf of brands
- MadConnect integration pipes and buildout
- Opening new integration channels based on client demand
We could treat the sub-bullets as nested list? But spec says use
- for any list of duties/requirements/benefits. Could embed nested
. We'll keep top-level - for each main responsibility, and for the integration projects we can have a
inside.
Qualifications list: many bullet-like sentences separated by line breaks? Let's extract:
- Extensive experience building production-grade RESTful APIs with proven expertise in API design patterns, versioning strategies, and backward compatibility
- Deep understanding of API performance optimization techniques, including query optimization, connection pooling, request batching, and response compression
- Strong knowledge of modern API technologies and standards, including OpenAPI/Swagger specifications, OAuth 2.0, JWT, GraphQL, and API gateway patterns
- Demonstrated success integrating with external API vendors and managing complex API ecosystems with multiple third-party dependencies
- Experience with API testing frameworks, contract testing, and implementing comprehensive API monitoring and alerting systems
- 6 or more years of experience as a back-end data/software engineer working on various data technologies, with proficiency in SQL, Python, and Javascript (Node.js)
- 2 or more years of hands-on experience with Snowflake ecosystem, including expert knowledge of SnowPipes, Streams, Views, performance tuning, data modeling, ELT pipelines, data visualizations, and standard DWH concepts, and experience implementing complex SQL stored procedures
- Minimum 3 years' experience with various AWS cloud technologies and data lake management such as S3, Lambda, Airflow, Redshift, Athena, and Glue
- Demonstrable knowledge of data clean room technologies (e.g., creating secure data shares using RBAC). Knowledge of Snowflake Native apps (v6+) preferred
- Knowledge of all aspects of the SDLC as well as experience with Jenkins and setting up CI/CD processes
- Experience with security concepts such as CCPA, GDPR, SSO, and JWT
- Proficiency in data access controls, including aggregation constraints, projection policies, row access policies, column masking, and differential privacy; knowledge of data controls including semantic models, dbt, honeydew, Iceberg tables, various catalogs (glue, rest, nessie, hadoop etc), and catalog syncing concepts
- Experience with cloud environments such as SNOWFLAKE, AWS, DATABRICKS, LIVERAMP, and GCP
- Familiarity with BI tools such as Thoughtspot, Sigma, Domo, Looker, Quicksights, Tableau; detailed knowledge of AI concepts such as Generative AI chatbots, cortex analyst, agent training, various LLMs, and prompt engineering
- Experience in modeling: Snowpark ML, TensorFlow
- Expert-level experience building, maintaining, and scaling APIs using Node.js, Express, Fastify, or similar frameworks; proficiency with Swagger/OpenAPI specifications, API documentation tools, Next.js, and modern API development practices
We'll output as - each.
Benefits paragraph: "Benefits for full-time employees of Affinity Solutions begin on the first of the month following your date of hire with a generous employer contribution for medical, dental, and vision. In addition to company paid holidays, wellness time off, other wellness benefits, and employee discounts, you will also get employer paid life insurance and have the option to enroll into an employer-matched 401K Plan. We strongly encourage work/life balance by providing unlimited vacation days, available starting 90 days from your hire date as a team member."
We can turn that into a list? It's prose; we can keep as
. But spec says use
- for any list of duties/requirements/benefits. Benefits is a list? It's not explicitly a list but we could keep as
. It's okay.
Pay: Salary Range: $145,000 – $160,000. We'll make a
maybe under
Pay
$145,000 – $160,000
.
Schedule: Office hours: 9am – 5:30pm. Schedule
9am – 5:30pm
.
Now produce HTML fragment.
We need to ensure no extra text. Output only HTML.
Let's craft:
About the role
Affinity is seeking a highly skilled and experienced Senior Data and Software Engineer I (API) to join our team. In this role, you will be responsible for architecting, building, and maintaining high-performance RESTful APIs that serve as the backbone of our data integration ecosystem. This position requires deep expertise in API development, data technologies, cloud environments, data clean rooms, and modern software engineering practices.
Responsibilities
- Design, develop, and maintain high-performance RESTful APIs that handle large-scale data operations with optimal efficiency and minimal latency
- Stay current with emerging API technologies, standards, and best practices, including GraphQL, gRPC, OpenAPI 3.0+, and modern authentication/authorization frameworks
- Implement performance optimization strategies for APIs, including caching, rate limiting, pagination, and asynchronous processing, to ensure scalability and reliability
- Integrate with third-party API vendors and external systems, managing authentication, data transformation, and error handling, and ensuring seamless interoperability
- Develop comprehensive API documentation using industry standards (Swagger/OpenAPI) and implement robust monitoring, logging, and observability solutions
- Design and implement data privacy features and services to enable secure multi-party collaboration, including query constraints, data clean room construction, deployment, and monitoring at scale
- Uphold data governance standards and practices, ensuring compliance with data quality standards
- Implement and enforce data security measures to protect sensitive data, including personally identifiable information (PII) and financial data
- Leverage SQL and Python programming proficiency to extract, transform, clean, and interpret large data volumes (200BIL+ records)
- Design highly performant data structures to ensure optimal storage and retrieval of data
- Utilize advanced database technologies to enhance data storage and processing capabilities
- Participate in code reviews to maintain code quality and consistency; collaborate with the infrastructure team to plan and execute deployments
- Lead and manage integration projects, including:
- LiveRamp XMI Integration and Salesforce integration
- Additional clean rooms (AWS/AMC) modeling integration
- CAPI integrations with walled gardens on behalf of brands
- MadConnect integration pipes and buildout
- Opening new integration channels based on client demand
Qualifications
- Extensive experience building production-grade RESTful APIs with proven expertise in API design patterns, versioning strategies, and backward compatibility
- Deep understanding of API performance optimization techniques, including query optimization, connection pooling, request batching, and response compression
- Strong knowledge of modern API technologies and standards, including OpenAPI/Sw
for prose. We must not repeat job title as heading. Do not put Job ID etc. Remove boilerplate. We need to preserve all substantive info. So we need to include About the role (the paragraph after "About Your Role:"), Responsibilities (list), Qualifications (list), Benefits (list maybe), Pay (salary range), Schedule (office hours). Ensure we only include sections if posting has real specific content. We need to format responsibilities as list items. The responsibilities paragraph includes many sentences separated by line breaks? It's a paragraph with many responsibilities separated by line breaks? Actually it's a block: "Design, develop, and maintain high-performance RESTful APIs that handle large-scale data operations with optimal efficiency and minimal latencyStay current with emerging API technologies, standards, and best practices, including GraphQL, gRPC, OpenAPI 3.0+, and modern authentication/authorization frameworksImplement performance optimization strategies for APIs, including caching, rate limiting, pagination, and asynchronous processing, to ensure scalability and reliabilityIntegrate with third-party API vendors and external systems, managing authentication, data transformation, and error handling, and ensuring seamless interoperabilityDevelop comprehensive API documentation using industry standards (Swagger/OpenAPI) and implement robust monitoring, logging, and observability solutionsDesign and implement data privacy features and services to enable secure multi-party collaboration, including query constraints, data clean room construction, deployment, and monitoring at scaleUphold data governance standards and practices, ensuring compliance with data quality standardsImplement and enforce data security measures to protect sensitive data, including personally identifiable information (PII) and financial dataLeverage SQL and Python programming proficiency to extract, transform, clean, and interpret large data volumes (200BIL+ records)Design highly performant data structures to ensure optimal storage and retrieval of dataUtilize advanced database technologies to enhance data storage and processing capabilitiesParticipate in code reviews to maintain code quality and consistency; collaborate with the infrastructure team to plan and execute deploymentsLead and manage integration projects, including: - LiveRamp XMI Integration and Salesforce integration - Additional clean rooms (AWS/AMC) modeling integration - CAPI integrations with walled gardens on behalf of brands - MadConnect integration pipes and buildout - Opening new integration channels based on client demand" We need to split into list items. Likely each sentence before a capital letter? We can break at each verb phrase. But we can also keep as a single
- with each responsibility as
- . We'll need to parse manually.
Let's list responsibilities:
1. Design, develop, and maintain high-performance RESTful APIs that handle large-scale data operations with optimal efficiency and minimal latency
2. Stay current with emerging API technologies, standards, and best practices, including GraphQL, gRPC, OpenAPI 3.0+, and modern authentication/authorization frameworks
3. Implement performance optimization strategies for APIs, including caching, rate limiting, pagination, and asynchronous processing, to ensure scalability and reliability
4. Integrate with third-party API vendors and external systems, managing authentication, data transformation, and error handling, and ensuring seamless interoperability
5. Develop comprehensive API documentation using industry standards (Swagger/OpenAPI) and implement robust monitoring, logging, and observability solutions
6. Design and implement data privacy features and services to enable secure multi-party collaboration, including query constraints, data clean room construction, deployment, and monitoring at scale
7. Uphold data governance standards and practices, ensuring compliance with data quality standards
8. Implement and enforce data security measures to protect sensitive data, including personally identifiable information (PII) and financial data
9. Leverage SQL and Python programming proficiency to extract, transform, clean, and interpret large data volumes (200BIL+ records)
10. Design highly performant data structures to ensure optimal storage and retrieval of data
11. Utilize advanced database technologies to enhance data storage and processing capabilities
12. Participate in code reviews to maintain code quality and consistency; collaborate with the infrastructure team to plan and execute deployments
13. Lead and manage integration projects, including:
- LiveRamp XMI Integration and Salesforce integration
- Additional clean rooms (AWS/AMC) modeling integration
- CAPI integrations with walled gardens on behalf of brands
- MadConnect integration pipes and buildout
- Opening new integration channels based on client demand
We could treat the sub-bullets as nested list? But spec says use
- for any list of duties/requirements/benefits. Could embed nested
- . We'll keep top-level
- for each main responsibility, and for the integration projects we can have a
- inside.
Qualifications list: many bullet-like sentences separated by line breaks? Let's extract:
- Extensive experience building production-grade RESTful APIs with proven expertise in API design patterns, versioning strategies, and backward compatibility
- Deep understanding of API performance optimization techniques, including query optimization, connection pooling, request batching, and response compression
- Strong knowledge of modern API technologies and standards, including OpenAPI/Swagger specifications, OAuth 2.0, JWT, GraphQL, and API gateway patterns
- Demonstrated success integrating with external API vendors and managing complex API ecosystems with multiple third-party dependencies
- Experience with API testing frameworks, contract testing, and implementing comprehensive API monitoring and alerting systems
- 6 or more years of experience as a back-end data/software engineer working on various data technologies, with proficiency in SQL, Python, and Javascript (Node.js)
- 2 or more years of hands-on experience with Snowflake ecosystem, including expert knowledge of SnowPipes, Streams, Views, performance tuning, data modeling, ELT pipelines, data visualizations, and standard DWH concepts, and experience implementing complex SQL stored procedures
- Minimum 3 years' experience with various AWS cloud technologies and data lake management such as S3, Lambda, Airflow, Redshift, Athena, and Glue
- Demonstrable knowledge of data clean room technologies (e.g., creating secure data shares using RBAC). Knowledge of Snowflake Native apps (v6+) preferred
- Knowledge of all aspects of the SDLC as well as experience with Jenkins and setting up CI/CD processes
- Experience with security concepts such as CCPA, GDPR, SSO, and JWT
- Proficiency in data access controls, including aggregation constraints, projection policies, row access policies, column masking, and differential privacy; knowledge of data controls including semantic models, dbt, honeydew, Iceberg tables, various catalogs (glue, rest, nessie, hadoop etc), and catalog syncing concepts
- Experience with cloud environments such as SNOWFLAKE, AWS, DATABRICKS, LIVERAMP, and GCP
- Familiarity with BI tools such as Thoughtspot, Sigma, Domo, Looker, Quicksights, Tableau; detailed knowledge of AI concepts such as Generative AI chatbots, cortex analyst, agent training, various LLMs, and prompt engineering
- Experience in modeling: Snowpark ML, TensorFlow
- Expert-level experience building, maintaining, and scaling APIs using Node.js, Express, Fastify, or similar frameworks; proficiency with Swagger/OpenAPI specifications, API documentation tools, Next.js, and modern API development practices
We'll output as
- each.
Benefits paragraph: "Benefits for full-time employees of Affinity Solutions begin on the first of the month following your date of hire with a generous employer contribution for medical, dental, and vision. In addition to company paid holidays, wellness time off, other wellness benefits, and employee discounts, you will also get employer paid life insurance and have the option to enroll into an employer-matched 401K Plan. We strongly encourage work/life balance by providing unlimited vacation days, available starting 90 days from your hire date as a team member."
We can turn that into a list? It's prose; we can keep as
. But spec says use
- for any list of duties/requirements/benefits. Benefits is a list? It's not explicitly a list but we could keep as
. It's okay. Pay: Salary Range: $145,000 – $160,000. We'll make a
maybe under
Pay
$145,000 – $160,000
. Schedule: Office hours: 9am – 5:30pm.Schedule
9am – 5:30pm
. Now produce HTML fragment. We need to ensure no extra text. Output only HTML. Let's craft:About the role
Affinity is seeking a highly skilled and experienced Senior Data and Software Engineer I (API) to join our team. In this role, you will be responsible for architecting, building, and maintaining high-performance RESTful APIs that serve as the backbone of our data integration ecosystem. This position requires deep expertise in API development, data technologies, cloud environments, data clean rooms, and modern software engineering practices.
Responsibilities
- Design, develop, and maintain high-performance RESTful APIs that handle large-scale data operations with optimal efficiency and minimal latency
- Stay current with emerging API technologies, standards, and best practices, including GraphQL, gRPC, OpenAPI 3.0+, and modern authentication/authorization frameworks
- Implement performance optimization strategies for APIs, including caching, rate limiting, pagination, and asynchronous processing, to ensure scalability and reliability
- Integrate with third-party API vendors and external systems, managing authentication, data transformation, and error handling, and ensuring seamless interoperability
- Develop comprehensive API documentation using industry standards (Swagger/OpenAPI) and implement robust monitoring, logging, and observability solutions
- Design and implement data privacy features and services to enable secure multi-party collaboration, including query constraints, data clean room construction, deployment, and monitoring at scale
- Uphold data governance standards and practices, ensuring compliance with data quality standards
- Implement and enforce data security measures to protect sensitive data, including personally identifiable information (PII) and financial data
- Leverage SQL and Python programming proficiency to extract, transform, clean, and interpret large data volumes (200BIL+ records)
- Design highly performant data structures to ensure optimal storage and retrieval of data
- Utilize advanced database technologies to enhance data storage and processing capabilities
- Participate in code reviews to maintain code quality and consistency; collaborate with the infrastructure team to plan and execute deployments
- Lead and manage integration projects, including:
- LiveRamp XMI Integration and Salesforce integration
- Additional clean rooms (AWS/AMC) modeling integration
- CAPI integrations with walled gardens on behalf of brands
- MadConnect integration pipes and buildout
- Opening new integration channels based on client demand
Qualifications
- Extensive experience building production-grade RESTful APIs with proven expertise in API design patterns, versioning strategies, and backward compatibility
- Deep understanding of API performance optimization techniques, including query optimization, connection pooling, request batching, and response compression
- Strong knowledge of modern API technologies and standards, including OpenAPI/Sw
- for any list of duties/requirements/benefits. Benefits is a list? It's not explicitly a list but we could keep as
- each.
Benefits paragraph: "Benefits for full-time employees of Affinity Solutions begin on the first of the month following your date of hire with a generous employer contribution for medical, dental, and vision. In addition to company paid holidays, wellness time off, other wellness benefits, and employee discounts, you will also get employer paid life insurance and have the option to enroll into an employer-matched 401K Plan. We strongly encourage work/life balance by providing unlimited vacation days, available starting 90 days from your hire date as a team member."
We can turn that into a list? It's prose; we can keep as
- for each main responsibility, and for the integration projects we can have a
- for any list of duties/requirements/benefits. Could embed nested