Data Engineer II

Overview DetailPage.com helps Amazon brands grow organic traffic through content optimization and market segment share insights, using a patented (US Patent No. 12,093,340), AI-assisted process to identify high-traffic keywords and rewrite product content for sustainable organic growth. We're looking for a Data Engineer to build and optimize scalable data pipelines, support our ETL/ELT and API processes, and keep data flowing seamlessly across our organization and to our end users — working closely with engineering, analytics, and product. What you'll do Design, develop, and maintain scalable data pipelines using a variety of AWS servicesWork with relational databases such as Aurora (PostgreSQL), Redshift, and AWS Glue for large-scale data managementDevelop and optimize ETL/ELT processes for smooth data integration from multiple sourcesCollaborate with cross-functional teams to ensure data accessibility and integrity across platformsUse Python, SQL, and Pandas for data manipulation, analysis, and workflow automationImplement unit testing (PyTest) to ensure code reliabilityManage API integrations and development using FastAPIAssist with infrastructure as code (IaC) using CDK and TerraformBuild CI/CD pipelines in Jenkins What we're looking for SQL mastery – expertise in complex SQL queries and database optimization2-3 years of experience in Data Engineering with AWS and PythonLinux proficiency – comfortable with shell scripting, common CLI tools, and building/testing Linux-based Docker imagesAdvanced Python – strong hands-on experience, ideally with Data Engineering tools like PySpark, Pandas, and SQLAlchemyGit proficiency – comfortable with version control, branching, and collaborationETL/ELT experience – proven ability to build and optimize extract, transform, and load processesUnit testing – familiarity with PyTest or similar tools Nice to haves AWS experience with Aurora (PostgreSQL or MySQL), Redshift, Fargate, Lambda, SQS, and IAM, plus tools like Boto3 and the AWS CLIAirflow expertise, particularly AWS Managed Airflow, for scheduling and orchestrating data workflowsAPI development experience with API Gateway and FastAPIInfrastructure as Code experience with CDK or TerraformFamiliarity with caching tools like RedisBasic DevOps knowledge for CI/CD pipelines and dev workflow optimizationFamiliarity with DBT Compensation Compensation and equity details to be finalized by hiring team.