Lead AI Automation & Integration Engineer

Location: Remote (US / Anywhere)

About the role

Drive the creation of next-generation automation workflows and intelligent data pipelines for an expanding market intelligence and data analytics platform. This hands-on role invites an experienced integrator to design scalable data extraction systems and deploy custom generative AI agents in a fast-paced environment. If you excel at transforming complex raw datasets into streamlined operational solutions, this opportunity offers high-impact visibility alongside an advanced data team.

Responsibilities

• Design and deploy scalable data extraction pipelines leveraging custom Python scripts and modern web scraping frameworks.
• Build and optimize multi-system automated workflows utilizing low-code/no-code platforms to connect databases, SaaS applications, and internal tools.
• Develop and integrate intelligent generative AI agents to automate analytical tasks, customer interactions, and content workflows.
• Engineer custom Python webhooks, scripts, and RESTful APIs to extend automation capabilities and integrate proprietary backends.
• Manage relational database systems and construct SQL queries to safeguard data integrity across connected systems.
• Monitor, troubleshoot, and fine-tune automated processes and scraping systems to ensure maximum operational uptime.

Requirements

• 5+ years of dedicated experience in API development, web data extraction, and complex systems integration.
• Advanced Python proficiency with proven application in web scraping frameworks (such as Scrapy, Playwright, or BeautifulSoup) and custom API development.
• Demonstrated experience building and maintaining complex, multi-step automations using platforms like Zapier or n8n.
• Hands-on experience implementing generative AI models (OpenAI, Claude) and visual agent orchestration builders, along with chat observability platforms.
• Solid SQL skills and working familiarity with relational databases and enterprise data warehouses (e.g., Snowflake, PostgreSQL).
• Deep comprehension of system integration essentials, including REST APIs, JSON, webhooks, and standard authentication protocols (OAuth2).
• Working knowledge of AWS cloud infrastructure, specifically Lambda, EC2, and S3.

Preferred Qualifications

• Practical background building complete end-to-end conversational AI workflows and production chat applications.
• Familiarity with enterprise web scraping platforms (e.g., Apify) or custom browser extension engineering.
• Experience integrating enterprise CRM platforms, such as Salesforce.
• Familiarity with modern data stack tooling including DBT, Prefect, Docker, and Terraform.

Benefits

• Competitive base salary and performance-driven bonuses.
• Comprehensive medical and dental coverage.
• Flexible remote work arrangements and professional development support.