Senior Data Engineer
About the role
SpyCloud is on a mission to make the internet a safer place by disrupting the criminal underground. As a Senior Data Engineer at SpyCloud, you will lead the architectural transformation of our data systems, working closely with Product Management, SpyCloud Labs, and Engineering teams.
Responsibilities
- Redesign and modernize data architecture for scalability, performance, and AI-readiness
- Use Databricks/spark to prepare, transform and serve data to customers
- Build and optimize real-time and batch data pipelines using AWS tools (e.g, Lambda, S3, DynamoDB, ECS, EKS, Terraform)
- Design systems to prepare and serve high-quality data for ML models and LLM applications
- Optimize cost and performance of daily data ingestion, transformation, and storage workflows
- Work with Product and Engineering teams to ensure data solutions meet product requirements
- Evaluate and implement modern tooling for data processing, ML data workflows, and observability
- Guide and mentor data engineers, championing best practices and technical excellence
- Ensure operational data quality, security, and reliability across systems
- Lead long-term data architecture planning aligned with company and AI-driven goals
Requirements
- 8+ years of experience in data engineering or closely related disciplines
- 2+ years in a technical leadership or senior engineering role
- Experience building and operating Lakehouse, Databricks, or large-scale distributed data lake architectures in AWS
- Knowledge of distributed systems as it pertains to data storage and computing
- Experience building and managing large Elasticsearch/Opensearch data stores
- Hands on experience building ETL scripts
- Hands-on experience preparing and managing data for machine learning and LLM workflows
- Strong development skills in Python, especially in building data-intensive systems
- Practical experience using DynamoDB and other AWS-native data services at scale
- Effective communication and collaboration across technical and non-technical stakeholders
- Proven ability to mentor and grow engineering talent and lead large-scale initiatives
Nice to have
- Familiarity with AI/ML tools such as SageMaker, LangChain, or vector databases
- Understanding of data governance, privacy, and compliance in AI contexts
- Comfort working in fast-paced environments with evolving product and technical requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or a related STEM field
- C programming language experience
- Go programming language experience
- Experience with password cracking tools
Pay
Base Salary Range: $144,000 – $187,000
The salary range reflects the expected base compensation for a fully qualified candidate at this level based on experience, qualifications, and market data at the time of posting.
Schedule
Flexible and remote-friendly work options
Benefits
U.S.-Based Benefits + Perks (for Full Time Employees):
- 401(k) with Employer Contribution
- Health, Vision, and Dental Insurance
- Health Savings Account (HSA) available with Employer Contribution
- Employer Paid Life, Short-term, and Long-term Disability Insurance
- Generous PTO Plan and 16 paid holidays per year
The U.K.-Based Benefits + Perks (for Full Time Employees):
- Retirement Savings Plan with Employer Contribution
- Employer Provided Private Health Insurance and Healthcare Cashplan
- Employer Paid Life Insurance and Income Replacement
- Generous Holiday Plan and 14 paid holidays per year
About SpyCloud
SpyCloud transforms recaptured darknet data to disrupt cybercrime. Its automated identity threat protection solutions use advanced analytics and AI to accelerate investigations and protect workforce, consumer, and supplier identities from the threats that matter most: authentication bypass, session hijacking, malicious insiders, account takeover, ransomware, and fraud. Its data from malware-infected devices, successful phishes, combolists, and third-party breaches also powers many popular dark web monitoring and identity theft protection offerings. Customers include 7 of the Fortune 10, along with hundreds of global enterprises, mid-sized companies, and government agencies worldwide.
Our Mission
Our mission is to make the internet a safer place by disrupting the criminal underground. Together with our customers and partners, we aim to end criminals' ability to profit from stolen information.
Who We Are
SpyCloud is a place for innovative, collaborative, and problem-solvers to thrive. Individually, we're amazing, but together, we're unstoppable. We celebrate diversity and various perspectives and aim to create an inclusive and supportive environment for all. We are proud to be an Equal Employment Opportunity and Affirmative Action employer of choice.