Data Engineer

About the role

Vagaro is seeking a skilled Data Engineer to join our dynamic team and partner with our Data Science, Machine Learning, and Business Intelligence teams to build enterprise-grade data solutions. As a Data Engineer at Vagaro, you will play a critical role in designing and maintaining scalable data architectures on the Microsoft Fabric platform. This role is based onsite in Pleasanton, CA Monday through Friday.

Compensation

• Base Annual Salary: $135,000 to $150,000
• Annual Bonus: Up to 10%

Responsibilities

Data Pipeline Development

• Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and store data from a variety of internal and external data sources.
• Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
• Monitor, troubleshoot, and resolve data pipeline failures and performance issues.
• Develop reusable Python libraries and frameworks to standardize data engineering solutions.
• Build and maintain CI/CD pipelines to automate deployment, testing, and release processes.
• Experience integrating with REST APIs to ingest, transform, and process data from external systems.

Microsoft Fabric Platform

• Design, implement, and maintain enterprise data solutions using the Microsoft Fabric platform.
• Build and optimize Fabric Warehouses, Lakehouses, Semantic Models, and Data Pipelines.
• Define enterprise Fabric architecture, workspace strategy, security model, and governance standards.
• Manage Fabric capacities, optimize compute utilization, and monitor platform health and performance.
• Lead capacity planning, workload isolation, reservation management, and cost optimization across Business Intelligence, Data Engineering, and Machine Learning workloads.
• Implement monitoring, alerting, logging, and operational best practices for Fabric environments.

Data Architecture & Management

• Design and maintain scalable data models and enterprise data architectures.
• Implement data governance, security, lineage, and metadata management best practices.
• Ensure data quality, integrity, availability, and compliance across all data platforms.
• Maintain comprehensive documentation for data pipelines, architectures, standards, and operational procedures.

Collaboration

• Partner with Data Scientists and Machine Learning engineers to provide reliable data infrastructure for model training and deployment.
• Collaborate with Business Intelligence teams to ensure timely and reliable data availability for reporting, dashboards, and analytics.
• Work closely with business stakeholders, analysts, and software engineers to understand requirements and deliver scalable data solutions.

Continuous Improvement

• Evaluate emerging technologies and recommend improvements to the data platform.
• Continuously improve data engineering processes, automation, and operational efficiency.
• Participate in architecture reviews, code reviews, and mentoring to promote engineering best practices.

Requirements

• Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related technical field.
• 3-5 years of experience as a Data Engineer or similar role.
• Experience designing and maintaining enterprise-scale ETL/ELT solutions.
• Hands-on experience with Microsoft Fabric, including data migration projects.
• Strong experience with relational and NoSQL databases.
• Experience building modern cloud-based data platforms in Azure (AWS or GCP experience is also beneficial).
• Experience with DevOps practices, CI/CD pipelines, and Infrastructure as Code.

Skills

• Expert-level SQL.
• Strong Python development skills.
• Experience with PySpark, Pandas, and Spark.
• Strong understanding of data modeling, dimensional modeling, and schema design.
• Experience working with SQL Server, NoSQL (MongoDB, Elasticsearch, etc.), Azure Data Lake Storage, Delta Lake, and Parquet.
• Familiarity with REST APIs and data integration patterns.
• Experience working with large-scale structured and semi-structured datasets.
• Excellent analytical and problem-solving abilities.
• Strong communication and collaboration skills.
• Ability to work independently while collaborating across multiple teams.
• Strong attention to detail and commitment to data quality.

Preferred Qualifications

• Experience with Azure DevOps or GitHub Actions.
• Experience with Docker and Kubernetes.
• Experience implementing monitoring, observability, and alerting for enterprise data platforms.

Benefits

• Generous PTO: 15 accrued days, plus 10 company holidays annually.
• Health & Wellness: Comprehensive healthcare, dental, and vision plans for you and your family.
• Exclusive Perks: Discounts on attractions, theme parks, shows, sports events, movies, hotels, and more through TicketsAtWork.
• Beauty Perks: $30/month reimbursement for any Vagaro service, including health, beauty, or wellness treatments.
• Food Perks: $50 monthly stipend for our onsite microkitchen and a complimentary DoorDash DashPass subscription.
• Growth Opportunities: College Assistance Reimbursement, access to EAP & Work/Life Programs, and a LinkedIn Learning account.
• Financial Security: 401k program with 4% matching and optional life/supplemental insurance.
• Stay Active: Access to our on-site gym, flavored water dispenser, and basketball court.