Data Engineer

Key Responsibilities

• Supervise junior members of the data engineering team.
• Guiding, planning, and reviewing the team's work.
• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Extend our machine learning platform by designing tools that interface with cloud services, our current code base, and provide new flexibility in model building.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Python, and AWS.
• Create analytics tools to provide actionable insights into key business performance metrics, as well as supporting the needs of the analytics team.
• Create data-handling tools for analytics and data scientist team members that assist them in building and optimizing our decision-making process.

Ideal Candidate Will Have

• 3+ years of experience in a Data Engineer role.
• Bachelors degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
• Advanced working SQL knowledge and experience working with relational databases (including Postgres and MySQL), query authoring (SQL), as well as working familiarity with a variety of databases.
• Experience building data pipelines, architectures, and data sets from raw, loosely structured data.
• A history of focusing on test driven design and results for repeatable and maintainable processes and tools.
• Experience building processes supporting data transformation, data structures, metadata, dependency, and workload management.
• Experience building processes supporting data transformation, data structures, metadata, dependency, and workload management.
• Experience with message queuing, stream processing, and highly scalable data stores.
• Strong project management and organizational skills and the ability to work independently in a fast-paced, quickly changing environment.
• The ability to keep up with several projects at once and understand the impact of projects within a larger system.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Experience managing junior engineers and guiding a team of engineers through project planning, execution, and quality control stages.
• Experience using the following software/tools: Experience with object-oriented design in Python, Experience with data pipeline and workflow management tools, Experience with AWS cloud services: EC2, RDS, Redshift, Glue, S3.

Additional Pluses

• Strong analytic skills and understanding statistical methodologies.
• Experience building machine learning models.
• Experience handling data from acquisition to usage in models.
• Experience building and maintaining RestAPI systems, Flask apps, and state machines.
• Experience with continuous integration, especially in a data science context.
• Experience with Ruby on Rails.