Jobs · South Carolina

Data Engineer

INSPYR Solutions · Fort Mill, SC · 4 days ago
HybridContract

Key Responsibilities

  • Define, build, test, and implement scalable data pipelines.
  • Design and implement cloud-native data architectures on AWS, including data lakes, data warehouses, and real-time data processing pipelines.
  • Perform data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.
  • Collaborate with development, analytics, and reporting teams to develop data models that feed business intelligence tools.
  • Develop, deploy, and manage AWS Lambda functions written in Python.
  • Develop, deploy, and manage AWS Glue jobs written in Python.
  • Debug and troubleshoot Lambda functions and Glue jobs.
  • Collaborate with other AWS service teams to design and implement robust solutions.
  • Optimize data storage, retrieval, and pipeline performance for large-scale distributed systems.
  • Ensure data security, compliance, and privacy policies are integrated into solutions.
  • Develop and maintain technical documentation and architecture diagrams.
  • Stay current with AWS updates and industry trends to continuously evolve the data architecture.
  • Mentor and provide technical guidance to junior team members and stakeholders.

Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Analytics, or related field.
  • 5+ years of experience in data architecture, engineering, or similar roles.
  • 3+ years programming with Python.
  • 3+ years in an ETL or Data Engineering role building and implementing data pipelines.
  • Strong understanding of design best practices for OLTP systems, ODS reporting needs, and dimensional database practices.
  • Hands-on experience with AWS Lambda, AWS Glue, and other AWS services.
  • Proficient in Python and SQL with the ability to write efficient queries.
  • Experience with API-driven data access (API development experience a plus).
  • Solid experience with database technologies (SQL, NoSQL) and data modeling.
  • Understanding of serverless architecture benefits and challenges.
  • Experience working in agile development environments.
  • Highly self-motivated, detail-oriented, and able to work independently.
  • Strong analytical thinking, problem-solving, and communication skills.
  • AWS certifications (e.g., AWS Certified Data Analytics - Specialty, AWS Certified Solutions Architect) are highly desirable.

Preferred Skills

  • Experience with modern data stack technologies (e.g., dbt, Snowflake, Databricks).
  • Familiarity with machine learning pipelines and AI-driven analytics.
  • Background in DevOps practices and Infrastructure as Code (IaC) using tools like Terraform or AWS CloudFormation.
  • Knowledge of CI/CD pipelines for data workflows.

About INSPYR Solutions

INSPYR Solutions is a national expert in delivering flexible technology and talent solutions. We strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities.

Similar jobs

Data Engineer

Tata Consultancy ServicesMalvern, PA· 6 days ago
Information Technology$120k–$130k/yrapply on ibegin.tcsapps.com

Data Engineer

HarnhamDallas, TX· 6 days ago
Engineering$160k/yrapply on aplitrak.com

Data Engineer

Edgesource CorporationMcLean, VA· 6 days ago
Information Technology$130k–$145k/yrapply on edgesource.com

Data Engineer

Systech FederalMcLean, VA· 6 days ago
Information Technologyapply on careers.systechfederal.com

Data Engineer

TRIMEDXIndianapolis, IN· 1 wk ago
Information Technologyapply on trimedx.wd1.myworkdayjobs.com

Data Engineer

Ryan Companies US, Inc.Minneapolis, MN· 2 mo ago
Information Technology$90k–$113k/yrapply on ryancompanies.wd5.myworkdayjobs.com