DATA ENGINEER I
C2Q Health Solutions · Queens, NY · 5 days ago
Information Technology$80k–$90k/yrFull-time
About the Role
The Data Engineer will play a pivotal role in designing, developing, and maintaining the data architecture for our organization. This individual will be responsible for T-SQL development, ETL processes, and Python scripting to ensure efficient data transfer, transformation, and integration. The primary focus will be on automating data workflows, supporting diverse file formats, and utilizing APIs for seamless data import and export. The Data Engineer will collaborate closely with cross-functional teams to enhance data-driven decision-making and contribute to the overall success of our data infrastructure.
Responsibilities
- Utilize advanced T-SQL skills to design, optimize, and maintain database structures.
- Develop complex SQL queries for reporting and data transformation.
- Design, implement, and optimize ETL processes for efficient data extraction, transformation, and loading.
- Develop and maintain ETL scripts using Python for seamless integration with existing data workflows.
- Automate SFTP file transfer processes, ensuring secure and reliable data exchange.
- Import and export data and files in various formats, including flat file, XML, JSON, X12, Excel, and Parquet using Python.
- Utilize Python to integrate with APIs for importing and exporting data.
- Collaborate with team members and stakeholders to review and optimize code for efficiency and maintainability.
- Collaborate with analysts and business stakeholders to understand data visualization requirements.
- Work closely with cross-functional teams to understand data requirements and ensure data integrity.
- Document data engineering processes, standards, and best practices.
- Use Git and GitHub for version control of scripts and queries, ensuring a collaborative and organized development environment.
- Integrate Tableau for effective data representation and reporting.
Requirements
- Bachelor's Degree in Computer Science, Information Technology, or a related field.
- One to four (1-4) years of hands-on experience in T-SQL development and ETL processes.
- Proven experience in Python scripting for data manipulation and automation.
- Experience in data visualization using Tableau.
- Strong problem-solving skills and ability to troubleshoot data-related issues effectively.
- Identify and implement solutions to complex technical projects.
- Ability to work independently and in a team environment.
- Excellent communication and collaboration skills.
- Knowledge of health care delivery and operations is a plus.
Skills
- Strong expertise in database design, optimization, and maintenance using T-SQL.
- Proficient in developing and optimizing ETL processes.
- Experience with automating SFTP file transfers and handling diverse file formats.
- Knowledge of data formats such as XML, JSON, Excel.
- Proficient in version controlling scripts and queries using Git and GitHub.
Physical Requirements
- Standing – Duration of up to 6 hours a day.
- Sitting/Stationary positions – Sedentary position in duration of up to 6-8 hours a day for consecutive hours/periods.
- Lifting/Push/Pull – Up to 50 pounds of equipment, baggage, supplies, and other items.
- Bending/Squatting – Ability to safely bend or squat to perform essential functions.
- Stairs/Steps/Walking/Climbing – Must be able to safely maneuver stairs, climb up/down, and walk to access work areas.
- Agility/Fine Motor Skills – Must demonstrate agility and fine motor skills to operate equipment, devices, instruments, and tools.
- Sight/Visual Requirements – Must be able to visually read documentation and type/write with accuracy.
- Audio Hearing and Motor Skills – Must be able to listen attentively and speak clearly for effective communication.
- Cognitive Ability – Must demonstrate good decision-making, reasoning, and analytical skills.
Pay
Salary Range: $80,000.00 - $90,000.00
Schedule
- Monday - Friday
- 8:30 AM – 5:30 PM
- Weekly Hours: 40
Location
Flushing, Queens - Hybrid