Senior Data Engineer
Confluence · Pittsburgh, PA · 1 wk ago
HybridInformation TechnologyFull-time
About the role
The Senior Data Engineer will lead the development and maintenance of complex data systems, ensuring high performance and scalability. They will also be responsible for integrating new data sources and optimizing data pipelines.
Responsibilities
- Design and implement robust data architectures using modern technologies.
- Develop and maintain scalable data pipelines and ETL processes.
- Collaborate with cross-functional teams including data scientists, software engineers, and product managers.
- Optimize data storage solutions to meet business needs.
- Ensure data quality through automated testing and validation processes.
- Contribute to the continuous improvement of data infrastructure.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, or a related field.
- At least 5 years of professional experience as a Data Engineer or similar role.
- Experience with big data technologies such as Hadoop, Spark, and Kafka.
- Strong proficiency in SQL and knowledge of NoSQL databases.
- Hands-on experience with Python, Java, or C#.
- Excellent problem-solving skills and ability to work independently and in a team environment.
- Experience with cloud platforms like AWS, Azure, or Google Cloud.
Qualifications
- Proven track record of delivering high-quality data engineering projects.
- Knowledge of data modeling and database design principles.
- Experience with data warehousing and BI tools (e.g., Tableau, PowerBI).
- Good understanding of data security best practices.
- Ability to communicate technical concepts to non-technical stakeholders.
Skills
- Data Engineering
- Big Data Technologies
- Cloud Computing
- Database Management
- Python
- Java
- C#
- SQL
- NoSQL Databases
- ETL Processes
- Scalability
- Performance Optimization
- Collaboration
- Problem Solving
Benefits
- Competitive salary commensurate with experience.
- Flexible working hours.
- Professional development opportunities.
- Health insurance coverage.
- Employee discounts on technology products.
Pay
Salary range: $80,000 - $120,000 per year, depending on experience.
Schedule
Full-time position, Monday to Friday, 9 AM to 5 PM.