Principal Data Engineer, Signal Processing
PHM Society · Rochester, NY · Yesterday
Information TechnologyFull-time
About the role
Responsible for designing, implementing, and maintaining data pipelines and processing systems to support signal processing initiatives.
Responsibilities
- Develop scalable data processing solutions using Apache Spark and Hadoop
- Collaborate with cross-functional teams to understand business needs and translate them into technical requirements
- Optimize data processing workflows to improve efficiency and reduce latency
- Perform data quality checks and ensure data integrity across all stages of the pipeline
- Implement monitoring and logging mechanisms to track system performance and troubleshoot issues
Requirements
- Bachelor's degree in Computer Science, Electrical Engineering, or related field
- Minimum 5 years of experience in data engineering or similar roles
- Experience with Apache Spark, Hadoop, and other big data technologies
- Strong understanding of data processing concepts and best practices
- Proficiency in Python, Java, or Scala
- Excellent problem-solving and analytical skills
Qualifications
- Experience with cloud platforms such as AWS, Azure, or Google Cloud
- Knowledge of NoSQL databases like Cassandra or MongoDB
- Experience with machine learning and AI tools
- Ability to work independently and manage multiple projects simultaneously
Skills
- Data modeling and design
- ETL processes
- Big data technologies
- Cloud computing
- Machine learning and AI
Benefits
- Competitive compensation package
- Flexible work schedule
- Health, dental, and vision insurance
- 401(k) retirement plan
- Employee discounts on GM products
Pay
Commensurate with experience
Schedule
Full-time