Specialist - Data Engineering
LTM · Rutherford, NJ · 2 mo ago
On-siteEngineeringFull-time
About the role
The Sr. Big DATA Developer will be responsible for developing and maintaining big data solutions using technologies such as Python, Spark, Hadoop, and Tableau. They should have 7+ years of experience working with these technologies and hands-on experience with SQL, Oracle SQL/PLSQL, and Big Data frameworks like Cloudera.
Responsibilities
- Contribute to the development and maintenance of big data solutions using technologies like Python, Spark, Hadoop, and Tableau.
- Develop and maintain SQL scripts for data extraction, transformation, and loading (ETL).
- Implement automating data ingestion solutions using tools like Sqoop, Hive, Impala, and Spark.
- Monitor production systems and troubleshoot issues as needed.
- Collaborate with cross-functional teams to ensure successful project delivery.
Requirements
- Experience with SQL ETL processes.
- Experience with implementing automating data ingestion solutions using Hadoop Sqoop, Hive, Impala, and Spark.
- Experience with Cloudera Big Data frameworks.
- Knowledge of Oracle SQL/PLSQL.
Qualifications
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Proven experience in developing and maintaining big data solutions.
- Strong understanding of data warehousing concepts and practices.
- Excellent problem-solving and analytical skills.
Skills
- Proficient in Python and Spark.
- Hands-on experience with SQL and Oracle SQL/PLSQL.
- Experience with Hadoop, Hive, Impala, and Sqoop.
- Experience with Cloudera Big Data frameworks.
- Ability to troubleshoot and resolve production issues.
Benefits
- Comprehensive Medical Plan
- Dental and Vision Coverage
- Short and Long-Term Disability Coverage
- 401(k) Plan with Company Match
- Life Insurance
- Vacation Time, Sick Leave, Paid Holidays
- Paid Paternity and Maternity Leave