Senior Engineer
Tata Consultancy Services · West Chester, PA · 2 mo ago
Engineering$90k–$120k/yrFull-time
Must Have Technical/Functional Skills
- Snowflake: Deep expertise in Snowflake
- PySpark: Strong hands-on experience using Apache Spark with Python for distributed data processing and transformation
- Database & SQL Knowledge: Advanced proficiency in Teradata
Roles & Responsibilities
- Pipeline Development: Design and implement robust ETL/ELT pipelines using PySpark and SQL to ingest data from diverse sources including APIs, flat files, and relational databases
- Data Modeling: Develop and manage complex data models (e.g., Star/Snowflake schemas) and maintain Fact and Dimension tables within Snowflake
- Performance Optimization: Monitor and tune Snowflake queries and Spark jobs to optimize performance, reduce latency, and manage computational costs
- Data Quality & Integrity: Implement automated data validation frameworks and testing procedures to ensure a "single source of truth" and high data reliability
- Operations: Troubleshoot production pipeline issues, manage version control via Git
Education
BACHELOR OF COMPUTER SCIENCE
Benefits
- Discretionary Annual Incentive
- Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans
- Family Support: Maternal & Parental Leaves
- Insurance Options: Auto & Home Insurance, Identity Theft Protection
- Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement
- Time Off: Vacation, Time Off, Sick Leave & Holidays
- Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing
Pay
$90000 - 120000 a year
This response is AI-generated, for reference only.