Azure Databricks Data Engineer

Role Description Azure Databricks Data Engineer Location Rartian NJ Onsite Role Overview We are looking for a highly motivated Data Engineer with strong expertise in Databricks and modern data engineering practices The ideal candidate should have handson experience in building scalable data pipelines notebooks implementing CICD processes and working with Delta Lake technologies The candidate must possess excellent Python programming skills a solid understanding of Unity Catalog and the ability to collaborate effectively within large crossfunctional teams Key Responsibilities Design develop and maintain scalable ETLELT pipelines Notebooks using Databricks Build and optimize data processing solutions using PySpark and Python Implement and manage data governance security and access controls using Unity Catalog Work with Delta Lake features including Delta Sharing Time Travel Change Data Feed CDF and data optimization techniques Develop and maintain CICD pipelines for Databricks deployments using industrystandard DevOps practices Perform performance tuning and optimization of Databricks workloads Collaborate with architects business analysts and stakeholders to understand data requirements and deliver solutions Support production deployments troubleshooting monitoring and performance improvements Follow coding standards documentation and best practices for software development lifecycle SDLC Required Skills Databricks Strong Strong understanding of Databricks architecture and ecosystem Handson experience with Delta Lake Delta Sharing Unity Catalog Structured Streaming Workflow orchestration Performance tuning and optimization Data governance and access management Experience with Medallion Architecture Bronze Silver Gold layers Programming Strong handson coding experience in Python Experience with PySpark for largescale data processing Good understanding of SQL and query optimization DevOps CICD Experience implementing CICD processes for Databricks workloads Familiarity with Gitbased source control and branching strategies Experience with deployment automation tools and DevOps pipelines Data Engineering Concepts ETLELT design patterns Data modeling and data warehousing concepts Data quality monitoring and observability frameworks Good to Have Skills AWS Cloud AWS Glue S3 IAM Lambda Azure Cloud Azure Data Factory ADF Azure Storage Azure Databricks Key Vault Soft Skills Excellent verbal and written communication skills Strong problemsolving and analytical abilities Ability to work effectively in a large global team environment Strong stakeholder management and collaboration skills Selfdriven proactive and able to work independently with minimal supervision" Other Details Actual compensation within the range will be dependent upon the individual's skills, experience, performance and internal equity. Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”): Benefits And Perks Comprehensive Medical Plan Covering Medical, Dental, VisionShort Term and Long-Term Disability Coverage401(k) Plan with Company matchLife InsuranceVacation Time, Sick Leave, Paid HolidaysPaid Paternity and Maternity Leave The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation. Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting. LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.