Azure Databricks handson Architect
Must Have Skills
- Strong experience in designing and developing data pipelines and ETL workflows using Azure Databricks
- Expertise in Apache Spark, PySpark, Scala, and SQL for large-scale data processing
- Handson experience with Delta Lake and Lakehouse architecture
- Experience in building scalable, optimized, and performant data pipelines
- Strong understanding of data modeling, data integration, and big data processing frameworks
- Knowledge of Azure ecosystem, including ADLS, ADF, Synapse
- Experience with data governance, security, and data quality frameworks within Databricks
- Experience monitoring, troubleshooting, and optimizing Databricks workloads and performance
- Experience working with cross-functional teams for integrating data solutions
- Proven experience in architectural design and data engineering strategy planning
Nice To Have Skills
- Experience with machine learning workflows on Databricks, MLflow, and model deployment
- Familiarity with Unity Catalog, data lineage, and governance frameworks
- Exposure to CI/CD, DevOps, and orchestration tools like Airflow, Azure DevOps
- Knowledge of streaming frameworks like Kafka and Structured Streaming
- Experience with BI tools such as Power BI
- Domain exposure in Insurance and Financial Services
- Experience in evaluating and adopting emerging data engineering tools and technologies
Qualifying Questions
- Can you describe your experience in designing end-to-end data pipelines using Azure Databricks Bronze-Silver-Gold architecture? What scale and complexity did you handle?
- How have you optimized performance, cost, compute, and query efficiency in Databricks workloads? Please share a specific example.
- Have you led architecture decisions or mentored teams on Databricks best practices? Can you elaborate on your role and impact?
Other details
Variable Compensation: This position includes a bonus or variable payout component based on individual and organizational performance. Actual compensation within the range will be dependent upon the individual's skills, experience, performance, and internal equity.
Benefits/Perks: Comprehensive Medical Plan Covering Medical, Dental, Vision Short Term and Long-Term Disability Coverage 401(k) Plan with Company match Life Insurance Vacation Time, Sick Leave, Paid Holidays Paid Paternity and Maternity Leave
The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training.
Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting. LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.