Technology Lead | Big Data - Data Processing | Spark

About the role

Strong expertise in Databricks, Apache Spark, Scala, Advanced Python, and SQL, with extensive hands-on development experience. Proven experience in Healthcare AI and Generative AI (GenAI) solution development, including processing and analyzing both structured and unstructured healthcare data. Skilled in designing, developing, and implementing scalable data engineering and AI-driven solutions to address complex healthcare business requirements.

Responsibilities

• Design, develop, and implement scalable data engineering and AI-driven solutions for healthcare use cases
• Process and analyze structured and unstructured healthcare data using Spark and related technologies
• Leverage Databricks, Spark, Scala, AWS, Hive, GCP, and Snowflake to build robust data pipelines

Requirements

• Must Have Skills: Databricks, Spark, Scala, AWS, Hive, GCP, Snowflake
• Nice to Have Skills: OpenAI APIs, LangChain, LangGraph, LlamaIndex, RAG
• Minimum Years of Experience: 8–10 years

Work arrangement

Hybrid work set-up in Richardson, TX 75082