Data Engineer at Concora Credit

About the Role

We are seeking a Data Engineer with deep expertise in Azure, Databricks, Python, SQL, and distributed data systems to help drive the evolution of our enterprise data platform. This role goes beyond traditional data engineering and focuses on building and governing scalable data solutions that enable analytics, machine learning, AI, and Business Intelligence across the organization. You’ll serve as a technical leader responsible for data platform governance, feature enablement, and engineering best practices while partnering closely with teams across the enterprise to ensure our data ecosystem remains secure, scalable, cost-efficient, and easy to use.

We’re grounded in innovation and entrepreneurship, and we're looking for someone who enjoys solving complex technical challenges, influencing platform strategies, and enabling others to be successful through scalable data solutions and thoughtful governance. At Concora Credit, we put people first, including our customers, partners, and Team Members. Our industry leadership, resilience, and willingness to adapt ensure we can help our partners responsibly say yes to millions more.

Responsibilities

• Help design, develop, and optimize scalable data pipelines and data solutions using Databricks, PySpark, SQL, and Python.
• Help build and maintain reliable data models and ETL/ELT processes that support analytics, business intelligence, machine learning, and AI.
• Help establish and maintain data engineering standards, governance, security, and best practices across the Azure and Databricks platforms.
• Evaluate new Databricks capabilities and recommend adoption strategies, standards, and implementation patterns.
• Monitor, troubleshoot, and optimize data pipelines and platform performance for reliability, scalability, and cost efficiency.
• Partner with cross-functional teams to solve complex data challenges and provide technical guidance on data architecture and engineering best practices.
• Mentor junior engineers and contribute to a culture of technical excellence and continuous improvement.

Requirements

• 3+ years of experience in Data Engineering, Data Platform Engineering, or a related field.
• Strong hands-on experience with Databricks, Apache Spark, PySpark, Python, SQL, Azure Data Lake Storage, and Delta Lake.
• Deep understanding of distributed data processing and large-scale data architectures.
• Strong knowledge of data engineering principles, including:
  • Data modeling
  • ETL and ELT design patterns
  • Data quality and observability
  • Metadata management
  • Data lifecycle management
  • Master Data Management concepts
• Strong understanding of modern table formats and storage architecture.
• Experience with performance optimization techniques.
• Experience implementing CI/CD and infrastructure automation using tools.
• Excellent problem-solving, analytical, and communication skills.
• Ability to operate independently while leading initiatives in a fast-paced, agile environment.
• Passion for building scalable, maintainable, and well-governed data platforms.

Preferred Qualifications

• Experience with Unity Catalog, Databricks Workflows, Delta Live Tables / Spark Declarative Pipelines, Structured Streaming, Kafka or Event Hubs.
• Experience implementing data governance frameworks and cloud security best practices.
• Experience with RBAC, ABAC, data classification, auditing, and compliance controls.
• Experience supporting self-service analytics platforms and integrating Databricks with Power BI or other analytics tools.
• Experience evaluating and adopting emerging cloud and data platform technologies.
• Experience creating engineering standards, reference architectures, and operational best practices for enterprise data platforms.
• Experience building and delivering internal training or enablement programs for technical platforms.

Benefits

• Medical, Dental, and Vision insurance for you and your family
• Paid Time Off (PTO)
• 6 company-observed paid holidays, plus 3 paid floating holidays
• 401k (after 90 days) plus employer match up to 4%
• Pet Insurance for your furry family members
• Wellness perks including onsite fitness equipment, EAP, and access to the Headspace App
• Tuition Reimbursement
• Flexible Spending Accounts
• Life and AD&D Insurance
• Company-paid Long-Term Disability and voluntary Short-Term Disability