Data Engineer - Databricks

This position is hybrid in Tampa, FL.

About the role

We are seeking a Data Engineer with strong Databricks expertise to modernize and scale our Business Intelligence (BI) capabilities. This role will design and build data pipelines, deploy machine learning solutions, and operationalize intelligent analytics to drive decision-making across the organization. The ideal candidate blends data engineering best practices with applied machine learning, MLOps, and AI.

Responsibilities

• End-to-end data pipelines and integrations
• Advanced SQL optimization and complex query design
• Kafka streaming applications and connector development
• Databricks workflow development with medallion architecture
• Data governance implementation and compliance
• Performance tuning for large-scale data processing
• Data security and privacy best practices
• Apache NiFi pipeline development for invoice and PO processing
• Integration with purpose-built data stores (Druid, MongoDB, OpenSearch, Postgres)
• Build and maintain end-to-end ML pipelines for training, deployment, and monitoring of models
• Design and optimize data architectures for large-scale ML workloads
• Explore and implement LLM-based solutions, RAG architectures, and generative AI for business use cases
• Cross-functional collaboration with product and engineering teams
• Technical mentoring for junior data engineers
• Analytical thinking for complex data problems
• Stakeholder communication for data requirements
• Process improvement and efficiency focus
• Quality mindset for data accuracy and reliability
• Direct communication with data platform vendors
• Evaluate vendor tools for specific data use cases
• Provide technical feedback on vendor product roadmaps
• Coordinate with vendors for data integration projects

Requirements

• Bachelor’s/Master’s in Computer Science, Data Engineering, Statistics, or related field
• 5+ years in data engineering
• 2+ years applying ML in production

Benefits

• Hybrid work
• Employer-matched 401K
• Company-paid medical insurance (option for employee and dependent children)
• Company-paid dental insurance for employee
• Company-paid vision insurance for employee
• Company-paid long and short-term disability
• Company-paid life and AD&D insurance
• 18 paid vacation days a year
• Six paid holidays
• Employee recognition programs
• Holiday bonus
• Incentive compensation
• Community outreach opportunities
• Business casual dress code

About Fintech

Fintech, a pioneering accounts payable (AP) automation solutions provider, has dedicated nearly 35 years to automating invoice processing between retail and hospitality businesses, and their supply chain partners. Backed by leading investors TA Associates and General Atlantic, it stands as a leader in this sector. Its flagship product, PaymentSource®, was first built for the alcohol industry to provide invoice payment automation between alcohol distributors and their customers across all 50 states. Today, it is utilized by over 267,000 businesses nationwide for invoice payment and collection associated with all B2B business transactions. This proven platform automates invoice payment, streamlines payment collection, and facilitates comprehensive data capture for over 1.1 million business relationships. Recognizing operational hurdles, Fintech expanded its payment capabilities to include scan-based trading/consignment selling for its vendors and retailers and built an advanced CRM tool with functionality to fortify vendor, supplier, and distributor field execution, addressing diverse profit center challenges.