Database Developer

What You Will Be Doing

• Design, develop, and maintain robust and scalable data solutions within our data lakehouse architecture, leveraging Apache Iceberg for open table format management.
• Develop and optimize data ingestion, transformation, and curation processes using technologies compatible with Iceberg, Oracle, and Starburst.
• Utilize Starburst (Trino) for high-performance querying and data virtualization across various data sources, including Iceberg tables and Oracle databases.
• Work extensively with Oracle databases for enterprise data management, including schema design, stored procedures, performance tuning, and data integration.
• Collaborate with data architects, data scientists, and business intelligence teams to translate business requirements into technical data models and data solutions.
• Implement and manage ETL/ELT pipelines to move data efficiently between Oracle, data lake storage (e.g., S3, ADLS), and Iceberg tables.
• Ensure data quality, integrity, and security across all data platforms, adhering to data governance standards.
• Perform performance tuning and optimization for queries running on Starburst, Iceberg tables, and Oracle databases.
• Participate in the evaluation and adoption of new data technologies and best practices to enhance our data platform capabilities.
• Troubleshoot and resolve complex data-related issues, ensuring high availability and reliability of data infrastructure.
• Document technical specifications, data flows, data models, and operational procedures.
• Mentor junior team members and contribute to a culture of continuous learning and improvement.

Required Skills & Experience

• Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related technical field.
• 7-10 years of experience in database development or data engineering roles.
• Proven hands-on experience with Apache Iceberg for managing large-scale, high-performance table formats in a data lake context.
• Strong expertise in Oracle database development, including SQL, PL/SQL, schema design, indexing, and performance tuning.
• Experience with Starburst (Trino) for distributed query processing and federated queries across heterogeneous data sources.
• Proficiency in SQL for complex data manipulation, analysis, and optimization.
• Solid understanding of data warehousing concepts, dimensional modeling, and ETL/ELT methodologies.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data storage services (e.g., S3, ADLS, GCS).
• Experience with distributed data processing frameworks (e.g., Apache Spark, Flink).
• Experience with version control systems (e.g., Git).
• Excellent analytical, problem-solving, and communication skills, with the ability to articulate complex technical concepts.