Data Transformation Engineer

Pay Range: $130000 - $150000 / year Our Perks & Benefits:_Comprehensive benefits package including medical, dental, vision, and life insurancePerformance-based bonuses to reward your contributions*Paid time off to recharge and maintain a healthy work-life balanceFlexible work options, including remote and hybrid opportunities, if eligibleRetirement Plan (401k) with company-matched contributionsEducation Advancement, for employees and qualified dependents, via the Confie Enablement Scholarship FundFitness Reimbursement – up to $15/month for gym membershipsInclusive workplace through a strong commitment to Diversity, Equity, and InclusionEmployee Assistance Program – confidential support for personal or professional challenges, at no costExtra Perks – optional plans for disability, hospital indemnity, health advocate program, universal life, critical illness, accident insurance, and even pet insurance PurposeWork under the guidance and supervision of the Director of Enterprise Architecture to build Confie's next-generation Enterprise Data Solutions. Require expertise in implementing and maintaining data solutions on Snowflake data cloud environments that drive critical business insights and operations. Responsible for developing robust data models, creating efficient ELT processes, and optimizing performance to support the organization's data needs Essential Duties & ResponsibilitiesDesign and develop data pipelines, ELT workflows to populate the cloud Data Lake and Data Warehouse on Snowflake with transformation tools (e.g., Coalesce, WhereScape, Azure Data Factory) and replication tools (e.g., Fivetran, Airbyte, etc.)Translate business requirements into technical specifications; establish and define details, definitions, and requirements of applications, components, and enhancementsDesign and develop robust and scalable data pipelines to support data integrations using Snowflake, Coalesce, Python, Airflow, and FivetranDesign and develop Snowflake data objects (tables, views, stored procedures, udf's, etc.)Implement ELT (Extract, Load, Transform) processes using Snowflake's features, such as SnowPipe, Streams, and TasksPerform data cleaning, analysis, and integration using PythonAbility to work with multiple data sources and types (structured/semi-structured/unstructured)Design and implement efficient data models and schemas within Snowflake to support reporting, analytics, and business intelligence needsMonitor and optimize query performance and resource utilization within Snowflake using query profilling, query optimization techniques, and workload management featuresIdentify and resolve performance bottlenecks and optimize data warehouse configurations for maximum efficiencyImplement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on itMonitor data pipelines for timely and accurate completionStay up-to-date with industry trends and advancements in data engineering, continuously improving the team's technical knowledge and skillsOn-call support Qualifications and Education Requirements4+ years of professional experience in data engineering, designing and implementing data pipelines, and building data infrastructure4+ years of strong experience required in Snowflake data cloud and ETL development, including Snowflake procedures, udf's in Python and SQL, streams, tasks, Snowpipe, and working with semi-structured data3+ years of strong experience with Python programming and extensively used frameworks/packages like Snowpark, pandas, numpy, and requests for Data Analysis and integrationSolid understanding of data warehousing concepts, dimensional modeling, and data integration techniques2+ years of strong experience with data integration and transformation tools like Coalesce, WhereScape, and Azure Data FactoryExperience with data quality and observability concepts is a plusBachelor's degree in Computer Science, Engineering, or a related fieldSnowflake Advanced Certification is a plusAdditional certifications related to data platforms are a plus Other DutiesThis job description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice Notice As permitted by applicable law and from time-to-time, Confie may use a computer system that has elements of artificial intelligence to help make decisions about your employment, including recruitment, hiring, renewal of employment, or the terms and conditions of your employment. Employees with questions about Confie’s use of these computer systems should contact Human Resources at employeerelations@confie.com