BI Data Engineer
Crane ChemPharma & Energy · The Woodlands, TX · 1 wk ago
Business DevelopmentFull-time
Principle Duties
- Create ETL routines including writing code for transformations and processes that move data from specified sources, transform it as required, and write it into the data mart.
- Maintain and provide enhancements to data architecture within new/existing systems including Data Warehouse.
- Recommend and implement processes to improve data quality, data reliability, and database performance.
- Employ various ETL and integration tools for system and data integrations.
- Architect solutions that support data scientists and business stakeholders.
- Conduct ETL testing and data transformation testing.
- Develop data models for data science team that can be utilized for data mining.
- Maintain source to target documentation and process flow documentation.
- Ability to serve as SQL Server DBA – Processes/Job/Error Handling/Troubleshooting/Scheduling, etc.
- Create and enhance data solutions enabling seamless delivery of data and is responsible for collecting, parsing, managing, and analyzing large sets of data.
- Translate data access, transformation, and movement requirements into functional requirements and mapping designs.
- Ensure data quality.
- Oversee the complete lifecycle of data integration: analysis, design, implementation, and actively engage with the business on using the data to make decisions.
- Architect data flows, build out data pipelines, and implement complex analytics while ensuring the highest standard of data integrity.
- Perform advanced quantitative and statistical analysis of large datasets to identify trends, patterns, and correlations that can be used to improve business performance.
- Translate business requirements into data models to manage data within the organization, using sound technical expertise.
- Work with the IT Operations team and BI Vendor to resolve any production issues.
- Manage stakeholder demand and backlog of reporting requirements and needs.
- Manage relationships with key vendors to plan and adapt the Data Platform roadmap and best leverage the capabilities that we have.
- Monitor usage of the Data Platform and work with users to deprecate reports and data sets that are not needed and create a continuous improvement model for the data.
- Actively work with users to understand data issues, trace back data lineage, and help the business put appropriate data cleansing and quality processes in place.
- Monitor and report on the uses of emerging technologies, and seek areas for continuous improvement.
- Prescribe and doggedly follow CBS processes and toolkits to achieve operational excellence.
- Submit Weekly Report to update on the progress of assigned tasks.
- Follow project charge from IT Leader.
- Ensure compliance with IT policies and regulations.
Essential Qualifications / Experience
- BS or MS degree in Computer Science or a related technical field.
- 4+ years of experience with ETL Development, Testing, Maintenance and Troubleshooting.
- 4+ years of SQL experience (No-SQL experience is a plus).
- 4+ years of experience with data cleansing and preparation.
- Strong understanding of data analysis, data and process modelling, and relational database concepts.
- Experience designing, building, and maintaining data processing systems.
- Database Development (tables, relationships, indexes, stored procedures, functions, jobs, agents, etc.).
- 3rd Party System Integrations/API programming.
- Agile (methodologies and practical application).
- Continuous Integration/Continuous Deployment (methodologies and practical application).
- New System Installations (Server Setup, Configuration, Testing, Deployment).
- System Migrations (i.e., On-Premise to Cloud).
- Willingness to travel to domestic/international Crane or customer locations, with up to 25% travel at peak-times.
Desirable Qualifications / Experience
- Knowledge of best practices and IT operations in an always-up, always-available service.
- Proven Business intelligence and data experience gained in previous roles.
- Previous experience of meeting the visualization, reporting and analytics needs of key business functions through development of presentation and data models.
- Working closely with business management teams to understand their requirements and data.
- Define and develop data sets, models and cubes.
- Data Warehouse Design/Development - ETLs, Data Modeling, Advanced Data Management Techniques.
- Working knowledge of SalesForce data structures.
- Experience with or knowledge of Agile Software Development methodologies.
- Excellent problem solving and troubleshooting skills.
- Process oriented with great documentation skills.
- Excellent oral and written communication skills with a keen sense of customer service.
- Experience presenting to stakeholders.