BI / Data Engineer
Estuate, Inc. · Milpitas, CA · 1 mo ago
Information TechnologyFull-time
About the role
Gather data from multiple sources including databases, spreadsheets, and external sources. Clean and preprocess data to ensure accuracy, completeness, and consistency. Maintain and update data systems and databases to ensure data integrity. Conduct exploratory data analysis (EDA) to identify trends, patterns, and insights. Develop and generate detailed reports, dashboards, and visualizations to communicate findings to stakeholders. Perform advanced statistical analyses to support business decisions and strategies.
Responsibilities
- Implement AI techniques to automate repetitive tasks and improve data processing efficiency
- Develop and implement data validation and verification processes in Incorta
- Ensure accuracy and reliability of data by identifying and addressing data quality issues
- Develop and maintain physical schemas, business schemas, and bridge schemas to organize and simplify data structures in Incorta
- Work with Incorta Formula Builder and manage complex query management
- Monitor Incorta nodes in CMC and Loader in Incorta
- Develop impactful insights and dashboards that illustrate key patterns, findings and predictions from raw data within Incorta
- Work in Cloud data solutions such as Snowflake and Redshift
- Work with Pyspark, Oracle, SAP, and SQL
- Use experience in Pyspark and SQL for data transformation
- Use experience in materialized views, Incorta modeling, data visualization, and business intelligence reporting
- Use knowledge in best practices for migration and performance tuning in Incorta
- Create dashboards that are visually appealing and deliver key insights to the users
- Use experience in end-to-end implementation of the BI solutioning, requirement mapping, finalization of specifications, development, testing and implementation in Incorta
Qualifications
- Master of Science in Computer Science/Engineering, Information Systems/Technology, or related field
- 2 years experience in the job offered, Software Engineer/Developer, Database Engineer/Admin, or related field
Location: Milpitas, CA | Full Time | General Shift