Sr Data Engineer

Location

Atlanta, GA

Duties and Responsibilities

• Provides industry thought leadership to fellow team members across business and technical project dimensions, solving complex business requirements.
• Proactively considers the future state of the organization and how technology can support these efforts.
• Advocates and defines Marketing Data Engineering vision from a strategic perspective, including internal and external platforms, tools, and systems.
• Maintains overall MarTech industry Data knowledge on latest trends, technology, etc.
• Mentor and develop a team of contingent worker data engineers onsite and offshore.
• Manage and lead a technical team responsible for data engineering and analysis.
• Focusing on individual's professional development as well as overall team health and technical proficiency on their assigned project tasks.
• Conducts product work reviews with team members.
• Serves in the development of team members by actively facilitating new learning opportunities and experiences in the Data Engineering space.
• Design and implement scalable data solutions on Azure platform using Data Factory, Databricks, PySpark, Python and other related services.
• Build data pipelines and workflows to ingest, transform, and load data from various sources.
• Develop and maintain data models and schemas for efficient data storage and retrieval.
• Develop and maintain CI/CD pipelines for automated deployment and testing of data solutions.
• Lead development and production deployment of analytic Data and BI products (also potentially pilots and proof of concepts), determining appropriate design strategies and methodologies.
• Collaborate and maintain relationships with cross-functional teams (Cloud Infra, Enterprise Data & IT-SEC) to ensure data solutions meet business requirements.
• Continuously evaluate and recommend new data technologies and approaches to improve data solutions.
• Develop business partnerships and influence priorities by identifying solutions that are aligned with current business objectives and closely follow industry trends; understanding how to apply them and sharing knowledge with coworkers.
• Communicate with partners, describing technology concepts in ways the business can understand, documenting initiatives in a concise and clear manner.
• Partner with Enterprise Data management & information security colleagues to ensure the adherence of Data Governance standards for Client.
• Data Engineering Lead (Marketing) Delivery Management (20%):
• Find creative solutions to challenging problems involving factors with potentially broad implications; reflecting on solutions, measuring impact, and using that information to ideate and optimize.
• Execute data strategies with an understanding of enterprise architecture, consumption patterns, platforms and application infrastructure.
• Stay ahead of the impediments to ensure a smooth, on time and in budget, implementation of Data Projects.
• Collect weekly status updates from Dev teams across multiple Data POD teams and consolidate for leadership project health reporting.
• Work with Dev teams to execute on data strategy and ensure timely delivery of projects.

Work Experience/ Education

• Bachelor's degree in computer science, Information Technology or a related study, or equivalent experience
• 5+ years of hands-on Data Engineering experience with On-Prem and Cloud based Data tools/Platforms, 3+ years of experience in data engineering with expertise specifically in Azure Data Factory, Databricks, PySpark, Python and related services.
• Proven experience in leading and managing technical teams in data engineering and analysis.
• Experience in designing and developing data models and schemas.
• Strong proficiency in programming languages such as Python.
• Experience in developing and maintaining CI/CD pipelines for automated deployment and testing.
• Good understanding of cloud computing and its services (e.g., Azure, AWS, Google Cloud Platform).
• Excellent problem-solving skills and ability to work in a fast-paced environment.
• Experience with the some of the following concepts: Real-time & Batch Data Processing, Workload Orchestration, Cloud, Data lakes, Data Security, Networking, Serverless, Testing / Test Automation (Unit, Integration, Performance, etc.), WebServices, DevOps, Logging, Monitoring, and Alerting, Containerization, Encryption / Decryption, Data Masking, Cost & Performance Optimization
• Skilled leading and/or participating in system design and architectural activities including technical requirement writing experience and ability to lead collaboration sessions for important design reviews and decisions.
• Proven experience succeeding in complex, matrix and cross-functional projects
• Ability to personally deliver large scale initiatives in a fast-paced environment with high levels of complexity and ambiguity
• Experience and comfort managing indirect teams; scrums, agile cross functional teams, vendor stakeholders
• Strong collaboration skills and the ability to work in a team-based environment including employees, vendors and third-party contractors
• Excellent mentoring skills and the desire to contribute to efforts beyond the scope of the day-to-day project work
• Excellent written, presentation and oral communication skills
• Knowledge of technical architecture as a role discipline
• Good to have, but not mandatory: Experience working with Loyalty Management data, and other Marketing business processes data Experience with Campaign Management, Customer Data Platforms, Content Management, Advertising Technology, Personalization Engines as a Solution, etc., Tech Skills: Data Engineering Lead (Marketing) Microsoft Azure Cloud: Azure Data Factory, APIM, Function Apps, Logic Apps, Key Vault, Azure App Insights, Azure SQL, Azure DevOps Databases: Azure SQL, Databricks, MongoDB, DevOps: GitHub, Azure DevOps, CI/CD Pipelines Programming Languages: SQL, PYTHON, SCALA, R API Development: Azure APIM, REST APIs, web services, security such as Oauth2, SAML, IDM, open API standards like swaggers, RAML, developer portal, API Testing: Postman, Log Analytics: Splunk, Dynatrace Web/Mobile App Analytics: Google Analytics, Firebase, Google Tag management Architecture modeling: Lucid Chart, Visio, ARIS, etc., Software development Experience using SaFe Agile methodologies. ACI (Advanced Computing International) is a Global Technology Services, Products & Solutions Company focused on designing and delivering the next generation applications and digital experiences for businesses and consumers. We specialize in Big Data & Analytics, Digital Transformation, IT Service Management, Cognitive Solutions, Artificial Intelligence, IOT & Future Networks, DevOps, Enterprise Applications & Managed Infrastructure Services & Industry Specific Solutions. Leveraging the insights gained from working on innovative solutions and disruptive technologies, ACI develops Solutions to enhance business performance, accelerate product & applications time-to-market, harmonize Consumer Experiences and streamline their business operations. ACI works with clients across different business sectors: Financial Services, Healthcare, Manufacturing, Hi-Tech, Media, Utilities, Public sector, Retail, Telecom, E-commerce & Logistics, and Higher Education. ACI s core DNA is built on Innovation and co-existence to build a collaborative ecosystem where companies and consumers win.