Data Engineering Innovator

We are seeking an experienced Data Engineering Innovator to lead the technical evolution of our enterprise data lake.This role combines hands-on development, tactical guidance, team leadership, and partner engagement across our technical team.Key ResponsibilitiesDesign and implement scalable Lakehouse architecture using Delta and Medallion architecture.Elevate data engineering skills through mentorship, collaboration, and exemplification.Develop scalable data pipelines using incremental ingestion and streaming.Buid and maintain data infrastructure with tools like Databricks, Spark, Airflow 2 in an AWS environment.Collaborate with technical teams to transform complex data into actionable insights.Ensure high data quality standards by leveraging best practice approaches.Architect storage layers, metastore/catalog solutions, and performance optimization.Oversee cloud infrastructure in AWS using Terraform.Guide integration of master data management and governance solutions like Datahub.Establish team coding standards and best practices.Requirements:8+ years of experience in data engineering, including senior/lead experience.Expertise in Lakehouse architectures, Delta/Parquet file formats, hive metastore solutions (Glue, Unity Catalog), and ETL processes (Airflow and Databricks).Strong Experience with Python and SQL.Familiarity with Infrastructure as Code (IAC) using Terraform or CloudFormation.Databricks experience.Strong AWS experience.Certified AWS Solutions Architect or Data Engineer preferred.As a Data Engineering Innovator, you will be responsible for driving the technical vision and strategy for our data engineering function.You will lead a team of data engineers to design, build, and maintain our data infrastructure, ensuring it meets the needs of our business.