Lead Data Engineer
4 semanas atrás
Lead Data Engineer Description
We are looking for a highly experienced Lead Data Engineer to lead and guide the technical evolution of our enterprise data lake. This role will combine hands-on development, tactical guidance, team leadership, and partner engagement across our technical team.
English fluency is a MUST for this role Only candidates with level C1 or C2 will be considered:
A1 Beginner
A2 Elementary
B1 Intermediate
B2 Upper-Intermediate
C1 Advanced
C2 Proficient
Responsibilities
Lead the implementation of scalable Lakehouse architecture using Delta and medallion architecture
Elevate data engineering skills across our team through mentorship, collaboration, and exemplification.
Lead development of scalable data pipelines using incremental ingestion and streaming
Build and maintain data infrastructure with tools like Databricks, Spark, Airflow 2 in an AWS environment
Collaborate closely with technical teams across the enterprise to help us transform complex data into actionable insights
Ensure high data quality standards by leveraging best practice approaches
Help architect storage layers, metastore/catalog solutions, and performance optimization
Oversee cloud infrastructure in AWS using Terraform, with a deep understanding of services like S3, IAM, KMS, Glue, Athena, Redshift, SNS/SQS, MSK, and Kinesis.
Help guide the integration of master data management and governance solutions like Datahub to track the health, lineage, and meaning of data across the enterprise
Help establish team coding standards and best practices.
Help refine development and operational processes to drive consistent, predictable quality
Participate in our on-call schedule to help us ensure availability of critical data services
Provide technical leadership on DevOps, security, and deployment strategies for AI/ML models
Requirements
8+ years of experience in data engineering, including senior/lead experience
Expertise in Lakehouse architectures, Delta/Parquet file formats, hive metastore solutions (Glue, Unity Catalog), and ETL processes (Airflow and Databricks)
Strong Experience with Python and SQL
Strong proficiency in data modeling (OLTP/OLAP)
Strong experience working with AWS cloud infrastructure services
Familiarity with Infrastructure as Code (IAC) using Terraform or CloudFormation
Databricks experience
Strong AWS experience. Certified AWS Solutions Architect or Data Engineer preferred.
Bachelor’s degree in computer science, Information Systems, Data Science, Mathematics, or similar fields, or equivalent experience
-
Chromatography Field Service Engineer
2 semanas atrás
Anápolis, Brasil Agilent Technologies, Inc. Tempo inteiroChromatography Field Service Engineer - Anápolis (GO) page is loaded## Chromatography Field Service Engineer - Anápolis (GO)locations: Brazil-Remote Locationtime type: Full timeposted on: Posted Todayjob requisition id: ## **Job Description**Responsible for supporting customers through on-site activities such as installation, implementation, maintenance,...
-
Senior Azure Cloud Engineer
1 dia atrás
anápolis, Brasil HCLTech Tempo inteiroAbout HCLTechHCLTech is a global technology company, spread across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing,...
-
Video Ad Copywriter
Há 3 dias
Anápolis, Brasil Property Leads Tempo inteiroAbout the Role Property Leads is a fast-growing real estate lead generation and data company. We're looking for a Paid Media Ad Copywriter who can craft high-performing copy across multiple digital channels. This role blends creative storytelling with performance marketing expertise, you'll write, test, and optimize ad copy that drives engagement and lead...
-
Content Editor/Author/Writer
1 semana atrás
Anápolis, Brasil Innodata Inc. Tempo inteiroContent Editor/Author/Writer – Innodata Inc.We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance.Key ResponsibilitiesConduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).Evaluate and...
-
Content Editor/Author/Writer
2 semanas atrás
Anápolis, Brasil Innodata Inc. Tempo inteiroContent Editor/Author/Writer – Innodata Inc. We are seeking highly analytical and detail‑oriented professionals with hands‑on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. Key Responsibilities Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs). Evaluate and...
-
Anápolis, Brasil Como Pessoa Consultora Comercial Você Vai: Tempo inteiroJob type: Full-time employee Full-time employeeSomos o grupo educacional mais diversificado do país.Todos os dias, criamos futuros incríveis através da inovação.Colocamos a mão na massa para tirar as ideias do papel e colocá-las em prática.Enfrentamos desafios com resiliência e nos adaptamos às mudanças constantes.Por aqui, somos um time e não...
-
Estagiário Comercial 100% Remoto
Há 3 dias
Anápolis, GO, Brasil SAAM Auditoria Tempo inteiroSobre a empresa: Somos a SISAUDCON! Fundada em 2011 na cidade de Anápolis/GO. Somos a detentora dos direitos de desenvolvimento e inteligência do sistema SAAM Auditoria. Buscamos e oferecemos inovação em soluções tecnológicas no âmbito fiscal e contábil. Sobre a vaga: O estagiário irá desempenhar um papel ativo no processo de vendas, realizando...
-
Pessoa Analista Controle Materiais Jr
2 semanas atrás
Anápolis, Brasil Brainfarma Tempo inteiroBuscamos talentos que possam transformar possibilidades em realidade, que contribuam para nos manter como a melhor e mais completa empresa farmacêutica brasileira, participando da vida das pessoas para que elas vivam mais e melhor. Todas as nossas vagas estão abertas para Pessoas com Deficiência (PCD's). Você não se identificou com essa vaga? Não se...
-
Pessoa Consultora Comercial Graduacao Ii
2 semanas atrás
Anápolis, Brasil Cogna Educação Tempo inteiroSomos o grupo educacional mais diversificado do país. Todos os dias, criamos futuros incríveis através da inovação. Colocamos a mão na massa para tirar as ideias do papel e colocá-las em prática. Enfrentamos desafios com resiliência e nos adaptamos às mudanças constantes. Por aqui, somos um time e não heróis, guiados pela vontade de fazer a...
-
Senior Software Architect
Há 4 dias
Anápolis, GO, Brasil Specialty Capital Tempo inteiroAbout Specialty Capital Specialty Capital was founded just four years ago with a bold idea - to give "debanked" small businesses access to capital that's Simple, Smart, and Reliable. Today, the company is among the top revenue-based finance companies in the U.S., serving thousands of merchants through a combination of speed, technology, and a deeply human...