AWS Data Engineer

Há 3 dias


Santo André, São Paulo, Brasil Compass UOL Tempo inteiro
Overview

Descrição da vaga.

Responsabilidades
  • Criação de pipeline de dados para obtenção dos dados com airflow/spark;
  • Implementar controles de acesso e auditoria para proteger dados sensíveis e garantir conformidade com regulamentações;
  • Migrar e integrar dados existentes na nova plataforma, assegurando a continuidade das operações e a integridade dos dados;
  • Performance Tuning: Habilidade em otimizar o desempenho de pipelines de dados, ajustando parâmetros e configurando corretamente os recursos;
  • Monitoramento e Debugging: Capacidade de monitorar e depurar pipelines para identificar e resolver gargalos e problemas de desempenho.
Requisitos
  • Proficiência em SQL;
  • Entendimento de modelagem de dados;
  • Experiência com ETL;
  • Experiência com cloud AWS: Glue, S3, EMR, Lake Formation.
  • Apache Spark, Apache AirFlow, Apache Iceberg;
  • Conhecimento em Python.

Não possui todos os requisitos para a vaga?

Está tudo bem Na Compass UOL, estimulamos o desenvolvimento contínuo de novos talentos e transformamos desafios em oportunidades.

Benefícios

#remote

"remote"

#J-18808-Ljbffr

  • Santo André, São Paulo, Brasil beBeeDataEngineer Tempo inteiro R$180.000 - R$220.000

    Job Role OverviewThis is a Senior Data Engineer position where you will design, implement and maintain robust and scalable data pipelines. The successful candidate will be responsible for enabling efficient data integration, storage and processing across various data sources.The ideal candidate will have strong technical skills in developing and optimizing...

  • ETL + Data Engineer

    2 semanas atrás


    Santo André, São Paulo, Brasil BairesDev Tempo inteiro

    Join to apply for the ETL + Data Engineer - REMOTE WORK | REF# role at BairesDev . At BairesDev, we've been leading in technology projects for over 15 years, delivering solutions to clients like Google and innovative startups in Silicon Valley. Our diverse team of over 4,000 top-tier professionals works remotely on impactful projects worldwide. This role...


  • Santo André, São Paulo, Brasil Nearsure Tempo inteiro

    Microsoft Fabric Data Engineer - Work from home Microsoft Fabric Data Engineer - Work from home 1 day ago Be among the first 25 applicants Join our close-knit LATAM remote team: Connect through fun activities like coffee breaks, tech talks, and games with your team-mates and management. Say goodbye to micromanagement We champion autonomy, open...


  • Santo André, São Paulo, Brasil BairesDev Tempo inteiro

    Join to apply for the Data Platform Engineer - Remote Work | REF# role at BairesDev 1 month ago Be among the first 25 applicants Join to apply for the Data Platform Engineer - Remote Work | REF# role at BairesDev Get AI-powered advice on this job and more exclusive features. At BairesDev, we've been leading the way in technology projects for over 15...

  • Data Engineer

    2 semanas atrás


    Santo André, São Paulo, Brasil BairesDev Tempo inteiro

    Join to apply for the Data Engineer - Remote Work | REF# role at BairesDev At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on...

  • Global Data Engineer

    2 semanas atrás


    Santo André, São Paulo, Brasil beBeeDataEngineer Tempo inteiro US$10.000 - US$15.000

    Join a global team of data professionals to work on projects that drive significant impact worldwide. At our organization, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to clients and collaborate with top talent from around the globe.We're seeking a skilled Data Engineer to join our Development team...

  • Senior ETL and Data Engineer

    2 semanas atrás


    Santo André, São Paulo, Brasil beBeeData Tempo inteiro US$120.000 - US$150.000

    As a seasoned ETL and Data Engineer, you have the opportunity to join our global team where your technical expertise can drive impact. With over 15 years of experience in leading technology projects, we deliver innovative solutions to clients worldwide, including Google. Our diverse team of top-tier professionals works remotely on impactful projects,...

  • Senior Data Developer

    2 semanas atrás


    Santo André, São Paulo, Brasil beBeeDataEngineer Tempo inteiro US$80.000 - US$120.000

    Senior Data Developer OpportunityWe are seeking an experienced Senior Data Developer to join our team. As a key member of our data team, you will be responsible for designing and implementing data solutions that drive business value.Develop complex SQL queries and analyze data to gain insights and inform business decisions.Design and develop new ETL...

  • Data Solutions Specialist

    2 semanas atrás


    Santo André, São Paulo, Brasil beBeeData Tempo inteiro US$114.000 - US$136.000

    We are seeking an expert in data solutions to join our team as a Data Solutions Specialist.Key Responsibilities:Conduct thorough assessments of data scientists and engineers to evaluate their technical skills.Input data from these assessments into our products, contributing to the development of predictive and fair solutions.Collaborate with developers, tech...


  • Santo André, São Paulo, Brasil beBeeElectrical Tempo inteiro US$90.000 - US$120.000

    Data Center Electrical Engineer RoleThis is a challenging position that involves the design, installation, testing, and commissioning of electrical infrastructure for data centers. The role requires strong technical skills and knowledge of electrical systems, as well as excellent problem-solving abilities.