Spark Data Engineer

Há 3 dias


Remoto, Brasil Compass Uol Tempo inteiro

.

Responsabilidades e atribuições

  • Analisar rotinas SAS legadas;
  • Atuar na reescrita e adaptação dos programas SAS para tecnologias do ecossistema de dados;
  • Executar testes necessários, identificando inconsistências e efetuando a correção;
  • Atuar no processo de validação funcional e técnica, comparando resultados entre o legado SAS e a nova implementação.

Requisitos e qualificações

  • Experiência sólida com Python para processamento de dados;
  • Conhecimento prático em Spark para manipulação de grandes volumes de dados;
  • Domínio de SQL para consultas, transformações e validações de dados.
  • Desejáveis: Experiência com serviços AWS (S3, Athena, Glue, Lambda e Step Functions), orquestração de cargas batch com Control-M, versionamento de código com Git/GitHub, atuação em ambiente Linux, uso de Terraform para infraestrutura como código (IaC) e vivência em ambientes ágeis, incluindo ferramentas como Agile Cockpit.

Compass UOL is a global firm and part of the AI Revolution Company, together transforming organizations using Artificial Intelligence, Generative AI, and other of today's most advanced technologies.

We equip our team with proprietary and external AI-driven tools to design and build digital-native platforms, integrating cutting-edge technologies and enabling companies to innovate, transform their businesses, and drive success in their markets.

To achieve this, we attract and develop the best talent, creating opportunities that enhance people's lives and highlight the positive impact of disruptive technologies.

We empower borderless talent and promote knowledge and opportunities in the latest market trends, driving significant personal and professional growth.

Join us and be part of the AI-driven revolution.


  • Senior Data Engineer

    8 minutos atrás


    Remoto, Brasil Meta IT Tempo inteiro

    What We're Looking ForWe are seeking a Senior Data Engineer with strong expertise in AWS and Big Data environments to lead the design and implementation of scalable Data Warehouse and Data Lake solutions. This role requires a hands-on technical leader who will serve as a reference in Data Analytics initiatives, ensuring performance, quality, and security...

  • Senior Data Engineer

    1 minuto atrás


    Remoto, Brasil Ci&T Tempo inteiro

    We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.With over 8,000 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.Hey everyone This is Thai Viapiana from CI&T's Talent Attraction Team :) We are looking...


  • Remoto, Brasil Compass Uol Tempo inteiro

    .Responsabilidades e atribuições Atuar na migração e evolução da Camada Gold;Desenvolver e otimizar pipelines no Databrick;Implementar modelagem dimensional para analytics e B;Garantir a qualidade, governança e consistência dos dados na Camada Gol;Atuar em conjunto com times de negócio e BI para definição e evolução dos modelos...

  • Data Tech Lead

    1 minuto atrás


    Remoto, Brasil Ci&T Tempo inteiro

    We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.With over 8,000 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.We are looking for a highly skilled Data Tech Lead with focus on Databricks to lead the...

  • Analytics Engineer

    9 minutos atrás


    Remoto, Brasil Dadosfera Tempo inteiro

    Company OverviewDadosfera is transforming the data landscape with a platform that delivers advanced Data, AI, and Analytics capabilities—previously available only to tech giants like Meta, Amazon, Alphabet, and Microsoft—into the hands of small and medium-sized businesses. By democratizing access to these technologies, we empower our clients to...

  • Software Engineer ID45371

    1 minuto atrás


    Remoto, Brasil AgileEngine Tempo inteiro

    Important: after confirming your application on this platform, you'll receive an email with the next step: completing your application on our internal site, LaunchPod. So keep an eye on your inbox and don't miss this step — without it, the process can't move forward.About the roleJoin our ambitious team as a Senior Software Engineer specializing in Data...

  • Senior Data Engineer, Brazil

    9 minutos atrás


    Remoto, Brasil Ci&T Tempo inteiro

    We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.With over 8,000 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.Position Overview:As a Senior Data Engineer, you will be leading the design,...

  • Data Engineer

    Há 2 dias


    Remoto, Brasil Compass Uol Tempo inteiro

    .Responsabilidades e atribuições Garantir a execução estável e controlada das rotinas de dados, assegurando que os pipelines de ingestão, transformação e disponibilização de dados sejam executados conforme o planejado;Identificar incidentes, analisar, comunicar e tratar dentro do SLA;Manter o ambiente íntegro e disponível para consumo analítico...


  • Remoto, Brasil Pantheon Tempo inteiro

    Atividades / ResponsabilidadesGerenciar e prestar suporte à ferramenta de modelagem de dados ER/Studio.Administrar servidores on-premises e em nuvem.Realizar monitoramento de ambientes (local e cloud) utilizando Datadog.Apoiar iniciativas de automação de processos para ganho de eficiência operacional.Atuar em melhorias contínuas de observabilidade,...

  • AI Engineer

    9 minutos atrás


    Remoto, Brasil Onebridge Tempo inteiro

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...