Analista Data Engineer PySpark e Azure

4 semanas atrás


Manaus Pernambuco Brazil 4DF Connect Tempo inteiro

Responsabilidades

  • Desenvolver, manter e otimizar pipelines de dados utilizando PySpark.
  • Automatizar e gerenciar processos de ingestão, transformação e disponibilização de dados.
  • Implementar práticas de versionamento e integração contínua com Azure DevOps.
  • Monitorar a performance das cargas de dados e atuar proativamente na resolução de problemas.
  • Garantir a governança, segurança e qualidade dos dados ao longo de todo o ciclo de vida.

Requisitos Obrigatórios
  • Experiência prática com PySpark (manipulação e transformação de dados em larga escala).
  • Experiência com Azure DevOps (CI/CD, versionamento de código, automação de pipelines).

Conhecimentos Desejáveis (não Obrigatórios)
  • Linguagens de programação: Python, SQL, Scala.
  • Orquestração de pipelines com ferramentas como Apache Airflow, Azure Data Factory ou similares.
  • Armazenamento e processamento de dados em nuvem: Azure, AWS ou GCP.
  • Modelagem de dados (conceitual, lógica e física).
  • Experiência com bancos de dados relacionais (PostgreSQL, SQL Server) e não-relacionais (MongoDB, Cassandra).
  • Conhecimento em Data Lakes, Data Warehouses e arquitetura orientada a dados.
  • Familiaridade com ferramentas de versionamento além do Azure DevOps, como Git/GitHub.
  • Práticas de DataOps, DevOps e CI/CD aplicadas a pipelines de dados.
  • Monitoramento e observabilidade com ferramentas como Datadog, Prometheus, Grafana, entre outras.

A vaga aceita trabalho remoto?

NãoAnalista Pleno de Dados e Planejamento - Mercado EnviosAnalista de Dados de Experiência do Cliente - PEEngenheiro (a) de Dados Júnior | Recife-PE6428 - Analista de Governança de Dados PlenoAnalista de Dados – Pleno e Sênior | DataViz & Cloud | Inglês AvançadoPessoa Analista de Desenvolvimento de Sistemas IIAnalista de Banco de Dados Sênior [Oracle]Visagio Talentos - Estágio: Engenheiro(a) de Dados NEEngenheiro de Dados - Trabalho Remoto | REF#259078

Jaboatão dos Guararapes, Pernambuco, Brazil 6 months ago

Engenheiro de Dados GCP – Júnior | Pleno | Sênior
#J-18808-Ljbffr

  • Manaus, Amazonas, Brasil 4DF Connect Tempo inteiro

    ResponsabilidadesDesenvolver, manter e otimizar pipelines de dados utilizando PySpark. Automatizar e gerenciar processos de ingestão, transformação e disponibilização de dados. Implementar práticas de versionamento e integração contínua com Azure DevOps. Monitorar a performance das cargas de dados e atuar proativamente na resolução de problemas....

  • Data Engineer

    4 semanas atrás


    Manaus, Amazonas, Brasil Insight Global Tempo inteiro

    This position is fully remote and is a contractor (PJ) position. Salary range is 18-25/hr.Required Skills & Experience- 3+ years of experience with Power BI development and engineering (DAX and semantic model development and deployment) - Strong hands on coding ability in PySpark and Python - Professional working experience with Databricks, Fabric, or...

  • Data Engineer

    Há 17 horas


    Manaus, Pernambuco, Brazil FullStack Labs Tempo inteiro

    OverviewJoin to apply for the Data Engineer - Remote - Latin America role at FullStack Labs.1 day ago Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.About FullStackFullStack is the most transparent IT talent network, connecting highly skilled individuals with top global companies and Silicon Valley startups for...

  • Senior Data Engineer

    59 minutos atrás


    Manaus, Amazonas, Brasil beBeeDataEngineering Tempo inteiro R$80.509 - R$114.569

    Data Engineering PositionThis is a challenging role that involves designing and implementing data pipelines using Azure Data Factory. You will work with large datasets to ensure data integrity and quality.Key Responsibilities:Design and implement data pipelines: Utilize Azure Data Factory to create efficient and scalable data pipelines.Develop ETL processes:...

  • Data Science

    3 semanas atrás


    Manaus, Pernambuco, Brazil BairesDev Tempo inteiro

    Data Science / Data Engineer - Remote Work:At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact...


  • Buenos Aires, Espírito Santo, Brazil Netrix Global Tempo inteiro

    Join to apply for the Azure Machine Learning Engineer role at Netrix Global.Netrix Global is seeking a Machine Learning Engineer within the Professional Services – Data Intelligence department. The role involves researching, building, designing, and maintaining artificial intelligence systems responsible for machine learning. The engineer will also serve...


  • Buenos Aires, Espírito Santo, Brazil Ideamine Technologies (Acquired by Netrix Global) Tempo inteiro

    OverviewJoin to apply for the Azure Machine Learning Engineer role at Ideamine Technologies (Acquired by Netrix Global)Get AI-powered advice on this job and more exclusive features.About The OpportunityNetrix Global is looking for a Machine Learning Engineer for the Professional Services – Data Intelligence department. The Machine Learning Engineer acts as...

  • DevOps Engineer – AI

    3 semanas atrás


    Manaus, Pernambuco, Brazil BitLab Tempo inteiro

    Recife BitLab Postado 27 dias atrásFull Job DetailsAbout BitLabBitLab is a modern product and AI studio at the intersection of Medical Technology, Media, Code, and AI. We partner with startups and scale-ups across North America and Europe to launch scalable, impactful platforms—fast.We blend Canadian leadership with a global team to deliver design-first,...


  • Manaus, Pernambuco, Brazil beBeeDataEngineering Tempo inteiro R$90.000 - R$120.000

    Job OpportunityWe are seeking a skilled professional to join our team as a Data Engineer.This role involves integrating directly into our client's team and working alongside their existing designers and engineers on a daily basis.As a Data Engineer, you will be responsible for building and maintaining real-time pipelines using Kafka, and ensuring the smooth...


  • Manaus, Amazonas, Brasil Decskill Tempo inteiro

    Overview Join to apply for the Azure DevOps Engineer role at Decskill . We are looking for an Azure DevOps Engineer for a remote project in Brazil. Decskill was founded in 2014 as an IT Consulting Company and their main mission is to deliver value through knowledge. We enable companies to meet the challenges of the digital world by providing our clients...