Analista Data Engineer PySpark e Azure

1 semana atrás

Manaus, Brasil 4DF Connect Tempo inteiro

ResponsabilidadesDesenvolver, manter e otimizar pipelines de dados utilizando PySpark. Automatizar e gerenciar processos de ingestão, transformação e disponibilização de dados. Implementar práticas de versionamento e integração contínua com Azure DevOps. Monitorar a performance das cargas de dados e atuar proativamente na resolução de problemas. Garantir a governança, segurança e qualidade dos dados ao longo de todo o ciclo de vida. Requisitos ObrigatóriosExperiência prática com PySpark (manipulação e transformação de dados em larga escala). Experiência com Azure DevOps (CI/CD, versionamento de código, automação de pipelines). Conhecimentos Desejáveis (não Obrigatórios)Linguagens de programação: Python, SQL, Scala. Orquestração de pipelines com ferramentas como Apache Airflow, Azure Data Factory ou similares. Armazenamento e processamento de dados em nuvem: Azure, AWS ou GCP. Modelagem de dados (conceitual, lógica e física). Experiência com bancos de dados relacionais (PostgreSQL, SQL Server) e não-relacionais (MongoDB, Cassandra). Conhecimento em Data Lakes, Data Warehouses e arquitetura orientada a dados. Familiaridade com ferramentas de versionamento além do Azure DevOps, como Git/GitHub. Práticas de DataOps, DevOps e CI/CD aplicadas a pipelines de dados. Monitoramento e observabilidade com ferramentas como Datadog, Prometheus, Grafana, entre outras. A vaga aceita trabalho remoto?Não Analista Pleno de Dados e Planejamento - Mercado Envios Analista de Dados de Experiência do Cliente - PE Engenheiro (a) de Dados Júnior | Recife-PE 6428 - Analista de Governança de Dados Pleno Analista de Dados – Pleno e Sênior | DataViz & Cloud | Inglês Avançado Pessoa Analista de Desenvolvimento de Sistemas II Analista de Banco de Dados Sênior (Oracle) Visagio Talentos - Estágio: Engenheiro(a) de Dados NE Engenheiro de Dados - Trabalho Remoto | REF# Jaboatão dos Guararapes, Pernambuco, Brazil 6 months ago Engenheiro de Dados GCP – Júnior | Pleno | Sênior #J-18808-Ljbffr

  • Azure Data Engineer

    3 semanas atrás

    Manaus, Brasil buscojobs Brasil Tempo inteiro

    Overview Your connection with Aubay starts in the following lines : Aubay Portugal is a multinational French company, in Portugal since 2007. We have offices in Lisbon and Oporto and we are a specialized consultant in Management, Implementation, Development and Maintenance of Information Systems. We have more than 150 active partners and we operate in...

  • Ecommerce Data Solutions Architect

    4 semanas atrás

    Manaus, Brasil beBeeDataEngineer Tempo inteiro

    Job Title: Job Overview: Our team is seeking a seasoned data engineer to help us design and implement a scalable data processing solution for our e-commerce platform. The ideal candidate will have expertise in Azure Data Factory, Synapse, and Python-based ETL tools. Key Responsibilities: Design and implement efficient data models to support big data volumes...

  • Data Engineer

    Há 7 dias

    Manaus, Brasil IDT Corporation Tempo inteiro

    Overview This is a full-time work from home opportunity for a Data Engineer from LATAM. IDT ( is an American telecommunications company founded in 1990 and headquartered in New Jersey. It is a leading provider of prepaid communication and payment services and one of the world’s largest international voice carriers. We are listed on the NYSE, with over 1300...

  • Data Scientist

    1 semana atrás

    Manaus, Brasil Insight Global Tempo inteiro

    Required Qualifications:Bachelor’s or Master’s degree in Data Science, Computer Science, Statistics, or a related field.3+ years of experience building and deploying ML models in enterprise environments.Proficiency in PySpark, Python, and ML frameworks (e.G., scikit-learn, TensorFlow, PyTorch).Hands-on experience with Databricks, Azure ML, AWS SageMaker,...

  • Data Engineer

    4 semanas atrás

    Manaus, Brasil AgileEngine Tempo inteiro

    Overview Data Engineer (Senior) ID40199 at AgileEngine. AgileEngine is an Inc. 5000 company that creates software for Fortune 500 brands and startups across 17+ industries. The company emphasizes people-first culture and has earned multiple Best Place to Work awards. We are looking for a Senior Data Engineer to take ownership of our data infrastructure,...

  • Optimize Business Growth As A Cloud Data Engineer

    1 semana atrás

    Manaus, Brasil Bebeedata Tempo inteiro

    Cloud Data EngineerEmbark on a challenging role that combines data engineering and cloud computing to drive business growth.As a Cloud Data Engineer, you will be responsible for designing, building, testing, and maintaining large-scale data pipelines on Microsoft Azure.The ideal candidate will have experience in designing and developing metadata-driven data...

  • Data Engineer

    3 semanas atrás

    Manaus, Brasil AgileEngine Tempo inteiro

    AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an...

  • Data Engineer

    3 semanas atrás

    Manaus, Brasil AgileEngine Tempo inteiro

    Overview AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. We are looking for a Senior Data Engineer to take...

  • Advanced Threat Intelligence Data Engineer

    4 semanas atrás

    Manaus, Brasil beBeeData Tempo inteiro

    We are seeking a skilled and experienced Data Engineer to join our team in designing, developing, and maintaining data pipelines for threat intelligence ingestion, validation, and export automation flows. Key Responsibilities: Design, develop, and maintain data pipelines for ingesting threat intelligence data from various sources into our data ecosystem....

  • Data Engineer

    2 semanas atrás

    Manaus, Brasil AgileEngine Tempo inteiro

    Overview AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. Role: Senior Data Engineer — take ownership of our...