Lead Data Pipeline Architect

1 semana atrás

Recife, Brasil Bebeedataengineer Tempo inteiro

Job OverviewThe Senior Data Engineer will be responsible for building, managing, and optimizing data pipelines to ensure compliance with data governance, data architecture, and data security requirements.Develop and maintain scalable data pipelines that encompass data modeling, data transformation, schemas, metadata, and workload management;Drive Automation through effective metadata management by leveraging industry-leading tools and technologies;Ensure compliance and governance during data use, including the maintenance of a centralized data catalog;Collaborate with cross-functional teams to deliver high-quality data solutions;Design and implement data architectures that meet business needs and drive strategic growth;Ensure the proper use of data architecture defined by the data factory team.Key Skills: Strong experience in various data management architectures, with a focus on cloud-based environments;Expertise in data modeling and design;Ability to develop and manage complex data pipelines using cutting-edge technologies;Experience working with commercial and open-source message queuing systems;Excellent communication and collaboration skills;Highly creative and results-driven individual who can adapt to fast-paced environments.

  • Lead Data Pipeline Architect

    2 semanas atrás

    Recife, Brasil beBeeDataEngineer Tempo inteiro

    Job Overview The Senior Data Engineer will be responsible for building, managing, and optimizing data pipelines to ensure compliance with data governance, data architecture, and data security requirements. Develop and maintain scalable data pipelines that encompass data modeling, data transformation, schemas, metadata, and workload management; Drive...

  • Lead Data Pipeline Architect

    Há 4 dias

    Recife, PE, Brasil beBeeDataEngineer Tempo inteiro

    Job Overview The Senior Data Engineer will be responsible for building, managing, and optimizing data pipelines to ensure compliance with data governance, data architecture, and data security requirements. Develop and maintain scalable data pipelines that encompass data modeling, data transformation, schemas, metadata, and workload management; Drive...

  • Data Pipeline Architect

    Há 6 dias

    Recife, Brasil Bebeedatabricks Tempo inteiro

    Databricks Data EngineerThis role involves designing, developing and delivering scalable data pipelines using Spark, PySpark, SQL and Delta Lake.Develop ETL/ELT pipelines in Databricks using PySpark, Spark SQL and Delta Lake.Ingest, clean and transform data from diverse sources such as APIs, SQL databases, cloud storage and SAP/legacy systems.Create reusable...

  • Data Pipeline Architect

    1 semana atrás

    Recife, Brasil beBeeDatabricks Tempo inteiro

    Databricks Data Engineer This role involves designing, developing and delivering scalable data pipelines using Spark, PySpark, SQL and Delta Lake. Develop ETL/ELT pipelines in Databricks using PySpark, Spark SQL and Delta Lake. Ingest, clean and transform data from diverse sources such as APIs, SQL databases, cloud storage and SAP/legacy systems. Create...

  • Data Pipeline Architect

    Há 6 dias

    Recife, PE, Brasil beBeeDatabricks Tempo inteiro

    Databricks Data Engineer This role involves designing, developing and delivering scalable data pipelines using Spark, PySpark, SQL and Delta Lake. Develop ETL/ELT pipelines in Databricks using PySpark, Spark SQL and Delta Lake. Ingest, clean and transform data from diverse sources such as APIs, SQL databases, cloud storage and SAP/legacy systems. Create...

  • Chief Data Pipeline Architect

    Há 2 dias

    Recife, Brasil beBeeDataEngineer Tempo inteiro

    Key Data Engineer Role We are looking for a seasoned expert in data engineering with a focus on artificial intelligence and machine learning to join our analytics team. This role will involve designing scalable data pipelines, operationalizing machine learning workflows, and collaborating closely with data scientists. Create end-to-end data pipelines using...

  • Cloud Data Architect

    Há 2 dias

    Recife, Brasil beBeeCloud Tempo inteiro

    Senior Cloud Data Architect Role We are seeking an experienced Senior Cloud Data Architect who can design and develop scalable data infrastructure using Azure Data Services. The ideal candidate will have expertise in cloud-based data platforms, including knowledge of Apache Spark (PySpark) on Azure Databricks and data quality tools such as Great Expectations...

  • Chief Data Pipeline Architect

    Há 12 horas

    Recife, PE, Brasil beBeeDataEngineer Tempo inteiro

    Key Data Engineer Role We are looking for a seasoned expert in data engineering with a focus on artificial intelligence and machine learning to join our analytics team. This role will involve designing scalable data pipelines, operationalizing machine learning workflows, and collaborating closely with data scientists. Create end-to-end data pipelines using...

  • Cloud Data Architect

    Há 2 dias

    Recife, PE, Brasil beBeeCloud Tempo inteiro

    Senior Cloud Data Architect Role We are seeking an experienced Senior Cloud Data Architect who can design and develop scalable data infrastructure using Azure Data Services. The ideal candidate will have expertise in cloud-based data platforms, including knowledge of Apache Spark (PySpark) on Azure Databricks and data quality tools such as Great Expectations...

  • Lead Data Pipeline Developer

    2 semanas atrás

    Recife, Brasil beBeeData Tempo inteiro

    Key Roles of a Data Engineer A multinational corporation is seeking an experienced data engineer to spearhead the design, development, and maintenance of large-scale data pipelines. Primary responsibilities include: Collaborating with cross-functional teams to integrate data into business applications; Developing and implementing robust data quality...