Empregos atuais relacionados a Data Pipeline Architect - Recife - beBeeDatabricks

  • Data Pipeline Architect

    4 semanas atrás

    Recife, PE, Brasil beBeeDatabricks Tempo inteiro

    Databricks Data Engineer This role involves designing, developing and delivering scalable data pipelines using Spark, PySpark, SQL and Delta Lake. Develop ETL/ELT pipelines in Databricks using PySpark, Spark SQL and Delta Lake. Ingest, clean and transform data from diverse sources such as APIs, SQL databases, cloud storage and SAP/legacy systems. Create...

  • Chief Data Pipeline Architect

    3 semanas atrás

    Recife, Brasil beBeeDataEngineer Tempo inteiro

    Key Data Engineer Role We are looking for a seasoned expert in data engineering with a focus on artificial intelligence and machine learning to join our analytics team. This role will involve designing scalable data pipelines, operationalizing machine learning workflows, and collaborating closely with data scientists. Create end-to-end data pipelines using...

  • Cloud Data Architect

    3 semanas atrás

    Recife, Brasil beBeeCloud Tempo inteiro

    Senior Cloud Data Architect Role We are seeking an experienced Senior Cloud Data Architect who can design and develop scalable data infrastructure using Azure Data Services. The ideal candidate will have expertise in cloud-based data platforms, including knowledge of Apache Spark (PySpark) on Azure Databricks and data quality tools such as Great Expectations...

  • Chief Data Pipeline Architect

    3 semanas atrás

    Recife, PE, Brasil beBeeDataEngineer Tempo inteiro

    Key Data Engineer Role We are looking for a seasoned expert in data engineering with a focus on artificial intelligence and machine learning to join our analytics team. This role will involve designing scalable data pipelines, operationalizing machine learning workflows, and collaborating closely with data scientists. Create end-to-end data pipelines using...

  • Lead Data Pipeline Architect

    4 semanas atrás

    Recife, PE, Brasil beBeeDataEngineer Tempo inteiro

    Job Overview The Senior Data Engineer will be responsible for building, managing, and optimizing data pipelines to ensure compliance with data governance, data architecture, and data security requirements. Develop and maintain scalable data pipelines that encompass data modeling, data transformation, schemas, metadata, and workload management; Drive...

  • Cloud Data Architect

    3 semanas atrás

    Recife, PE, Brasil beBeeCloud Tempo inteiro

    Senior Cloud Data Architect Role We are seeking an experienced Senior Cloud Data Architect who can design and develop scalable data infrastructure using Azure Data Services. The ideal candidate will have expertise in cloud-based data platforms, including knowledge of Apache Spark (PySpark) on Azure Databricks and data quality tools such as Great Expectations...

  • Cloud-based Data Architect

    3 semanas atrás

    Recife, Brasil beBeeDataEngineering Tempo inteiro

    Solution Architect We are seeking an experienced Solution Architect to join our team. Key Responsibilities: To design and implement scalable data architecture solutions that meet business requirements. Collaborate with technical teams to develop and maintain robust dimensional data models for the gold layer using Medallion architecture in Snowflake. Define,...

  • Cloud-based Data Architect

    3 semanas atrás

    Recife, PE, Brasil beBeeDataEngineering Tempo inteiro

    Solution Architect We are seeking an experienced Solution Architect to join our team. Key Responsibilities: To design and implement scalable data architecture solutions that meet business requirements. Collaborate with technical teams to develop and maintain robust dimensional data models for the gold layer using Medallion architecture in Snowflake. Define,...

  • Senior Data Pipeline Specialist

    3 semanas atrás

    Recife, Brasil beBeeDataEngineer Tempo inteiro

    Job Description We are seeking a skilled Data Engineer to design and implement scalable data pipelines using Databricks and Kafka. The successful candidate will have strong experience in designing data pipelines, building real-time streaming solutions, collaborating with cross-functional teams, and optimizing data processing workflows. Design scalable data...

  • Senior Data Systems Architect

    3 semanas atrás

    Recife, Brasil beBeeData Tempo inteiro

    Data Architect Specialist Role Overview: We are seeking a highly skilled Data Architect to lead the design and development of our large-scale data systems. This key role requires strong technical expertise, excellent communication skills, and the ability to collaborate effectively with cross-functional teams. Key Responsibilities: Design Scalable Data...

Data Pipeline Architect

4 semanas atrás

Recife, Brasil beBeeDatabricks Tempo inteiro

Databricks Data Engineer This role involves designing, developing and delivering scalable data pipelines using Spark, PySpark, SQL and Delta Lake. Develop ETL/ELT pipelines in Databricks using PySpark, Spark SQL and Delta Lake. Ingest, clean and transform data from diverse sources such as APIs, SQL databases, cloud storage and SAP/legacy systems. Create reusable pipeline frameworks, data validation logic and performance-tuned transformations. Design curated datasets and deliver insights through Power BI dashboards. Implement best practices for lakehouse development, orchestration and version control. Troubleshoot pipeline performance issues and ensure data accuracy, reliability and quality. Required Skills and Qualifications: Strong hands-on experience with Databricks (Spark, PySpark, Delta Lake). Advanced SQL skills for large-scale data processing. Experience integrating data from multiple structured and unstructured sources. Solid understanding of distributed computing, performance tuning and debugging Spark jobs. Power BI (reports, models, DAX preferred). Experience with CI/CD pipelines in an Azure environment. Nice to Have: Experience with data quality frameworks, lakehouse monitoring or DQX. Knowledge of Airflow, ADF, IoT or other tools is a plus. Experience with SAP data is a plus.