Data Pipeline Architect

4 semanas atrás


Recife PE, Brasil beBeeDatabricks Tempo inteiro

Databricks Data Engineer This role involves designing, developing and delivering scalable data pipelines using Spark, PySpark, SQL and Delta Lake. Develop ETL/ELT pipelines in Databricks using PySpark, Spark SQL and Delta Lake. Ingest, clean and transform data from diverse sources such as APIs, SQL databases, cloud storage and SAP/legacy systems. Create reusable pipeline frameworks, data validation logic and performance-tuned transformations. Design curated datasets and deliver insights through Power BI dashboards. Implement best practices for lakehouse development, orchestration and version control. Troubleshoot pipeline performance issues and ensure data accuracy, reliability and quality. Required Skills and Qualifications: Strong hands-on experience with Databricks (Spark, PySpark, Delta Lake). Advanced SQL skills for large-scale data processing. Experience integrating data from multiple structured and unstructured sources. Solid understanding of distributed computing, performance tuning and debugging Spark jobs. Power BI (reports, models, DAX preferred). Experience with CI/CD pipelines in an Azure environment. Nice to Have: Experience with data quality frameworks, lakehouse monitoring or DQX. Knowledge of Airflow, ADF, IoT or other tools is a plus. Experience with SAP data is a plus.



  • Recife, PE, Brasil beBeeDataEngineer Tempo inteiro

    Key Data Engineer Role We are looking for a seasoned expert in data engineering with a focus on artificial intelligence and machine learning to join our analytics team. This role will involve designing scalable data pipelines, operationalizing machine learning workflows, and collaborating closely with data scientists. Create end-to-end data pipelines using...

  • Lead Data Pipeline Architect

    4 semanas atrás


    Recife, PE, Brasil beBeeDataEngineer Tempo inteiro

    Job Overview The Senior Data Engineer will be responsible for building, managing, and optimizing data pipelines to ensure compliance with data governance, data architecture, and data security requirements. Develop and maintain scalable data pipelines that encompass data modeling, data transformation, schemas, metadata, and workload management; Drive...

  • Cloud Data Architect

    4 semanas atrás


    Recife, PE, Brasil beBeeCloud Tempo inteiro

    Senior Cloud Data Architect Role We are seeking an experienced Senior Cloud Data Architect who can design and develop scalable data infrastructure using Azure Data Services. The ideal candidate will have expertise in cloud-based data platforms, including knowledge of Apache Spark (PySpark) on Azure Databricks and data quality tools such as Great Expectations...

  • Cloud-based Data Architect

    3 semanas atrás


    Recife, PE, Brasil beBeeDataEngineering Tempo inteiro

    Solution Architect We are seeking an experienced Solution Architect to join our team. Key Responsibilities: To design and implement scalable data architecture solutions that meet business requirements. Collaborate with technical teams to develop and maintain robust dimensional data models for the gold layer using Medallion architecture in Snowflake. Define,...


  • Recife, Brasil beBeeDataEngineer Tempo inteiro

    Key Data Engineer Role We are looking for a seasoned expert in data engineering with a focus on artificial intelligence and machine learning to join our analytics team. This role will involve designing scalable data pipelines, operationalizing machine learning workflows, and collaborating closely with data scientists. Create end-to-end data pipelines using...

  • Cloud Data Architect

    3 semanas atrás


    Recife, Brasil beBeeCloud Tempo inteiro

    Senior Cloud Data Architect Role We are seeking an experienced Senior Cloud Data Architect who can design and develop scalable data infrastructure using Azure Data Services. The ideal candidate will have expertise in cloud-based data platforms, including knowledge of Apache Spark (PySpark) on Azure Databricks and data quality tools such as Great Expectations...

  • Data Pipeline Specialist

    3 semanas atrás


    Recife, PE, Brasil beBeeBackend Tempo inteiro

    Backend Engineer Opportunity Job Description This role focuses on designing and developing backend services and data pipelines using Python. The ideal candidate will have experience with AWS data workflows, AI/LLM frameworks, and Kubernetes-hosted applications. Mandatory Skills and Qualifications Strong expertise in Python development Proficiency in SQL and...


  • Recife, PE, Brasil beBeeData Tempo inteiro

    Data Architect Specialist Role Overview: We are seeking a highly skilled Data Architect to lead the design and development of our large-scale data systems. This key role requires strong technical expertise, excellent communication skills, and the ability to collaborate effectively with cross-functional teams. Key Responsibilities: Design Scalable Data...

  • Chief Data Architect

    3 semanas atrás


    Recife, PE, Brasil beBeeData Tempo inteiro

    Job Title: Data Engineer As a data engineer you will be responsible for building and maintaining scalable data pipelines, analyzing large datasets, and enabling business-driven decision-making across the organization. Key Responsibilities: Design, build, and maintain data pipelines and ETL processes to ensure efficient data flow. Clean, validate, and...

  • Data Environment Architect

    3 semanas atrás


    Recife, PE, Brasil beBeeAutomator Tempo inteiro

    **DevOps Position Overview** Our organization is seeking a highly skilled DevOps Engineer to join our team. The ideal candidate will have expertise in architecting and maintaining Continuous Integration/Continuous Deployment (CI/CD) pipelines for large-scale data environments, as well as implementing Infrastructure-as-Code with Terraform. Implement a robust...