Databricks Data Engineer

Há 2 dias

Recife, Brasil GlobalSource IT Tempo inteiro

Databricks Data Engineer

Fully Remote Contract

We’re looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake. This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and visualizations.

Responsibilities:

• Build and optimize ETL/ELT pipelines in Databricks using PySpark, Spark SQL, and Delta Lake.

• Ingest, clean, and transform data from diverse sources (APIs, SQL databases, cloud storage, SAP/legacy systems, streaming).

• Develop reusable pipeline frameworks, data validation logic, and performance-tuned transformations.

• Design curated datasets and deliver insights through Power BI dashboards.

• Implement best practices for lakehouse development, orchestration, and version control.

• Troubleshoot pipeline performance issues and ensure data accuracy, reliability, and quality.

Required Skills:

• Strong hands-on Databricks experience (Spark, PySpark, Delta Lake).

• Advanced SQL for large-scale data processing.

• Experience integrating data from multiple structured and unstructured sources.

• Solid understanding of distributed computing, performance tuning, and debugging Spark jobs.

• Power BI (reports, models, DAX preferred).

• Experience with CI/CD pipelines in an Azure environment

Nice to Have:

• Experience with data quality frameworks, Lakehouse monitoring, or DQX

• Knowledge of Airflow, ADF, IoT, Kafka or other tools is a plus

• Experience with SAP data is a plus.

  • Data Engineer – Databricks

    3 semanas atrás

    Recife, Brasil UPBI Data & AI Tempo inteiro

    A UPBI Data & AI , consultoria especializada em soluções digitais, parceira Microsoft e Databricks, está buscando um(a) Data Engineer com sólida experiência em Databricks e Azure para atuação em projeto internacional estratégico.Modelo: RemotoRegime: PJResponsabilidades:Desenvolver e otimizar pipelines de dados utilizando Databricks e serviços Azure...

  • Transformative Data Engineer Opportunity

    1 semana atrás

    Recife, Brasil Bebeedataengineer Tempo inteiro

    Unlock the Power of Data EngineeringA leading organization is seeking an experienced data engineer to join their team.The ideal candidate will have a minimum of 4 years of professional experience and strong skills in data engineering with Databricks and Python.Minimum 4 years of professional experience as a data engineer,Minimum 3 years of professional...

  • Transformative Data Engineer Opportunity

    2 semanas atrás

    Recife, Brasil beBeeDataEngineer Tempo inteiro

    Unlock the Power of Data Engineering A leading organization is seeking an experienced data engineer to join their team. The ideal candidate will have a minimum of 4 years of professional experience and strong skills in data engineering with Databricks and Python. Minimum 4 years of professional experience as a data engineer , Minimum 3 years of professional...

  • Data Engineer

    Há 6 dias

    Recife, Brasil Insight Global Tempo inteiro

    Position: Data Engineer Location: Remote in BrazilDuration: 3 year+ PJ ContractMonthly Salary Range: 3-5k USD/MonthRequirements:3+ years of experience in Data EngineeringHands on data engineering experience with Microsoft Fabric (highly preferred) or Azure Synapse/Databricks are also acceptableAdvanced Data Manipulation experience using SQL, Pandas, and...

  • Transformative Data Engineer Opportunity

    1 semana atrás

    Recife, PE, Brasil beBeeDataEngineer Tempo inteiro

    Unlock the Power of Data Engineering A leading organization is seeking an experienced data engineer to join their team. The ideal candidate will have a minimum of 4 years of professional experience and strong skills in data engineering with Databricks and Python. Minimum 4 years of professional experience as a data engineer , Minimum 3 years of professional...

  • Data Engenheiro

    3 semanas atrás

    Recife, Brasil beBeeDADOS Tempo inteiro

    Aqui está uma oportunidade para um profissional de dados experiente se juntar a nossa equipe. Descrição do cargo Nossa empresa é uma consultoria especializada em soluções digitais, parceira de Microsoft e Databricks. Estamos procurando por um Data Engineer com sólida experiência em Databricks e Azure para atuação em projeto internacional...

  • Data Engineer

    3 semanas atrás

    Recife, Brasil HeartCentrix Solutions Tempo inteiro

    We are seeking a highly skilled Python Data Engineer with an AI/ML focus to join our client's growing data & analytics team in Brazil. This role is ideal for someone who loves building scalable data pipelines, operationalizing machine learning workflows, and partnering closely with data scientists to bring models into production. You will design, develop,...

  • Data Engineer

    4 semanas atrás

    Recife, Brasil HeartCentrix Solutions Tempo inteiro

    We are seeking a highly skilled Python Data Engineer with an AI/ML focus to join our client’s growing data & analytics team in Brazil. This role is ideal for someone who loves building scalable data pipelines, operationalizing machine learning workflows, and partnering closely with data scientists to bring models into production. You will design, develop,...

  • Expert Data Quality Specialist

    4 semanas atrás

    Recife, Brasil beBeeDataEngineer Tempo inteiro

    We are seeking a Databricks Data Engineer to rebuild our data quality scorecards using SAP ECC data in the Lakehouse.

  • Databricks Pipeline Architect

    3 semanas atrás

    Recife, Brasil beBeeDataEngineer Tempo inteiro

    Job Title: A Databricks Data Engineer Job Description We are seeking a seasoned professional with strong experience in building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake to join our team. The role involves ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and visualizations....