Databricks Data Engineer

2 semanas atrás

Brasília, Brasil The BIG Jobsite Tempo inteiro

Databricks Data Engineer Fully Remote Contract
We’re looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake. This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and visualizations.
Responsibilities:
- Build and optimize ETL/ELT pipelines in Databricks using PySpark, Spark SQL, and Delta Lake.
- Ingest, clean, and transform data from diverse sources (APIs, SQL databases, cloud storage, SAP/legacy systems, streaming).
- Develop reusable pipeline frameworks, data validation logic, and performance-tuned transformations.
- Design curated datasets and deliver insights through Power BI dashboards.
- Implement best practices for lakehouse development, orchestration, and version control.
- Troubleshoot pipeline performance issues and ensure data accuracy, reliability, and quality.
Required Skills:
- Strong hands-on Databricks experience (Spark, PySpark, Delta Lake).
- Advanced SQL for large-scale data processing.
- Experience integrating data from multiple structured and unstructured sources.
- Solid understanding of distributed computing, performance tuning, and debugging Spark jobs.
- Power BI (reports, models, DAX preferred).
- Experience with CI/CD pipelines in an Azure environment
Nice to Have:
- Experience with data quality frameworks, Lakehouse monitoring, or DQX
- Knowledge of Airflow, ADF, IoT, Kafka or other tools is a plus
- Experience with SAP data is a plus.

  • Databricks Data Engineer

    2 semanas atrás

    Brasília, Brasil The Big Jobsite Tempo inteiro

    Databricks Data Engineer Fully Remote Contract We're looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake.This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and...

  • Data Engineer

    3 semanas atrás

    Brasília, Brasil UPBI Data & AI Tempo inteiro

    AUPBI Data & AI, consultoria especializada em soluções digitais, parceira Microsoft e Databricks, está buscando um(a)Data Engineercom sólida experiência emDatabricks e Azurepara atuação em projeto internacional estratégico. Modelo: Remoto Regime: PJResponsabilidades:Desenvolver e otimizar pipelines de dados utilizandoDatabrickse serviçosAzure....

  • Databricks Data Engineer

    Há 2 dias

    Brasília, Brasil Globalsource It Tempo inteiro

    Databricks Data EngineerFully Remote Contract We're looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake.This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and...

  • Data engineer

    2 semanas atrás

    Brasília, Brasil PIXIE Tempo inteiro

    Position: Data Engineer Location: (Hybrid - 3 days onsite) Duration: 12-month contract Data Engineer We are seeking a Data Engineer to design, develop, and optimize data pipelines that support Retail Power's forecasting, pricing, and reporting operations. This role is responsible for integrating Salesforce data, usage history, pricing curves, and additional...

  • Data Engineer

    2 semanas atrás

    Brasília, Brasil Pixie Tempo inteiro

    Position: Data Engineer Location: (Hybrid - 3 days onsite) Duration: 12-month contract Data Engineer We are seeking a Data Engineer to design, develop, and optimize data pipelines that support Retail Power's forecasting, pricing, and reporting operations. This role is responsible for integrating Salesforce data, usage history, pricing curves, and additional...

  • Data Engineer

    Há 2 dias

    Brasília, Brasil Zunzun Solutions Tempo inteiro

    Summary: We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines. In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions. You will play a key role in modernizing our data platform on the...

  • Data Engineer

    Há 2 dias

    Brasília, Brasil Zunzun Solutions Tempo inteiro

    Summary:We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines. In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions. You will play a key role in modernizing our data platform on the...

  • Data Engineer

    Há 5 dias

    Brasília, Brasil Ascendion Tempo inteiro

    Overview:We are seeking a highly skilled Data Engineer to support the development of personalized search capabilities and data assimilation initiatives within the organization.This is a remote role aligned to the EST time zone.The ideal candidate will have strong experience working with Python, databricks, and Kafka, and will contribute directly to ongoing...

  • Data Engineer

    Há 7 dias

    Brasília, Brasil Ascendion Tempo inteiro

    Overview: We are seeking a highly skilled Data Engineer to support the development of personalized search capabilities and data assimilation initiatives within the organization. This is a remote role aligned to the EST time zone. The ideal candidate will have strong experience working with Python, databricks, and Kafka, and will contribute directly to...

  • Sr Data Engineer

    Há 7 dias

    Brasília, Brasil Luxoft Tempo inteiro

    Before you apply, please get familiar with LuxoftLuxoft locations: https://career.luxoft.com/locations/Logeek Magazine: https://career.luxoft.com/logeek-magazine/Luxoft Alumni Club: https://career.luxoft.com/alumni/Responsibilities:Design and implement scalable data pipelines using Databricks and KafkaBuild and maintain real-time streaming solutions for...