Databricks Data Engineer
Há 18 horas
Databricks Data Engineer Fully Remote Contract
We're looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake. This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and visualizations.
Responsibilities:
• Build and optimize ETL/ELT pipelines in Databricks using PySpark, Spark SQL, and Delta Lake.
• Ingest, clean, and transform data from diverse sources (APIs, SQL databases, cloud storage, SAP/legacy systems, streaming).
• Develop reusable pipeline frameworks, data validation logic, and performance-tuned transformations.
• Design curated datasets and deliver insights through Power BI dashboards.
• Implement best practices for lakehouse development, orchestration, and version control.
• Troubleshoot pipeline performance issues and ensure data accuracy, reliability, and quality.
Required Skills:
• Strong hands-on Databricks experience (Spark, PySpark, Delta Lake).
• Advanced SQL for large-scale data processing.
• Experience integrating data from multiple structured and unstructured sources.
• Solid understanding of distributed computing, performance tuning, and debugging Spark jobs.
• Power BI (reports, models, DAX preferred).
• Experience with CI/CD pipelines in an Azure environment
Nice to Have:
• Experience with data quality frameworks, Lakehouse monitoring, or DQX
• Knowledge of Airflow, ADF, IoT, Kafka or other tools is a plus
• Experience with SAP data is a plus.
-
Data Engineer – Databricks | Azure
3 semanas atrás
Belo Horizonte, Brasil UPBI Data & AI Tempo inteiroA UPBI Data & AI, consultoria especializada em soluções digitais, parceira Microsoft e Databricks, está buscando um(a) Data Engineer com sólida experiência em Databricks e Azure para atuação em projeto internacional estratégico.Modelo: RemotoRegime: PJResponsabilidades:Desenvolver e otimizar pipelines de dados utilizando
-
Databricks Data Engineer
1 dia atrás
Belo Horizonte, Brasil GlobalSource IT Tempo inteiroDatabricks Data EngineerFully Remote Contract We’re looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake. This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and...
-
Databricks Data Engineer
1 dia atrás
Belo Horizonte, Brasil Globalsource It Tempo inteiroDatabricks Data Engineer Fully Remote Contract We're looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake.This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and...
-
Data Engineer
1 dia atrás
Belo Horizonte, Brasil Zunzun Solutions Tempo inteiroSummary:We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines. In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions. You will play a key role in modernizing our data platform on the...
-
Senior Data Engineer
3 semanas atrás
Belo Horizonte, Brasil Celebal Technologies Tempo inteiroJob Title : Data Engineer Location : São Paulo, Brazil (Hybrid or Remote within Brazil) Employment Type : Full-time About the Role We are looking for an experienced Data Engineer to join our data team in Brazil. The ideal candidate will design and maintain modern data pipelines and architectures, with a strong focus on Databricks development and migration...
-
Data Engineer
Há 7 dias
Belo Horizonte, Brasil Ascendion Tempo inteiroOverview:We are seeking a highly skilled Data Engineer to support the development of personalized search capabilities and data assimilation initiatives within the organization. This is a remote role aligned to the EST time zone. The ideal candidate will have strong experience working with Python, databricks, and Kafka, and will contribute directly to ongoing...
-
Data Engineer
3 semanas atrás
Porto Belo, Brasil HeartCentrix Solutions Tempo inteiroWe are seeking a highly skilled Python Data Engineer with an AI/ML focus to join our client's growing data & analytics team in Brazil. This role is ideal for someone who loves building scalable data pipelines, operationalizing machine learning workflows, and partnering closely with data scientists to bring models into production. You will design, develop,...
-
Engenheiro De Dados
2 semanas atrás
Porto Alegre, Brasil Dadoteca Tempo inteiroResumo da PosiçãoBuscamos um(a)Engenheiro(a) de Dadoscomcertificação obrigatória Databricks Certified Data Engineer Professional , para atuar no desenvolvimento de soluções de dados emAzureeDatabricks .Este profissional será responsável por projetar, implementar e otimizar pipelines de dados escaláveis e de alta performance, assegurando...
-
Sr Data Engineer
Há 6 dias
Belo Horizonte, Brasil Luxoft Tempo inteiroBefore you apply, please get familiar with Luxoft Luxoft locations: Logeek Magazine: Luxoft Alumni Club: Responsibilities: Design and implement scalable data pipelines using Databricks and Kafka Build and maintain real-time streaming solutions for high-volume data Collaborate with cross-functional teams to integrate data flows into broader systems Optimize...
-
Data Engineer
Há 6 dias
Belo Horizonte, Brasil Insight Global Tempo inteiroThis is a fully remote position working for a US client, CLT model and salary range of 15k-20k BRL/mo.Required Skills & Experience 2-5+ Year of experience in Data Engineering Use Python or SQL for engineering and scientific calculations Proven technology champion in working with relational, Data warehouses databases, query authoring (SQL) as well as working...