Databricks Data Engineer
Há 2 dias
Databricks Data Engineer Fully Remote Contract We’re looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake. This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and visualizations. Responsibilities: • Build and optimize ETL/ELT pipelines in Databricks using PySpark, Spark SQL, and Delta Lake. • Ingest, clean, and transform data from diverse sources (APIs, SQL databases, cloud storage, SAP/legacy systems, streaming). • Develop reusable pipeline frameworks, data validation logic, and performance-tuned transformations. • Design curated datasets and deliver insights through Power BI dashboards. • Implement best practices for lakehouse development, orchestration, and version control. • Troubleshoot pipeline performance issues and ensure data accuracy, reliability, and quality. Required Skills: • Strong hands-on Databricks experience (Spark, PySpark, Delta Lake). • Advanced SQL for large-scale data processing. • Experience integrating data from multiple structured and unstructured sources. • Solid understanding of distributed computing, performance tuning, and debugging Spark jobs. • Power BI (reports, models, DAX preferred). • Experience with CI/CD pipelines in an Azure environment Nice to Have: • Experience with data quality frameworks, Lakehouse monitoring, or DQX • Knowledge of Airflow, ADF, IoT, Kafka or other tools is a plus • Experience with SAP data is a plus.
-
Data Engineer – Databricks | Azure
3 semanas atrás
Brazil UPBI Data & AI Tempo inteiroA UPBI Data & AI , consultoria especializada em soluções digitais, parceira Microsoft e Databricks, está buscando um(a) Data Engineer com sólida experiência em Databricks e Azure para atuação em projeto internacional estratégico. Modelo: Remoto Regime: PJ Responsabilidades: Desenvolver e otimizar pipelines de dados utilizando Databricks e serviços...
-
Data Engineer – Databricks | Azure
3 semanas atrás
Brazil UPBI Data & AI Tempo inteiroA UPBI Data & AI, consultoria especializada em soluções digitais, parceira Microsoft e Databricks, está buscando um(a) Data Engineer com sólida experiência em Databricks e Azure para atuação em projeto internacional estratégico.Modelo: RemotoRegime: PJResponsabilidades:Desenvolver e otimizar pipelines de dados utilizando Databricks e serviços...
-
Data Engineer – Databricks | Azure
3 semanas atrás
Brazil, BR UPBI Data & AI Tempo inteiroA UPBI Data & AI, consultoria especializada em soluções digitais, parceira Microsoft e Databricks, está buscando um(a) Data Engineer com sólida experiência em Databricks e Azure para atuação em projeto internacional estratégico.Modelo: RemotoRegime: PJResponsabilidades:Desenvolver e otimizar pipelines de dados utilizando Databricks e serviços...
-
Databricks Data Engineer
Há 2 dias
Brazil, BR GlobalSource IT Tempo inteiroDatabricks Data EngineerFully Remote Contract We’re looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake. This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and...
-
Data Engineer
Há 2 dias
Brazil Zunzun Solutions Tempo inteiroSummary: We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines. In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions. You will play a key role in modernizing our data platform on the...
-
Unlock Your Potential as a Data Engineer
2 semanas atrás
Brazil beBeedataengineer Tempo inteiroJob Title: Data Engineer w/ Databricks We are seeking a skilled and motivated Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, testing, and maintaining large-scale data systems. The ideal candidate will have at least 4 years of professional experience in data engineering and strong knowledge of Databricks...
-
Data Engineer
Há 2 dias
Brazil Zunzun Solutions Tempo inteiroSummary:We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines. In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions. You will play a key role in modernizing our data platform on the...
-
Data Engineer
Há 2 dias
Brazil, BR Zunzun Solutions Tempo inteiroSummary:We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines. In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions. You will play a key role in modernizing our data platform on the...
-
Sr Data Engineer
1 semana atrás
Brazil Luxoft Tempo inteiroBefore you apply, please get familiar with Luxoft Luxoft locations: Logeek Magazine: Luxoft Alumni Club: Responsibilities: Design and implement scalable data pipelines using Databricks and Kafka Build and maintain real-time streaming solutions for high-volume data Collaborate with cross-functional teams to integrate data flows into broader systems Optimize...
-
Data Engineer
1 semana atrás
Brazil Ascendion Tempo inteiroOverview: We are seeking a highly skilled Data Engineer to support the development of personalized search capabilities and data assimilation initiatives within the organization. This is a remote role aligned to the EST time zone . The ideal candidate will have strong experience working with Python, databricks, and Kafka , and will contribute directly to...
