Databricks Data Engineer
Há 20 horas
Databricks Data Engineer
Fully Remote Contract
We're looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake. This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and visualizations.
Responsibilities:
- Build and optimize ETL/ELT pipelines in Databricks using PySpark, Spark SQL, and Delta Lake.
- Ingest, clean, and transform data from diverse sources (APIs, SQL databases, cloud storage, SAP/legacy systems, streaming).
- Develop reusable pipeline frameworks, data validation logic, and performance-tuned transformations.
- Design curated datasets and deliver insights through Power BI dashboards.
- Implement best practices for lakehouse development, orchestration, and version control.
- Troubleshoot pipeline performance issues and ensure data accuracy, reliability, and quality.
Required Skills:
- Strong hands-on Databricks experience (Spark, PySpark, Delta Lake).
- Advanced SQL for large-scale data processing.
- Experience integrating data from multiple structured and unstructured sources.
- Solid understanding of distributed computing, performance tuning, and debugging Spark jobs.
- Power BI (reports, models, DAX preferred).
- Experience with CI/CD pipelines in an Azure environment
Nice to Have:
- Experience with data quality frameworks, Lakehouse monitoring, or DQX
- Knowledge of Airflow, ADF, IoT, Kafka or other tools is a plus
- Experience with SAP data is a plus.
-
Data Engineer – Databricks | Azure
3 semanas atrás
Várzea Grande, Brasil UPBI Data & AI Tempo inteiroA UPBI Data & AI , consultoria especializada em soluções digitais, parceira Microsoft e Databricks, está buscando um(a) Data Engineer com sólida experiência em Databricks e Azure para atuação em projeto internacional estratégico. Modelo: Remoto Regime: PJ Responsabilidades: Desenvolver e otimizar pipelines de dados utilizando Databricks e...
-
Data Engineer
Há 6 dias
Várzea Grande, Brasil Ascendion Tempo inteiroOverview: We are seeking a highly skilled Data Engineer to support the development of personalized search capabilities and data assimilation initiatives within the organization. This is a remote role aligned to the EST time zone. The ideal candidate will have strong experience working with Python, databricks, and Kafka, and will contribute directly to...
-
Data Engineer
2 semanas atrás
Várzea Grande, Brasil Insight Global Tempo inteiroPosition : Data Engineer Location : Remote in Brazil Duration : 3 year+ PJ Contract Monthly Salary Range : 3-5k USD / Month Requirements : 3+ years of experience in Data Engineering Hands on data engineering experience with Microsoft Fabric (highly preferred) or Azure Synapse / Databricks are also acceptable Advanced Data Manipulation experience using SQL,...
-
Azure Data Engineer
2 semanas atrás
Várzea Grande, Brasil Tata Consultancy Services Tempo inteiroCome to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...
-
Data Engineer
2 semanas atrás
Várzea Grande, Brasil Design Manager Tempo inteiroJob Title: Data Engineer Location: Remote (Brazil) Employment Type: Full Time Compensation: Competitive hourly rate, commensurate with experience About Design Manager Design Manager (+DesignSpec) is a leading provider of project management and accounting software tailored specifically for interior design firms. For over 30 years, we've helped thousands...
-
Senior Data Solutions Architect
2 semanas atrás
Rio Grande do Sul, Brasil Provectus Tempo inteiro**Provectus,**a leading AI consultancy and solutions provider specializing in **Data Engineering** and **Machine Learning**. With a focus on helping businesses unlock the power of their data, we leverage the latest technologies to build innovative data platforms that drive results. Our Data Engineering team consists of top-tier professionals who design,...
-
Senior Data Solutions Architect
2 semanas atrás
Rio Grande do Sul, Brasil Provectus Tempo inteiro**Provectus,**a leading AI consultancy and solutions provider specializing in **Data Engineering** and **Machine Learning**. With a focus on helping businesses unlock the power of their data, we leverage the latest technologies to build innovative data platforms that drive results. Our Data Engineering team consists of top-tier professionals who design,...
-
Data engineer
2 semanas atrás
Rio Grande do Norte, Brasil Insight Global Tempo inteiroThis is a fully remote position working for a US client, CLT model and salary range of 15k-20k BRL/mo. Required Skills & Experience 2-5+ Year of experience in Data Engineering Use Python or SQL for engineering and scientific calculations Proven technology champion in working with relational, Data warehouses databases, query authoring (SQL) as well as working...
-
Data Enginner w
3 semanas atrás
Várzea Grande, Brasil Aubay Portugal Tempo inteiroAubay Portugal is a multinational French company, in Portugal since 2007. We have offices in Lisbon and Oporto and we are a specialized consultant in Management, Implementation, Development and Maintenance of Information Systems. We have more than 150 active partners and we operate in sectors such as banking, insurance, telecommunications, services, energy...
-
Data Engineer
3 semanas atrás
Campo Grande, Brasil Insight Global Tempo inteiroPosition: Data EngineerLocation: Remote in Brazil Duration: 3 year+ PJ Contract Monthly Salary Range: 3-5k USD/MonthRequirements: 3+ years of experience in Data Engineering Hands on data engineering experience with Microsoft Fabric (highly preferred) or Azure Synapse/Databricks are also acceptable Advanced Data Manipulation experience using SQL, Pandas, and...