Databricks Data Engineer
4 semanas atrás
Databricks Data Engineer
Fully Remote Contract
We’re looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake. This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and visualizations.
Responsibilities:
• Build and optimize ETL/ELT pipelines in Databricks using PySpark, Spark SQL, and Delta Lake.
• Ingest, clean, and transform data from diverse sources (APIs, SQL databases, cloud storage, SAP/legacy systems, streaming).
• Develop reusable pipeline frameworks, data validation logic, and performance-tuned transformations.
• Design curated datasets and deliver insights through Power BI dashboards.
• Implement best practices for lakehouse development, orchestration, and version control.
• Troubleshoot pipeline performance issues and ensure data accuracy, reliability, and quality.
Required Skills:
• Strong hands-on Databricks experience (Spark, PySpark, Delta Lake).
• Advanced SQL for large-scale data processing.
• Experience integrating data from multiple structured and unstructured sources.
• Solid understanding of distributed computing, performance tuning, and debugging Spark jobs.
• Power BI (reports, models, DAX preferred).
• Experience with CI/CD pipelines in an Azure environment
Nice to Have:
• Experience with data quality frameworks, Lakehouse monitoring, or DQX
• Knowledge of Airflow, ADF, IoT, Kafka or other tools is a plus
• Experience with SAP data is a plus.
-
Senior Data Engineer
1 hora atrás
Recife, Brasil Luxoft Tempo inteiroProject Description:The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration,...
-
Senior Data Engineer
Há 4 dias
Recife, Brasil Luxoft Tempo inteiroProject Description: The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week. Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration,...
-
Data Engineer
1 dia atrás
Recife, Brasil Emagine - Portugal Tempo inteiroProfile: Data / ETL Engineer (AWS)We are looking for a Data / ETL Engineers with strong experience building and operating data pipelines in AWS.Core skills & experience:• Solid understanding of relational databases, with strong SQL skills (experience with Microsoft SQL Server preferred)• Strong Python development skills, particularly for data processing...
-
Senior Data Engineer
2 semanas atrás
Recife, Brasil Applaudo Tempo inteiroAbout YouYou are a Senior Data Engineer who enjoys building reliable, scalable data platforms and enabling data-driven and AI-powered products.You feel comfortable owning data pipelines end to end, working closely with analytics and AI/Data Science teams, and translating complex data problems into robust technical solutions.You value clean architecture,...
-
Azure Data Engineer
2 semanas atrás
Recife, Brasil Tata Consultancy Services Tempo inteiroCome to one of the biggest IT Services companies in the world!! Here you can transform your career!Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to...
-
Big Data Architect
4 semanas atrás
Recife, PE, Brasil beBeeDataEngineer Tempo inteiroJob Overview We are seeking experienced Data Engineers to support a large-scale ERP implementation for our hardware manufacturing client. This role requires strong technical expertise in modern data platforms, Azure services, and data modeling principles. Design and implement scalable data pipelines for seamless integration with ERP systems. Develop and...
-
Cloud Data Professional
4 semanas atrás
Recife, PE, Brasil beBeeData Tempo inteiroAbout This Role We are seeking an experienced Data Engineer to join our team and work on delivering proactive services and workshops to premium enterprise customers in Brazil. Develop end-to-end data architecture solutions on Microsoft Azure. Create and manage ETL/ELT pipelines using Azure Data Factory. Design and optimize data storage solutions for...
-
Data Engineer
3 semanas atrás
Recife, Brasil Tata Consultancy Services Tempo inteiroCome to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...
-
Full Stack Engineer
4 semanas atrás
Recife, Brasil Luxoft Tempo inteiroProject description We are looking for a hands-on Full Stack Developer with strong experience in Databricks and exposure to AWS-based application development. Responsibilities Design, develop, and maintain scalable data pipelines using Databricks Integrate Databricks workflows into broader application architecture Collaborate with cross-functional teams...
-
Backend Software Engineer
4 semanas atrás
Recife, PE, Brasil beBeeBackend Tempo inteiroBackend Software Engineer – Data Science About the Role: We are seeking a talented Backend Software Engineer to join our Data Science team. You will work on backend systems powering user-facing features, collaborating closely with design, product, and client teams to build high-quality, scalable solutions. Key Responsibilities: Develop and maintain backend...