Databricks Data Engineer

4 semanas atrás

Várzea Grande, Brasil GlobalSource IT Tempo inteiro

Databricks Data Engineer

Fully Remote Contract

We're looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake. This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and visualizations.

Responsibilities:

- Build and optimize ETL/ELT pipelines in Databricks using PySpark, Spark SQL, and Delta Lake.

- Ingest, clean, and transform data from diverse sources (APIs, SQL databases, cloud storage, SAP/legacy systems, streaming).

- Develop reusable pipeline frameworks, data validation logic, and performance-tuned transformations.

- Design curated datasets and deliver insights through Power BI dashboards.

- Implement best practices for lakehouse development, orchestration, and version control.

- Troubleshoot pipeline performance issues and ensure data accuracy, reliability, and quality.

Required Skills:

- Strong hands-on Databricks experience (Spark, PySpark, Delta Lake).

- Advanced SQL for large-scale data processing.

- Experience integrating data from multiple structured and unstructured sources.

- Solid understanding of distributed computing, performance tuning, and debugging Spark jobs.

- Power BI (reports, models, DAX preferred).

- Experience with CI/CD pipelines in an Azure environment

Nice to Have:

- Experience with data quality frameworks, Lakehouse monitoring, or DQX

- Knowledge of Airflow, ADF, IoT, Kafka or other tools is a plus

- Experience with SAP data is a plus.

  • Data Engineer

    Há 2 dias

    Várzea Grande, Brasil emagine - Portugal Tempo inteiro

    Profile: Data / ETL Engineer (AWS) We are looking for a Data / ETL Engineers with strong experience building and operating data pipelines in AWS. Core skills & experience: - Solid understanding of relational databases, with strong SQL skills (experience with Microsoft SQL Server preferred) - Strong Python development skills, particularly for data...

  • Senior Data Engineer

    Há 3 dias

    Várzea Grande, Brasil Applaudo Tempo inteiro

    About YouYou are a Senior Data Engineer who enjoys building reliable, scalable data platforms and enabling data-driven and AI-powered products.You feel comfortable owning data pipelines end to end, working closely with analytics and AI / Data Science teams, and translating complex data problems into robust technical solutions.You value clean architecture,...

  • Azure Data Engineer

    Há 5 dias

    Várzea Grande, Brasil Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...

  • Data Engineer

    3 semanas atrás

    Várzea Grande, Brasil Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...

  • Senior Data Solutions Architect

    2 semanas atrás

    Rio Grande do Sul, Brasil Provectus Tempo inteiro

    **Provectus,**a leading AI consultancy and solutions provider specializing in **Data Engineering** and **Machine Learning**. With a focus on helping businesses unlock the power of their data, we leverage the latest technologies to build innovative data platforms that drive results. Our Data Engineering team consists of top-tier professionals who design,...

  • Data Engineer – Data

    3 semanas atrás

    Várzea Grande, Brasil ART IT Intelligent Technology Tempo inteiro

    Engenheiro(a) de Dados – Data & AI (Portugal) Oportunidade para brasileiros que desejam se mudar para Portugal Atuação em Braga ou Coimbra (possibilidade de alocação também em Lisboa, Porto ou Viseu) Sobre o Cliente Empresa de grande porte, em forte expansão na área de dados e inteligência artificial, com iniciativas robustas em plataformas...

  • Data Engineer

    2 semanas atrás

    Várzea Grande, Brasil Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...

  • Gcp Data Engineer

    2 semanas atrás

    Várzea Grande, Brasil Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...

  • Data Warehouse Architect

    Há 2 dias

    Campo Grande, Brasil Avm Consulting Inc Tempo inteiro

    Databricks Data Warehouse ArchitectAbout the roleOne of the largest companies in the world in the Gaming industry is seeking a hands-on Data Architect with Data Warehouse Engineer expertise in Databricks (DBX) and AWS-native data services to spearhead the design and implementation of a new data warehouse instance for a major product line.This role will...

  • Data Warehouse Architect

    Há 2 dias

    Campo Grande, Brasil AVM Consulting Inc Tempo inteiro

    Databricks Data Warehouse Architect About the role One of the largest companies in the world in the Gaming industry is seeking a hands‑on Data Architect with Data Warehouse Engineer expertise in Databricks (DBX) and AWS‑native data services to spearhead the design and implementation of a new data warehouse instance for a major product line. This role...