Data Engineer

2 semanas atrás

São Caetano do Sul, Brasil Zunzun Solutions Tempo inteiro

Summary We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise‑grade data pipelines. In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions. You will play a key role in modernizing our data platform on the Azure Cloud, ensuring reliability, efficiency, and compliance across the full data lifecycle. Key Responsibilities Data Pipeline Development: Design, build, and optimize ETL / ELT pipelines using Azure Databricks (PySpark, Delta Lake) and Azure Data Factory (ADF). Data Flows & Transformations: Develop pipelines, data flows, and complex transformations with ADF, PySpark, and T‑SQL for seamless data extraction, transformation, and loading. Data Processing: Develop Databricks Python notebooks for tasks such as joining, filtering, and pre‑aggregation. Database & Query Optimization: Optimize database performance through SQL query tuning, index optimization, and code improvements to ensure efficient data retrieval and manipulation. SSIS & Migration Support: Maintain and enhance SSIS package design and deployment for legacy workloads; contribute to migration and modernization into cloud‑native pipelines. Collaboration & DevOps: Work with cross‑functional teams using Git (Azure Repos) for version control and Azure DevOps pipelines (CI / CD) for deployment. Data Governance & Security: Partner with governance teams to integrate Microsoft Purview and Unity Catalog for cataloging, lineage tracking, and role‑based security. API & External Integration: Implement REST APIs to retrieve analytics data from diverse external data feeds, enhancing accessibility and interoperability. Automation: Automate ETL processes and database maintenance tasks using SQL Agent Jobs, ensuring data integrity and operational reliability. Advanced SQL Expertise: Craft and optimize complex T‑SQL queries to support efficient data processing and analytical workloads. Required Qualifications 5+ years of hands‑on expertise with Azure Databricks, Python, PySpark, and Delta Lake. 5+ years of proven experience with Azure Data Factory for orchestrating and monitoring pipelines. Strong SQL Server / T‑SQL experience with a focus on query optimization, indexing strategies, and coding best practices. Demonstrated experience in SSIS package design, deployment, and performance tuning. Hands‑on knowledge of Unity Catalog for governance. Experience with Git (Azure DevOps Repos) and CI / CD practices in data engineering projects. Nice to Have Exposure to Change Data Capture (CDC), Change Data Feed (CDF), and Temporal Tables. Experience with Microsoft Purview, Power BI, and Azure‑native integrations. Familiarity with Profisee Master Data Management (MDM). Working in Agile / Scrum environments. Preferred Qualifications Microsoft Certified: Azure Data Engineer Associate (DP‑203) Microsoft Certified: Azure Solutions Architect Expert or equivalent advanced Azure certification Databricks Certified Data Engineer Associate or Professional Additional Microsoft SQL Server or Azure certifications demonstrating advanced database and cloud expertise #J-18808-Ljbffr

  • Data Engineer

    2 semanas atrás

    São Caetano do Sul, Brasil Zunzun Solutions Tempo inteiro

    SummaryWe are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines.In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions.You will play a key role in modernizing our data platform on the...

  • Senior Data Engineer

    3 semanas atrás

    São Paulo, Brasil Grupo Data Tempo inteiro

    Overview Hi! Weare DATA Group and we are searching for the best talent! Our goal is tosimplify our clients' lives with innovative IT solutions. We operate at globalscale and we are expanding to Portugal! If youare passionate and have the desire to make the difference, we want to get toknow you! Join us to be part of this incredible adventure! Whoare we...

  • Senior Data Engineer

    4 semanas atrás

    Sapucaia do Sul, Brasil Pride Global Tempo inteiro

    We're Hiring : Senior Data Engineer | Remote from Brazil | Fluent English required | Location : Remote – Brazil only Contact : Temporary Are you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing e-commerce and circular fashion? We're looking for a Senior Data...

  • Data Engineer

    3 semanas atrás

    São Caetano do Sul, Brasil Artefact Tempo inteiro

    The current vacancy is for the Brazilian office and we work in a Free Office model. Who we are At Artefact LatAm, we believe in and live a culture based on empathy! A healthy work environment is a place where all voices are heard, respected, and valued. Our commitment is to build a more diverse and inclusive environment, because empathy is for everyone,...

  • Senior Data Engineer

    3 semanas atrás

    Sapucaia do Sul, Brasil Applaudo Tempo inteiro

    About You You are a Senior Data Engineer who enjoys building reliable, scalable data platforms and enabling data-driven and AI-powered products. You feel comfortable owning data pipelines end to end, working closely with analytics and AI / Data Science teams, and translating complex data problems into robust technical solutions. You value clean architecture,...

  • Senior Data Engineer

    Há 5 horas

    Caxias do Sul, Brasil Applaudo Tempo inteiro

    About You You are a Senior Data Engineer who enjoys building reliable, scalable data platforms and enabling data-driven and AI-powered products. You feel comfortable owning data pipelines end to end, working closely with analytics and AI/Data Science teams, and translating complex data problems into robust technical solutions. You value clean architecture,...

  • Data Engineer

    2 semanas atrás

    São Paulo, Brasil PIXIE Tempo inteiro

    Position: Data Engineer Location: 04578-000 (Hybrid - 3 days onsite) Duration: 12-month contract Data Engineer We are seeking a Data Engineer to design, develop, and optimize data pipelines that support Retail Power's forecasting, pricing, and reporting operations. This role is responsible for integrating Salesforce data, usage history, pricing curves, and...

  • Data Engineer

    3 semanas atrás

    Santa Cruz do Sul, Brasil Brick Abode Tempo inteiro

    Data Engineer – Brick Abode Join to apply for the Data Engineer role at Brick Abode . 1 month ago – be among the first 25 applicants. About Brick Abode We are a software development company serving clients from multiple countries around the world, with differing technological needs. We value a strong computer science foundation. Contractors with a solid...

  • Azure Data Engineer

    Há 2 dias

    Caxias do Sul, Brasil Penta Consulting Tempo inteiro

    We are currently looking for a Portuguese speaking Data Engineer to work across Microsoft Azure solutions in delivering proactive services and workshops to premier enterprise customers in remotely in Brazil. Key Responsibilities Design and implement end-to-end data architecture solutions on Microsoft Azure. Develop and manage ETL/ELT pipelines using Azure...

  • Sr Data Engineer

    3 semanas atrás

    Sapucaia do Sul, Brasil Luxoft Tempo inteiro

    Before you apply, please get familiar with Luxoft Luxoft locations: https://career.luxoft.com/locations/ Logeek Magazine: https://career.luxoft.com/logeek-magazine/ Luxoft Alumni Club: https://career.luxoft.com/alumni/ Responsibilities: Design and implement scalable data pipelines using Databricks and Kafka Build and maintain real-time streaming solutions...