Data Engineer

Há 18 horas

Mossoró, Brasil Zunzun Solutions Tempo inteiro

Summary:We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines. In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions. You will play a key role in modernizing our data platform on the Azure Cloud, ensuring reliability, efficiency, and compliance across the full data lifecycle.Key Responsibilities:· Data Pipeline Development:Design, build, and optimize ETL/ELT pipelines using Azure Databricks (PySpark, Delta Lake) and Azure Data Factory (ADF).·Data Flows & Transformations:Develop pipelines, data flows, and complex transformations with ADF, PySpark, and T-SQL for seamless data extraction, transformation, and loading.·Data Processing:Develop Databricks Python notebooks for tasks such as joining, filtering, and pre-aggregation.·Database & Query Optimization:Optimize database performance through SQL query tuning, index optimization, and code improvements to ensure efficient data retrieval and manipulation.·SSIS & Migration Support:Maintain and enhance SSIS package design and deployment for legacy workloads; contribute to migration and modernization into cloud-native pipelines.·Collaboration & DevOps:Work with cross-functional teams using Git (Azure Repos) for version control and Azure DevOps pipelines (CI/CD) for deployment.·Data Governance & Security: Partner with governance teams to integrate Microsoft Purview and Unity Catalog for cataloging, lineage tracking, and role-based security.·API & External Integration:Implement REST APIs to retrieve analytics data from diverse external data feeds, enhancing accessibility and interoperability.·Automation:Automate ETL processes and database maintenance tasks using SQL Agent Jobs, ensuring data integrity and operational reliability.·Advanced SQL Expertise:Craft and optimize complex T-SQL queries to support efficient data processing and analytical workloads.Required Califications:·5+ years of hands-on expertise with Azure Databricks, Python, PySpark, and Delta Lake.· 5+ years of proven experience with Azure Data Factory for orchestrating and monitoring pipelines.· Strong SQL Server / T-SQL experience with a focus on query optimization, indexing strategies, and coding best practices.· Demonstrated experience in SSIS package design, deployment, and performance tuning.· Hands-on knowledge of Unity Catalog for governance.· Experience with Git (Azure DevOps Repos) and CI/CD practices in data engineering projects.Nice to Have:·Exposure to Change Data Capture (CDC), Change Data Feed (CDF), and Temporal Tables.· Experience with Microsoft Purview, Power BI, and Azure-native integrations.· Familiarity with Profisee Master Data Management (MDM).· Working in Agile/Scrum environments.Preferred Qualifications:Microsoft Certified: Azure Data Engineer Associate (DP-203)Microsoft Certified: Azure Solutions Architect Expert or equivalent advanced Azure certificationDatabricks Certified Data Engineer Associate or ProfessionalAdditional Microsoft SQL Server or Azure certifications demonstrating advanced database and cloud expertise

  • Data Engineer

    Há 6 dias

    Mossoró, Brasil Brick Abode Tempo inteiro

    Join to apply for the Data Engineer role at Brick Abode3 weeks ago Be among the first 25 applicantsHey, Dev, check the opportunity we have here at Brick Abode!About Brick AbodeWe are a software development company that serves clients from multiple countries around the world, with differing technological needs.Therefore, we value a good computer science...

  • Data Engineer

    Há 6 dias

    Mossoró, Brasil Brick Abode Tempo inteiro

    Join to apply for the Data Engineer role at Brick Abode 3 weeks ago Be among the first 25 applicants Hey, Dev, check the opportunity we have here at Brick Abode! About Brick Abode We are a software development company that serves clients from multiple countries around the world, with differing technological needs. Therefore, we value a good computer science...

  • Data Engineer

    Há 6 dias

    Mossoró, Brasil Artefact Tempo inteiro

    Who we areThe current vacancy is for the Brazilian office and we work in a Free Office model.At Artefact LatAm, we believe in and live a culture based on empathy!A healthy work environment is a place where all voices are heard, respected, and valued.Our commitment is to build a more diverse and inclusive environment, because empathy is for everyone,...

  • Senior Data Engineer

    Há 3 dias

    Mossoró, Brasil Sankhya Gestão De Negócios Tempo inteiro

    Como Senior Data Engineer na área de Analytics & IA da Sankhya, você terá a missão de projetar, desenvolver e manter soluções escaláveis de dados, desenhar arquiteturas eficientes, garantir governança, segurança e alta performance. Atuará em colaboração com squads multidisciplinares, impulsionando inovação e contribuindo para a evolução da...

  • Data Warehouse Architect

    3 semanas atrás

    Mossoró, Brasil AVM Consulting Inc Tempo inteiro

    Databricks Data Warehouse ArchitectAbout the role: One of the largest companies in the world in the Gaming industry is seeking a hands-on Data Architect with DataWarehouse Engineer expertise in Databricks (DBX) and AWS-native data services to spearhead the design and implementation of a new data warehouse instance for a major product line. This role will...

  • Devops Engineer

    Há 6 dias

    Mossoró, Brasil Avenue Code Tempo inteiro

    About the OpportunityWe are looking for an experienced a DevOps Engineer to support the transition of a Retrieval-Augmented Generation (RAG) backend system from a Proof of Concept (PoC) to a scalable, production-ready platform.This role will focus on building, configuring, and deploying a serverless architecture leveraging AWS Bedrock, Lambda, API Gateway,...

  • Mid/Senior Vue.Js Software Engineer

    Há 5 horas

    Mossoró, Brasil Vilt Tempo inteiro

    Your next opportunity is on the way!VILTis an IT company where we value our people, promote teamwork, and of course, good humor.We believe that diversity and inclusion make our team stronger. Everyone is welcome here, and professionals with disabilities are encouraged to apply.Take a look at this job opportunity and see if you are the next VILTian! (and if...

  • Service Desk Engineer

    Há 20 horas

    Mossoró, Brasil Sycomp Tempo inteiro

    Service Desk Engineer (Latam) Sycomp About the Company Sycomp is a global IT services and logistics provider with extensive expertise in cloud, data center, endpoint management and security solutions. Sycomp’s diverse team of consultants and engineers deliver on the company’s mission to tackle challenging global IT projects through its...

  • Sr. / Lead Qa Automation Engineer (Angular • Golang • Aws/Gcp • Full-Stack Automation)

    Há 4 dias

    Mossoró, Brasil Sky Systems, Inc. (Skysys) Tempo inteiro

    Role: Senior/Lead QA Automation Engineer Position Type: Full-Time Contract (40hrs/week) Contract Duration: Long Term Work Hours: PST Work Schedule: 8 hours/day (Mon-Fri) Location: 100% Remote We are seeking a Senior/Lead QA Automation Engineer to assess the current QA landscape and build a test automation strategy and framework from scratch.This role is...

  • Analytics Engineer Pleno

    2 semanas atrás

    Mossoró, Brasil Gran Tempo inteiro

    Estamos em busca de uma pessoa Engenheira Analítica de Dados Pleno para compor o time de Engenharia AnalíticadoGrane mudar vidas com a gente!OGrané um ecossistema que uneeducaçãoetecnologia , que acelera e customiza o aprendizado para diferentes necessidades e momentos e que já impactou mais de 2 milhões de vidas.Hoje temos 2 verticais principais:a de...