Data Engineer
Há 2 dias
Summary :We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines.In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions.You will play a key role in modernizing our data platform on the Azure Cloud, ensuring reliability, efficiency, and compliance across the full data lifecycle.Key Responsibilities :Data Pipeline Development : Design, build, and optimize ETL / ELT pipelines using Azure Databricks (PySpark, Delta Lake) and Azure Data Factory (ADF).Data Flows & Transformations : Develop pipelines, data flows, and complex transformations with ADF, PySpark, and T-SQL for seamless data extraction, transformation, and loading.Data Processing : Develop Databricks Python notebooks for tasks such as joining, filtering, and pre-aggregation.Database & Query Optimization : Optimize database performance through SQL query tuning, index optimization, and code improvements to ensure efficient data retrieval and manipulation.SSIS & Migration Support : Maintain and enhance SSIS package design and deployment for legacy workloads; contribute to migration and modernization into cloud-native pipelines.Collaboration & DevOps : Work with cross-functional teams using Git (Azure Repos) for version control and Azure DevOps pipelines (CI / CD) for deployment.Data Governance & Security : Partner with governance teams to integrate Microsoft Purview and Unity Catalog for cataloging, lineage tracking, and role-based security.API & External Integration : Implement REST APIs to retrieve analytics data from diverse external data feeds, enhancing accessibility and interoperability.Automation : Automate ETL processes and database maintenance tasks using SQL Agent Jobs, ensuring data integrity and operational reliability.Advanced SQL Expertise : Craft and optimize complex T-SQL queries to support efficient data processing and analytical workloads.Required Califications :5+ years of hands-on expertise with Azure Databricks, Python, PySpark, and Delta Lake.5+ years of proven experience with Azure Data Factory for orchestrating and monitoring pipelines.Strong SQL Server / T-SQL experience with a focus on query optimization, indexing strategies, and coding best practices.Demonstrated experience in SSIS package design, deployment, and performance tuning.Hands-on knowledge of Unity Catalog for governance.Experience with Git (Azure DevOps Repos) and CI / CD practices in data engineering projects.Nice to Have :Exposure to Change Data Capture (CDC), Change Data Feed (CDF), and Temporal Tables.Experience with Microsoft Purview, Power BI, and Azure-native integrations.Familiarity with Profisee Master Data Management (MDM).Working in Agile / Scrum environments.Preferred Qualifications :Microsoft Certified : Azure Data Engineer Associate (DP-203)Microsoft Certified : Azure Solutions Architect Expert or equivalent advanced Azure certificationDatabricks Certified Data Engineer Associate or ProfessionalAdditional Microsoft SQL Server or Azure certifications demonstrating advanced database and cloud expertise#J-*****-Ljbffr
-
Data Engineer
Há 16 horas
Aracaju, Brasil Polígono Capital Tempo inteiroA Polígono Capital, gestora de fundos de investimento e joint venture entre BTG Pactual e Prisma Capital, está com vaga aberta para Junior Analytics / Data Engineer.O que estamos buscando?Buscamos um(a) Junior Analytics Engineer comunicativo, proativo e pragmático para :Colaborar em equipes multifuncionais (produto, gestão, risco), traduzindo requisitos...
-
Data Engineer
Há 16 horas
Aracaju, Brasil Tata Consultancy Services Tempo inteiroCome to one of the biggest IT Services companies in the world!Here you can transform your career.Why join TCS?At TCS we believe that people make the difference, so we live a culture of unlimited learning full of opportunities for improvement and mutual development.The ideal scenario to expand ideas through the right tools, contributing to our success in a...
-
Data Engineer
Há 3 dias
Aracaju, Brasil Tata Consultancy Services Tempo inteiroCome to one of the biggest IT Services companies in the world! Here you can transform your career. Why join TCS? At TCS we believe that people make the difference, so we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to our success in...
-
Senior Data Engineer
Há 9 horas
Aracaju, Brasil Jusfy Tempo inteiroA Jusfy está em busca de um Sr Data Engineer para compor o time!Somos uma startup jurídica que busca constantemente soluções para facilitar a vida dos advogados e advogadas brasileiros.Atuamos na área de tecnologia, desenvolvendo produtos e ferramentas que auxiliam na produtividade diária dos nossos clientes.Somos uma empresa jovem e muito...
-
Artificial Intelligence Engineer
Há 2 dias
Aracaju, Brasil Cor Tempo inteiroRole OverviewWe are seeking an experienced AI Engineer to design, develop, and deploy scalable artificial intelligence and machine learning solutions.The role requires strong backend engineering skills with Go (Golang) and hands-on experience building production-grade AI systems.Key ResponsibilitiesDesign, develop, and maintain AI / ML solutions for business...
-
Artificial Intelligence Engineer
3 semanas atrás
Aracaju, Brasil Cor Tempo inteiroRole Overview We are seeking an experienced AI Engineer to design, develop, and deploy scalable artificial intelligence and machine learning solutions. The role requires strong backend engineering skills with Go (Golang) and hands‑on experience building production‑grade AI systems. Key Responsibilities Design, develop, and maintain AI / ML solutions for...
-
Machine Learning Engineer
Há 3 dias
Aracaju, Brasil Onebridge Tempo inteiroOnebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...
-
Data Engineer with Scala
4 semanas atrás
Aracaju, Brasil Aubay Portugal Tempo inteiroYour connection with Aubay starts in the following lines: Aubay Portugal is a multinational French company, in Portugal since 2007. We have offices in Lisbon and Oporto and we are a specialized consultant in Management, Implementation, Development and Maintenance of Information Systems. We have more than 150 active partners and we operate in sectors such...
-
Data Migration Specialist
Há 9 horas
Aracaju, Brasil The Methodical Group Tempo inteiroEquipment : Must have own machine; equipment not providedPosition OverviewWe are seeking a skilled Data Engineer to design, build, and optimize data migration pipelines that enable seamless transitions from legacy systems into our SaaS platform.You will work closely with both customers and internal teams to ensure data accuracy, reliability, and long-term...
-
Data Migration Specialist
1 semana atrás
Aracaju, Brasil The Methodical Group Tempo inteiroEquipment : Must have own machine; equipment not provided Position Overview We are seeking a skilled Data Engineer to design, build, and optimize data migration pipelines that enable seamless transitions from legacy systems into our SaaS platform. You will work closely with both customers and internal teams to ensure data accuracy, reliability, and...