Senior Cloud Data Solutions Architect
Há 2 dias
Job Title: Data Architect We are seeking an experienced Data Architect to design and implement enterprise-grade data solutions using Azure Databricks, Azure Data Factory, SQL Server, and Python. This role requires a deep understanding of scalable data pipelines, governed data platforms, and performant data processing. You will be responsible for designing, building, and optimizing ETL/ELT pipelines using Azure Databricks (PySpark, Delta Lake) and Azure Data Factory (ADF). In addition to pipeline development, you will work on developing complex transformations with ADF, PySpark, and T-SQL for seamless data extraction, transformation, and loading. This includes developing Databricks Python notebooks for tasks such as joining, filtering, and pre-aggregation. You will also be responsible for optimizing database performance through SQL query tuning, index optimization, and code improvements to ensure efficient data retrieval and manipulation. Additionally, you will maintain and enhance SSIS package design and deployment for legacy workloads; contribute to migration and modernization into cloud-native pipelines. We require collaboration and DevOps skills, including working with cross-functional teams using Git (Azure Repos) for version control and Azure DevOps pipelines (CI/CD) for deployment. Data governance and security are also critical components of this role, partnering with governance teams to integrate Microsoft Purview and Unity Catalog for cataloging, lineage tracking, and role-based security. Familiarity with REST APIs to retrieve analytics data from diverse external data feeds is essential. Automation of ETL processes and database maintenance tasks using SQL Agent Jobs ensures data integrity and operational reliability. Finally, advanced SQL expertise is necessary for crafting and optimizing complex T-SQL queries to support efficient data processing and analytical workloads. Required Skills: Azure Databricks: 5+ years of hands-on experience with designing, building, and optimizing ETL/ELT pipelines Python: Strong programming skills in Python for developing Databricks notebooks and automating tasks PySpark: Experience with using PySpark for data processing and transformations Delta Lake: Familiarity with Delta Lake for storing and managing data Azure Data Factory: Proven experience with ADF for orchestrating and monitoring pipelines SQL Server/T-SQL: Strong knowledge of SQL Server and T-SQL for query optimization and database management SSIS Package Design: Experience with designing, deploying, and performing SSIS packages GIT/Azure Repos: Knowledge of GIT and Azure Repos for version control CICD Practices: Familiarity with CI/CD practices in data engineering projects Data Governance: Understanding of data governance concepts and integration with Microsoft Purview and Unity Catalog Benefits: This role offers the opportunity to work on exciting data engineering projects and collaborate with cross-functional teams. You will have the chance to develop your skills and expertise in Azure technologies, including Databricks, Data Factory, and SQL Server. In addition, you will be part of a dynamic team that values innovation, teamwork, and customer satisfaction. Others: Please note that a Microsoft Certified: Azure Data Engineer Associate (DP-203) certification is preferred but not required. Additional certifications demonstrating advanced database and cloud expertise are also valued.
-
Cloud Solutions Architect
2 semanas atrás
Porto Alegre, RS, Brasil beBeeCloud Tempo inteiroAs a Cloud Solutions Architect, you will play a pivotal role in designing and building cloud-native applications on Microsoft Azure. Your expertise with Java/Spring Boot, AKS, and CI/CD environments will drive the success of our modern architectures. Key Responsibilities: Develop and maintain scalable Java applications using Spring Boot Architect and deploy...
-
Cloud Solutions Architect
Há 6 dias
Porto Alegre, RS, Brasil beBeeCloudArchitect Tempo inteiroJob Title: Cloud Solutions Architect We are seeking a skilled Cloud Solutions Architect to join our team. As a Cloud Solutions Architect, you will be responsible for designing and implementing scalable and secure cloud-based solutions. Design and implement scalable and secure cloud-based solutions using Azure services such as VNets, subnets, DNS, and...
-
Cloud Solutions Architect
2 semanas atrás
Porto Alegre, Brasil beBeeCloud Tempo inteiroAs a Cloud Solutions Architect, you will play a pivotal role in designing and building cloud-native applications on Microsoft Azure. Your expertise with Java/Spring Boot, AKS, and CI/CD environments will drive the success of our modern architectures. Key Responsibilities: Develop and maintain scalable Java applications using Spring Boot Architect and deploy...
-
Cloud Solutions Architect
Há 6 dias
Porto Alegre, Brasil beBeeCloud Tempo inteiroAs a Cloud Solutions Architect, you will play a pivotal role in designing and building cloud-native applications on Microsoft Azure. Your expertise with Java/Spring Boot, AKS, and CI/CD environments will drive the success of our modern architectures. Key Responsibilities: Develop and maintain scalable Java applications using Spring Boot Architect and deploy...
-
Cloud Solutions Architect
Há 5 dias
Porto Alegre, Brasil Bebeecloudarchitect Tempo inteiroJob Title: Cloud Solutions ArchitectWe are seeking a skilled Cloud Solutions Architect to join our team.As a Cloud Solutions Architect, you will be responsible for designing and implementing scalable and secure cloud-based solutions.Design and implement scalable and secure cloud-based solutions using Azure services such as VNets, subnets, DNS, and...
-
Cloud Solutions Architect
2 semanas atrás
Porto Alegre, Brasil Bebeecloud Tempo inteiroAs a Cloud Solutions Architect, you will play a pivotal role in designing and building cloud-native applications on Microsoft Azure.Your expertise with Java/Spring Boot, AKS, and CI/CD environments will drive the success of our modern architectures.Key Responsibilities:Develop and maintain scalable Java applications using Spring BootArchitect and deploy...
-
Cloud Solution Architect
Há 6 dias
Porto Alegre, RS, Brasil beBeeDatabricks Tempo inteiroJob Title: Cloud Solution Architect We are looking for an experienced Cloud Solution Architect to lead the design and development of scalable data pipelines using Databricks. Develop cloud-native solutions with strong experience in Databricks and exposure to AWS-based application development. Design, develop, and maintain complex data workflows integrating...
-
Cloud Data Platform Specialist
Há 6 dias
Porto Alegre, RS, Brasil beBeeData Tempo inteiroData Solutions Expert The role involves designing and architecting end-to-end data solutions using cloud-based platforms. Responsibilities include implementing and maintaining a robust architecture, defining and overseeing data transformation processes, integrating and modernizing legacy data systems, and collaborating with cross-functional teams. Key...
-
AI Solutions Architect
3 semanas atrás
Porto Alegre, RS, Brasil beBeeArchitect Tempo inteiroAI Solutions Architect We are seeking an AI Solutions Architect to work as a Consultant out of our Brazilian Office. Design, develop, and deploy scalable, production-grade applications on AWS or GCP that serve as the backbone for AI-powered products. Implement and optimize sophisticated AI systems, including Retrieval-Augmented Generation (RAG) and AI...
-
Porto Alegre, Brasil beBeeData Tempo inteiroAs a Cloud Data Architect , you will be responsible for designing, developing, and maintaining scalable ETL/ELT pipelines using Azure Data Services. Key skills required for this role include proficiency in building high-performance data processing solutions with Apache Spark (PySpark) on Azure Databricks, optimizing data workflows/pipelines for performance...
