Senior Cloud Data Solutions Architect

4 semanas atrás

Porto Alegre RS, Brasil beBeeDataEngineer Tempo inteiro

Job Title: Data Architect We are seeking an experienced Data Architect to design and implement enterprise-grade data solutions using Azure Databricks, Azure Data Factory, SQL Server, and Python. This role requires a deep understanding of scalable data pipelines, governed data platforms, and performant data processing. You will be responsible for designing, building, and optimizing ETL/ELT pipelines using Azure Databricks (PySpark, Delta Lake) and Azure Data Factory (ADF). In addition to pipeline development, you will work on developing complex transformations with ADF, PySpark, and T-SQL for seamless data extraction, transformation, and loading. This includes developing Databricks Python notebooks for tasks such as joining, filtering, and pre-aggregation. You will also be responsible for optimizing database performance through SQL query tuning, index optimization, and code improvements to ensure efficient data retrieval and manipulation. Additionally, you will maintain and enhance SSIS package design and deployment for legacy workloads; contribute to migration and modernization into cloud-native pipelines. We require collaboration and DevOps skills, including working with cross-functional teams using Git (Azure Repos) for version control and Azure DevOps pipelines (CI/CD) for deployment. Data governance and security are also critical components of this role, partnering with governance teams to integrate Microsoft Purview and Unity Catalog for cataloging, lineage tracking, and role-based security. Familiarity with REST APIs to retrieve analytics data from diverse external data feeds is essential. Automation of ETL processes and database maintenance tasks using SQL Agent Jobs ensures data integrity and operational reliability. Finally, advanced SQL expertise is necessary for crafting and optimizing complex T-SQL queries to support efficient data processing and analytical workloads. Required Skills: Azure Databricks: 5+ years of hands-on experience with designing, building, and optimizing ETL/ELT pipelines Python: Strong programming skills in Python for developing Databricks notebooks and automating tasks PySpark: Experience with using PySpark for data processing and transformations Delta Lake: Familiarity with Delta Lake for storing and managing data Azure Data Factory: Proven experience with ADF for orchestrating and monitoring pipelines SQL Server/T-SQL: Strong knowledge of SQL Server and T-SQL for query optimization and database management SSIS Package Design: Experience with designing, deploying, and performing SSIS packages GIT/Azure Repos: Knowledge of GIT and Azure Repos for version control CICD Practices: Familiarity with CI/CD practices in data engineering projects Data Governance: Understanding of data governance concepts and integration with Microsoft Purview and Unity Catalog Benefits: This role offers the opportunity to work on exciting data engineering projects and collaborate with cross-functional teams. You will have the chance to develop your skills and expertise in Azure technologies, including Databricks, Data Factory, and SQL Server. In addition, you will be part of a dynamic team that values innovation, teamwork, and customer satisfaction. Others: Please note that a Microsoft Certified: Azure Data Engineer Associate (DP-203) certification is preferred but not required. Additional certifications demonstrating advanced database and cloud expertise are also valued.

  • Cloud Solutions Architect

    4 semanas atrás

    Porto Alegre, RS, Brasil beBeeCloudArchitect Tempo inteiro

    Job Title: Cloud Solutions Architect We are seeking a skilled Cloud Solutions Architect to join our team. As a Cloud Solutions Architect, you will be responsible for designing and implementing scalable and secure cloud-based solutions. Design and implement scalable and secure cloud-based solutions using Azure services such as VNets, subnets, DNS, and...

  • Cloud Solution Architect

    4 semanas atrás

    Porto Alegre, RS, Brasil beBeeDatabricks Tempo inteiro

    Job Title: Cloud Solution Architect We are looking for an experienced Cloud Solution Architect to lead the design and development of scalable data pipelines using Databricks. Develop cloud-native solutions with strong experience in Databricks and exposure to AWS-based application development. Design, develop, and maintain complex data workflows integrating...

  • Cloud Data Platform Specialist

    4 semanas atrás

    Porto Alegre, RS, Brasil beBeeData Tempo inteiro

    Data Solutions Expert The role involves designing and architecting end-to-end data solutions using cloud-based platforms. Responsibilities include implementing and maintaining a robust architecture, defining and overseeing data transformation processes, integrating and modernizing legacy data systems, and collaborating with cross-functional teams. Key...

  • Data-Driven Solutions Architect

    4 semanas atrás

    Porto Alegre, RS, Brasil beBeeData Tempo inteiro

    Unlocking business success lies in crafting and deploying AI solutions that scale. This involves developing end-to-end machine learning pipelines, implementing automation to drive informed decision-making, and empowering personalized experiences. Collaborating closely with cross-functional teams is vital for architecting robust AI infrastructure and ensuring...

  • Cloud Architect

    4 semanas atrás

    Porto Alegre, RS, Brasil beBeeCloud Tempo inteiro

    Cloud Infrastructure Developer We are seeking a Cloud Infrastructure Developer to design, build, and automate cloud-based infrastructure that supports high-scale financial transactions. This role focuses on delivering secure, resilient, and scalable cloud foundations that meet the needs of our organization. You will work in a highly technical environment,...

  • Lead Data Architect

    4 semanas atrás

    Porto Alegre, RS, Brasil beBeeDataEngineer Tempo inteiro

    Senior Data Engineer We're seeking a skilled data engineer to design and implement large-scale data pipelines and ingestion processes supporting analytics and AI initiatives. The ideal candidate will possess expertise in ETL/ELT workflows, ensuring seamless data integration and efficient processing. This role involves collaborating with cross-functional...

  • Chief Data Solutions Architect

    4 semanas atrás

    Porto Alegre, RS, Brasil beBeeDataEngineer Tempo inteiro

    Job Opportunity The Data Engineer plays a pivotal role in bridging the Analytics team and Engineering team by rationalizing data requests, designing ideal solutions, executing new data flow, maintaining existing data flow, and driving operational excellence for the analytics team. Key responsibilities include collaborating with stakeholders to prioritize...

  • Master Cloud Infrastructure Designer

    4 semanas atrás

    Porto Alegre, RS, Brasil beBeeInfrastructure Tempo inteiro

    Cloud Architect A comprehensive and visionary role is available for a skilled Cloud Architect to design, implement, and maintain secure, scalable, and cost-effective cloud infrastructure solutions. This exciting opportunity will see you working with cutting-edge technologies to create robust, well-architected cloud environments that meet the needs of our...

  • Chief Data Architect

    4 semanas atrás

    Porto Alegre, Brasil Bebeedata Tempo inteiro

    Cloud Data Engineer Position We are seeking an experienced Cloud Data Engineer to lead the design, development, and maintenance of scalable data processing pipelines in a cloud environment. This role involves working closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality datasets. Key...

  • Data Architect

    Há 4 dias

    Porto Belo, Brasil CriticalRiver Inc. Tempo inteiro

    Job Title: Data Architect Duration: 6months Location: LATAM [Remote] Need to support PST timings Description: What You'll Do Design & Strategy: Develop and maintain the overall data architecture aligned with organizational strategy. Blueprint Creation: Create conceptual, logical, and physical data models to support data storage, processing, and consumption...