Data Pipeline Architect
4 semanas atrás
Databricks Data Engineer This role involves designing, developing and delivering scalable data pipelines using Spark, PySpark, SQL and Delta Lake. Develop ETL/ELT pipelines in Databricks using PySpark, Spark SQL and Delta Lake. Ingest, clean and transform data from diverse sources such as APIs, SQL databases, cloud storage and SAP/legacy systems. Create reusable pipeline frameworks, data validation logic and performance-tuned transformations. Design curated datasets and deliver insights through Power BI dashboards. Implement best practices for lakehouse development, orchestration and version control. Troubleshoot pipeline performance issues and ensure data accuracy, reliability and quality. Required Skills and Qualifications: Strong hands-on experience with Databricks (Spark, PySpark, Delta Lake). Advanced SQL skills for large-scale data processing. Experience integrating data from multiple structured and unstructured sources. Solid understanding of distributed computing, performance tuning and debugging Spark jobs. Power BI (reports, models, DAX preferred). Experience with CI/CD pipelines in an Azure environment. Nice to Have: Experience with data quality frameworks, lakehouse monitoring or DQX. Knowledge of Airflow, ADF, IoT or other tools is a plus. Experience with SAP data is a plus.
-
Chief Data Pipeline Architect
3 semanas atrás
Recife, PE, Brasil beBeeDataEngineer Tempo inteiroKey Data Engineer Role We are looking for a seasoned expert in data engineering with a focus on artificial intelligence and machine learning to join our analytics team. This role will involve designing scalable data pipelines, operationalizing machine learning workflows, and collaborating closely with data scientists. Create end-to-end data pipelines using...
-
Lead Data Pipeline Architect
4 semanas atrás
Recife, PE, Brasil beBeeDataEngineer Tempo inteiroJob Overview The Senior Data Engineer will be responsible for building, managing, and optimizing data pipelines to ensure compliance with data governance, data architecture, and data security requirements. Develop and maintain scalable data pipelines that encompass data modeling, data transformation, schemas, metadata, and workload management; Drive...
-
Cloud Data Architect
4 semanas atrás
Recife, PE, Brasil beBeeCloud Tempo inteiroSenior Cloud Data Architect Role We are seeking an experienced Senior Cloud Data Architect who can design and develop scalable data infrastructure using Azure Data Services. The ideal candidate will have expertise in cloud-based data platforms, including knowledge of Apache Spark (PySpark) on Azure Databricks and data quality tools such as Great Expectations...
-
Cloud-based Data Architect
3 semanas atrás
Recife, PE, Brasil beBeeDataEngineering Tempo inteiroSolution Architect We are seeking an experienced Solution Architect to join our team. Key Responsibilities: To design and implement scalable data architecture solutions that meet business requirements. Collaborate with technical teams to develop and maintain robust dimensional data models for the gold layer using Medallion architecture in Snowflake. Define,...
-
Chief Data Pipeline Architect
3 semanas atrás
Recife, Brasil beBeeDataEngineer Tempo inteiroKey Data Engineer Role We are looking for a seasoned expert in data engineering with a focus on artificial intelligence and machine learning to join our analytics team. This role will involve designing scalable data pipelines, operationalizing machine learning workflows, and collaborating closely with data scientists. Create end-to-end data pipelines using...
-
Cloud Data Architect
3 semanas atrás
Recife, Brasil beBeeCloud Tempo inteiroSenior Cloud Data Architect Role We are seeking an experienced Senior Cloud Data Architect who can design and develop scalable data infrastructure using Azure Data Services. The ideal candidate will have expertise in cloud-based data platforms, including knowledge of Apache Spark (PySpark) on Azure Databricks and data quality tools such as Great Expectations...
-
Data Pipeline Specialist
3 semanas atrás
Recife, PE, Brasil beBeeBackend Tempo inteiroBackend Engineer Opportunity Job Description This role focuses on designing and developing backend services and data pipelines using Python. The ideal candidate will have experience with AWS data workflows, AI/LLM frameworks, and Kubernetes-hosted applications. Mandatory Skills and Qualifications Strong expertise in Python development Proficiency in SQL and...
-
Senior Data Systems Architect
4 semanas atrás
Recife, PE, Brasil beBeeData Tempo inteiroData Architect Specialist Role Overview: We are seeking a highly skilled Data Architect to lead the design and development of our large-scale data systems. This key role requires strong technical expertise, excellent communication skills, and the ability to collaborate effectively with cross-functional teams. Key Responsibilities: Design Scalable Data...
-
Chief Data Architect
3 semanas atrás
Recife, PE, Brasil beBeeData Tempo inteiroJob Title: Data Engineer As a data engineer you will be responsible for building and maintaining scalable data pipelines, analyzing large datasets, and enabling business-driven decision-making across the organization. Key Responsibilities: Design, build, and maintain data pipelines and ETL processes to ensure efficient data flow. Clean, validate, and...
-
Data Environment Architect
3 semanas atrás
Recife, PE, Brasil beBeeAutomator Tempo inteiro**DevOps Position Overview** Our organization is seeking a highly skilled DevOps Engineer to join our team. The ideal candidate will have expertise in architecting and maintaining Continuous Integration/Continuous Deployment (CI/CD) pipelines for large-scale data environments, as well as implementing Infrastructure-as-Code with Terraform. Implement a robust...