Databricks Pipeline Architect
Há 21 horas
Job Title:A Databricks Data EngineerJob DescriptionWe are seeking a seasoned professional with strong experience in building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake to join our team.The role involves ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and visualizations.Responsibilities:Design and optimize ETL/ELT pipelines in Databricks using PySpark, Spark SQL, and Delta Lake to meet business requirements.Ingest, clean, and transform data from diverse sources such as APIs, SQL databases, cloud storage, and SAP systems.Develop reusable pipeline frameworks, data validation logic, and performance-tuned transformations.Deliver insights through Power BI dashboards by designing curated datasets.Implement best practices for lakehouse development, orchestration, and version control.Troubleshoot pipeline performance issues and ensure data accuracy, reliability, and quality.Required Skills and Qualifications:Advanced knowledge of Databricks (Spark, PySpark, Delta Lake) and its applications.Strong hands-on experience with large-scale data processing using SQL.Ability to integrate data from multiple structured and unstructured sources.Solid understanding of distributed computing, performance tuning, and debugging Spark jobs.Proficiency in Power BI including reports, models, and DAX.Experience with CI/CD pipelines in an Azure environment.Nice to Have:Knowledge of data quality frameworks, Lakehouse monitoring, or DQX.Familiarity with Airflow, ADF, IoT, Kafka or other tools is beneficial.Experience with SAP data is desirable.
-
Databricks Pipeline Architect
Há 18 horas
Recife, Brasil beBeeDataEngineer Tempo inteiroJob Title: A Databricks Data Engineer Job Description We are seeking a seasoned professional with strong experience in building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake to join our team. The role involves ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and visualizations....
-
Databricks Pipeline Architect
Há 3 dias
Recife, PE, Brasil beBeeDataEngineer Tempo inteiroJob Title: A Databricks Data Engineer Job Description We are seeking a seasoned professional with strong experience in building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake to join our team. The role involves ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and visualizations....
-
Data Engineer – Databricks
Há 18 horas
Recife, Brasil UPBI Data & AI Tempo inteiroA UPBI Data & AI , consultoria especializada em soluções digitais, parceira Microsoft e Databricks, está buscando um(a) Data Engineer com sólida experiência em Databricks e Azure para atuação em projeto internacional estratégico.Modelo: RemotoRegime: PJResponsabilidades:Desenvolver e otimizar pipelines de dados utilizando Databricks e serviços Azure...
-
Senior Data Architect
1 semana atrás
Recife, Brasil Bebeedata Tempo inteiroData Architect OpportunityWe are seeking a highly skilled Data Architect to join our team.The ideal candidate will have at least 6 years of experience as a Data Engineer, 1 year as a Data Architect, and expertise in Cloud environments, Big Data tools, and maintenance, deployment, and development projects.Cloud environments: Azure, GCP, AWSBig Data tools:...
-
Engenheiro de Dados
2 semanas atrás
Recife, Brasil Dadoteca Tempo inteiroResumo da PosiçãoBuscamos um(a)Engenheiro(a) de Dadoscomcertificação obrigatória Databricks Certified Data Engineer Professional , para atuar no desenvolvimento de soluções de dados emAzureeDatabricks . Este profissional será responsável por projetar, implementar e otimizar pipelines de dados escaláveis e de alta performance, assegurando...
-
Lead Data Pipeline Developer
Há 18 horas
Recife, Brasil beBeeData Tempo inteiroKey Roles of a Data Engineer A multinational corporation is seeking an experienced data engineer to spearhead the design, development, and maintenance of large-scale data pipelines. Primary responsibilities include: Collaborating with cross-functional teams to integrate data into business applications; Developing and implementing robust data quality...
-
Lead Data Pipeline Developer
1 dia atrás
Recife, PE, Brasil beBeeData Tempo inteiroKey Roles of a Data Engineer A multinational corporation is seeking an experienced data engineer to spearhead the design, development, and maintenance of large-scale data pipelines. Primary responsibilities include: Collaborating with cross-functional teams to integrate data into business applications; Developing and implementing robust data quality...
-
Chief Cloud Architect
2 semanas atrás
Recife, Brasil beBeeDataEngineer Tempo inteiroJob Title: Senior Data Engineer We are seeking a skilled professional to lead the design, build, and optimization of data pipelines and modern cloud-based data platforms. Design, build, and optimize ETL/ELT processes and data pipelines for structured and unstructured data; Develop and maintain data lakes, warehouses, and analytics platforms in the cloud;...
-
Chief Cloud Architect
2 semanas atrás
Recife, Brasil Bebeedataengineer Tempo inteiroJob Title: Senior Data EngineerWe are seeking a skilled professional to lead the design, build, and optimization of data pipelines and modern cloud-based data platforms.Design, build, and optimize ETL/ELT processes and data pipelines for structured and unstructured data;Develop and maintain data lakes, warehouses, and analytics platforms in the cloud;Ensure...
-
Data Engineer – Databricks | Azure
Há 22 horas
Recife, Brasil Upbi Data & Ai Tempo inteiroAUPBI Data & AI , consultoria especializada em soluções digitais, parceira Microsoft e Databricks, está buscando um(a)Data Engineercom sólida experiência emDatabricks e Azurepara atuação em projeto internacional estratégico.Modelo: RemotoRegime: PJResponsabilidades:Desenvolver e otimizar pipelines de dados utilizandoDatabrickse serviçosAzure...
