Chief Data Architect
Há 20 horas
Cloud Data Engineer We are seeking a highly skilled data professional to design, implement and optimize enterprise-grade data pipelines. In this role you will leverage Azure Databricks, Azure Data Factory and SQL Server to enable scalable governed and performant data solutions. Key Responsibilities: Design build and optimize ETL/ELT pipelines using Azure Databricks PySpark Delta Lake and Azure Data Factory ADF. Develop pipelines data flows and complex transformations with ADF PySpark and T-SQL for seamless data extraction transformation and loading. Develop Databricks Python notebooks for tasks such as joining filtering and pre-aggregation. Optimize database performance through SQL query tuning index optimization and code improvements to ensure efficient data retrieval and manipulation. Maintain and enhance SSIS package design and deployment for legacy workloads; contribute to migration and modernization into cloud-native pipelines. Work with cross-functional teams using Git for version control and Azure DevOps pipelines for deployment. Partner with governance teams to integrate Microsoft Purview and Unity Catalog for cataloging lineage tracking and role-based security. Implement REST APIs to retrieve analytics data from diverse external data feeds enhancing accessibility and interoperability. Automate ETL processes and database maintenance tasks using SQL Agent Jobs ensuring data integrity and operational reliability. Required Skills and Qualifications: 5+ years of hands-on expertise with Azure Databricks Python PySpark and Delta Lake. 5+ years of proven experience with Azure Data Factory for orchestrating and monitoring pipelines. Strong SQL Server / T-SQL experience with a focus on query optimization indexing strategies and coding best practices. Demonstrated experience in SSIS package design deployment and performance tuning. Hands-on knowledge of Unity Catalog for governance. Experience with Git and CI/CD practices in data engineering projects. Benefits: Opportunity to work on large-scale cloud data platforms. Collaborative and dynamic work environment. Professional growth and development opportunities. Preferred Qualifications: Microsoft Certified: Azure Data Engineer Associate DP-203 Microsoft Certified: Azure Solutions Architect Expert or equivalent advanced Azure certification Databricks Certified Data Engineer Associate or Professional
-
Chief Data Architect
1 semana atrás
Salvador, BA, Brasil beBeeDataScientist Tempo inteiroJob Overview Data Scientists are integral to our team, collaborating with developers and solution architects to build scalable applications. They drive technological advancements by enhancing existing structures or proposing innovative solutions. Strong analytical skills, coupled with hands-on experience in managing data loads and ensuring high-quality...
-
Chief Data Strategist
3 semanas atrás
Salvador, BA, Brasil beBeeSolution Tempo inteiroSolution Architect Job We are seeking a highly skilled Solution Architect to design and implement end-to-end data solutions leveraging Snowflake. The ideal candidate will have a strong background in cloud-based data platforms and excellent communication skills. Main Responsibilities: Implement Medallion architecture in Snowflake, ensuring a robust...
-
Chief Data Modeler
Há 5 dias
Salvador, BA, Brasil beBeeData Tempo inteiroJob Summary Expert Data Designer Needed A leading organization is seeking an expert data designer to craft end-to-end data solutions from scratch. Key Responsibilities: Implement and maintain cutting-edge data architecture in Snowflake. Define and oversee innovative data transformation processes using Coalesce.io. Integrate and modernize legacy data systems...
-
Expert Data Architect
Há 6 dias
Salvador, BA, Brasil beBeeData Tempo inteiroExpert Data Architect We are seeking a seasoned data architect with a proven track record in designing and implementing scalable data pipelines using Databricks, Apache Kafka, and real-time data streaming solutions. Design and implement robust and efficient data architectures that meet business needs Collaborate with cross-functional teams to integrate data...
-
Lead Data Architect
3 semanas atrás
Salvador, BA, Brasil beBeeDataArchitect Tempo inteiroLead Data Architect We are seeking a seasoned Lead Data Architect to spearhead the development of cutting-edge data architectures on Google Cloud Platform (GCP). The ideal candidate will have expertise in designing and implementing scalable, secure, and high-performing data pipelines. The successful architect will lead cross-functional teams to drive...
-
Chief Data Architect
1 semana atrás
Salvador, BA, Brasil beBeeDataEngineer Tempo inteiroJob Title: Data Engineer The role of a Data Engineer involves designing, building, and maintaining scalable data pipelines and ETL processes. They must also ensure data quality and usability by cleaning, validating, and structuring raw data from various sources. Design and Build Data Pipelines: Develop and implement efficient data pipelines to support...
-
Chief Data Architect
Há 5 dias
Salvador, BA, Brasil beBeeData Tempo inteiroJob Opportunity We are seeking a skilled Data Engineer to join our team. This is an exciting opportunity to work on large-scale data processing and storage projects, leveraging AWS services such as S3, Lambda, Glue, Athena, Redshift, and DynamoDB. The ideal candidate will have extensive experience working as a Data Engineer with a strong focus on AWS...
-
Chief Data Architect
Há 5 dias
Salvador, BA, Brasil beBeeData Tempo inteiroSenior Data Engineer We are seeking an experienced Senior Data Engineer to join our team. The ideal candidate will design and implement scalable data architectures on GCP using services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer, among others. They will develop and optimize high-performance ETL/ELT pipelines, ensuring data...
-
Chief Data Architect
3 semanas atrás
Salvador, BA, Brasil beBeeData Tempo inteiroThe artefact team is looking for a skilled Data Engineer to join our data team in Salvador, Brazil. We're committed to building a diverse and inclusive environment where all voices are heard and valued. As a Data Engineer, you'll be responsible for designing, building, and maintaining scalable data pipelines using Apache Airflow. You'll collaborate with data...
-
Chief Data Architect
Há 6 dias
Salvador, BA, Brasil beBeeDataEngineer Tempo inteiroWe're looking for a skilled professional to support our product and technology team in their efforts to analyze and utilize data effectively. The ideal candidate will be responsible for creating and maintaining robust data pipelines, analyzing large datasets to identify trends and patterns, and enabling informed decision-making across the organization. Key...
