Empregos atuais relacionados a Mastering Data Pipeline Architecture - Brasília - beBeeDataEngineering
-
Data Pipeline Architect
4 semanas atrás
Brasília, Brasil beBeeDataDeveloper Tempo inteiroExpert Data Developer Design and build scalable data pipelines using AWS services. Develop efficient integration processes with Lambda or Fargate for seamless data ingestion. Implement robust processing pipelines in PySpark (AWS Glue or EMR) to meet high performance standards. Manage and optimize large datasets in S3 and Glue Data Catalog. Ensure...
-
Senior Data Engineer
3 semanas atrás
Brasília, DF, Brasil beBeeDataEngineer Tempo inteiroJob Description Becoming a Key Player in Data Engineering is an exciting opportunity to shape the future of data-driven decision making. As a senior data engineer, you will play a pivotal role in building and maintaining high-performance data pipelines that fuel business growth. Key Responsibilities: Create and optimize data pipelines for various data...
-
Data Pipeline Architect
4 semanas atrás
Brasília, DF, Brasil beBeeDataDeveloper Tempo inteiroExpert Data Developer Design and build scalable data pipelines using AWS services. Develop efficient integration processes with Lambda or Fargate for seamless data ingestion. Implement robust processing pipelines in PySpark (AWS Glue or EMR) to meet high performance standards. Manage and optimize large datasets in S3 and Glue Data Catalog. Ensure...
-
Senior Data Engineer
2 semanas atrás
Brasília, Brasil Stefanini Group Tempo inteiroMission Responsible for building, managing, and optimizing data pipelines; Support for defining data flows and access to data sources; Ensure compliance with data governance, data architecture, and data security requirements. Responsibilities Create, maintain, and optimize data pipelines for data structures that encompass data modeling, data transformation,...
-
Senior Data Pipeline Developer
3 semanas atrás
Brasília, DF, Brasil beBeeDataEngineer Tempo inteiroUnlock Your Career in Data Engineering Job Description As a data engineer, you will play a critical role in designing and building scalable data pipelines that integrate diverse enterprise data sources for AI processing. You will work closely with cross-functional teams to develop connectors and adapters for enterprise systems, implement data quality...
-
Data Engineering Expert
4 semanas atrás
Brasília, Brasil beBeeDataEngineer Tempo inteiroJob Description Transform your career as a Data Engineer in a collaborative and innovative environment. We are seeking an experienced professional to design and implement an AWS Serverless DataLake architecture, develop data ingestion pipelines, and optimize data storage and retrieval mechanisms. This role offers opportunities for professional development,...
-
Cloud Data Specialist
4 semanas atrás
Brasília, Brasil beBeeDataSpecialist Tempo inteiroJob Description: We are seeking an experienced professional to design, develop, and maintain scalable data pipelines using cloud-based services. This role involves leveraging big data technologies such as Azure Data Factory, Databricks, and Synapse Analytics to drive business growth and improvement. The ideal candidate will have expertise in columnar storage...
-
Chief Data Infrastructure Architect
4 semanas atrás
Brasília, Brasil beBeeDataEngineer Tempo inteiroRole Overview We are seeking a seasoned Data Engineer to join our team and drive the design, development, and maintenance of scalable data pipelines. Design and implement high-performance data pipelines using Databricks and Kafka. Build and maintain real-time streaming solutions for large-scale data processing. Collaborate with cross-functional teams to...
-
Data Architect Specialist
2 semanas atrás
Brasília, DF, Brasil beBeeApacheNifi Tempo inteiroJob Overview A data engineer with expertise in Apache Nifi is needed to manage and implement data pipelines. The ideal candidate will have hands-on experience with Apache Nifi; a strong understanding of data flow patterns, integration design principles, XML, and XPath; Implementing scalable data architectures for enterprise systems; Designing and developing...
-
Cloud Data Architect Position
2 semanas atrás
Brasília, DF, Brasil beBeeDataArchitecturalEngineer Tempo inteiroJob Title: Data Architectural Engineer Transform your career by designing and implementing scalable, high-performance data architectures on Google Cloud Platform (GCP). Responsibilities: Develop ETL/ELT pipelines using BigQuery, Dataflow, Dataproc, and Pub/Sub. Evaluate data quality, integrity, and security end-to-end. Create and maintain data models aligned...
Mastering Data Pipeline Architecture
4 semanas atrás
Lead Data Engineer As a Lead Data Engineer, you will provide technical direction and mentorship to a team of data engineers. Your expertise in architecting, implementing, and optimizing end-to-end data pipelines will ensure the efficient and reliable processing of large-scale datasets. Key Responsibilities: Design scalable workflows using orchestration tools such as Apache Airflow to ensure high availability and fault tolerance. Lead the implementation and optimization of Snowflake and data lake technologies like Apache Iceberg for storage, query performance, and scalability. Built robust systems leveraging Kafka, SQS, or similar messaging technologies for real-time and batch data processing. Work closely with Data Science, Product, and Engineering teams to define data requirements and deliver actionable insights. Establish and enforce data governance frameworks to ensure compliance with regulatory standards and maintain data integrity. Requirements: 8+ years of experience in data engineering. Strong programming skills in Python. Expertise in building and optimizing ETL pipelines. Experience with Snowflake or equivalent data warehouses. Benefits: This role offers the opportunity to work on complex data engineering challenges and collaborate with cross-functional teams to drive business outcomes. As a Lead Data Engineer, you will have the autonomy to design and implement data solutions that meet the needs of the business while ensuring data quality and integrity. Our company values innovation, collaboration, and continuous learning, and we offer opportunities for growth and development in a dynamic and supportive environment.
