Chief Data Solutions Architect
Há 6 dias
Job Title The role of Data Lead Engineer involves providing technical direction and mentorship to a team of data engineers, ensuring best practices in coding, architecture, and data operations. As a key member of the engineering team, you will be responsible for architecting, implementing, and optimizing end-to-end data pipelines that process and transform large-scale datasets efficiently and reliably. Key skills required for this position include strong programming skills in Python, expertise in building and optimizing ETL pipelines, and extensive experience with Snowflake or equivalent data warehouses. You will also have a deep understanding of messaging queues such as Kafka, AWS SQS, or similar technologies for real-time data ingestion and processing, demonstrated ability to architect and implement scalable data solutions handling terabytes of data, hands-on experience with Apache Iceberg for managing and optimizing data lakes, and proficiency in containerization and orchestration tools like Docker and Kubernetes. Responsibilities Technical Leadership: Provide technical direction and mentorship to a team of data engineers. End-to-End Ownership: Architect, implement, and optimize end-to-end data pipelines. Orchestration and Automation: Design scalable workflows using orchestration tools. Data Warehouse and Lake Optimization: Lead the implementation and optimization of Snowflake and data lake technologies. Real-Time and Batch Processing: Build robust systems leveraging Kafka, SQS, or similar messaging technologies. Cross-Functional Collaboration: Work closely with Data Science, Product, and Engineering teams. Data Governance and Security: Establish and enforce data governance frameworks. Scalability and Performance: Develop strategies to optimize performance for systems processing terabytes of data daily. Qualifications 8+ years of experience in data engineering with a proven track record of leading data projects or teams. Strong programming skills in Python, with expertise in building and optimizing ETL pipelines. Extensive experience with Snowflake or equivalent data warehouses for designing schemas, optimizing queries, and managing large datasets. Expertise in orchestration tools like Apache Airflow, with experience in building and managing complex workflows. Deep understanding of messaging queues such as Kafka, AWS SQS, or similar technologies for real-time data ingestion and processing. Demonstrated ability to architect and implement scalable data solutions handling terabytes of data. Hands-on experience with Apache Iceberg for managing and optimizing data lakes. Proficiency in containerization and orchestration tools like Docker and Kubernetes for deploying and managing distributed systems. Strong understanding of CI/CD pipelines, including version control, deployment strategies, and automated testing. Proven experience working in an Agile development environment and managing cross-functional team interactions. Strong background in data modeling, data governance, and ensuring compliance with data security standards.
-
Chief Data Solutions Architect
Há 4 dias
Brasília, DF, Brasil beBeeDataLeadEngineer Tempo inteiroJob Title The role of Data Lead Engineer involves providing technical direction and mentorship to a team of data engineers, ensuring best practices in coding, architecture, and data operations. As a key member of the engineering team, you will be responsible for architecting, implementing, and optimizing end-to-end data pipelines that process and transform...
-
Big Data Solutions Architect
Há 7 dias
Brasília, Brasil beBeeDataEngineer Tempo inteiroData Architect and Engineer Databricks engineers build robust data pipelines using Spark, PySpark, SQL, and Delta Lake. Key Responsibilities: Optimize ETL/ELT pipelines in Databricks using PySpark, Spark SQL, and Delta Lake for efficient data processing. Ingest, clean, and transform diverse data sources from APIs, SQL databases, cloud storage, and legacy...
-
Big Data Solutions Architect
3 semanas atrás
Brasília, Brasil beBeeDataEngineer Tempo inteiroData Architect and Engineer Databricks engineers build robust data pipelines using Spark, PySpark, SQL, and Delta Lake. Key Responsibilities: Optimize ETL/ELT pipelines in Databricks using PySpark, Spark SQL, and Delta Lake for efficient data processing. Ingest, clean, and transform diverse data sources from APIs, SQL databases, cloud storage, and legacy...
-
Chief Machine Learning Architect
1 semana atrás
Brasília, Brasil beBeeMachineLearning Tempo inteiroJob Overview We are seeking a highly skilled Chief Machine Learning Architect to lead the development and deployment of advanced machine learning solutions. In this role, you will influence the technical direction of the team, collaborate closely with product and engineering partners, and drive innovation across data-driven initiatives. This is an excellent...
-
Big Data Solutions Architect
3 semanas atrás
Brasília, DF, Brasil beBeeDataEngineer Tempo inteiroData Architect and Engineer Databricks engineers build robust data pipelines using Spark, PySpark, SQL, and Delta Lake. Key Responsibilities: Optimize ETL/ELT pipelines in Databricks using PySpark, Spark SQL, and Delta Lake for efficient data processing. Ingest, clean, and transform diverse data sources from APIs, SQL databases, cloud storage, and legacy...
-
Chief Data Solutions Architect
Há 6 dias
Brasília, Brasil beBeeData Tempo inteiroSenior Data Engineer Job Description About You You are a seasoned professional with expertise in building scalable data platforms and enabling AI-driven products. You possess the ability to design, develop, and maintain complex data pipelines that meet business needs. Collaborating closely with analytics, AI/Data Science, and product teams, you work...
-
Chief Data Solutions Architect
Há 6 dias
Brasília, DF, Brasil beBeeData Tempo inteiroSenior Data Engineer Job Description About You You are a seasoned professional with expertise in building scalable data platforms and enabling AI-driven products. You possess the ability to design, develop, and maintain complex data pipelines that meet business needs. Collaborating closely with analytics, AI/Data Science, and product teams, you work...
-
Chief .NET Solutions Architect
2 semanas atrás
Brasília, Brasil beBeeExpert Tempo inteiroSeeking an accomplished .NET professional to lead technology initiatives and develop cutting-edge solutions in a cloud-first environment. Job Summary We are looking for a highly skilled .NET Architect with extensive experience in AWS Cloud Services and modern software engineering practices to drive the modernization of existing applications, architect...
-
Chief .NET Solutions Architect
3 semanas atrás
Brasília, Brasil beBeeExpert Tempo inteiroSeeking an accomplished .NET professional to lead technology initiatives and develop cutting-edge solutions in a cloud-first environment. Job Summary We are looking for a highly skilled .NET Architect with extensive experience in AWS Cloud Services and modern software engineering practices to drive the modernization of existing applications, architect...
-
Chief .NET Solutions Architect
3 semanas atrás
Brasília, DF, Brasil beBeeExpert Tempo inteiroSeeking an accomplished .NET professional to lead technology initiatives and develop cutting-edge solutions in a cloud-first environment. Job Summary We are looking for a highly skilled .NET Architect with extensive experience in AWS Cloud Services and modern software engineering practices to drive the modernization of existing applications, architect...
