Senior Data Pipeline Specialist

Há 5 dias

São Paulo, Brasil beBeeData Tempo inteiro

Sr Data Engineer Position We are seeking a skilled Sr Data Engineer to join our team. This role involves designing and implementing scalable data pipelines using Databricks and Kafka. Key Responsibilities: Design, implement and maintain scalable data pipelines for efficient data processing Build real-time streaming solutions for high-volume data streams Collaborate with cross-functional teams to integrate data flows into broader systems Optimize performance and reliability of data processing workflows Ensure data quality, lineage and compliance across streaming and batch pipelines Mandatory Skills and Qualifications: +5 years of experience in data engineering roles Proven expertise with Databricks (Spark, Delta Lake, notebooks, performance tuning) Strong hands-on experience with Apache Kafka (topics, producers/consumers, schema registry) Solid understanding of streaming frameworks (e.g., Spark Structured Streaming, Flink or similar) Experience with cloud platforms (AWS, Azure or GCP) Proficiency in Python or Scala for data pipeline development Familiarity with CI/CD pipelines (GitLab, Jenkins) and agile tools (Jira) Exposure to data lakehouse architectures and best practices Knowledge of data governance, security and observability Bonus Points: Advanced knowledge of data processing languages (Python, Scala, Java) Experience with machine learning libraries (TensorFlow, PyTorch, scikit-learn) Understanding of data storage solutions (HDFS, S3, Azure Blob Storage)

  • Qualified Pipeline

    1 semana atrás

    São Paulo, Brasil Data Meaning Tempo inteiro

    Alteryx Specialist – Qualified Pipeline Location: USA, Brazil or Latin America Position Type: Full time or Part Time   Position Summary Data Meaning is a front-runner in Business Intelligence and Data Analytics consulting, renowned for our high-quality consulting services throughout the US and LATAM. Our expertise lies in delivering tailored solutions in...

  • Senior Data Pipeline Specialist

    Há 3 dias

    São Paulo, SP, Brasil beBeeData Tempo inteiro

    Sr Data Engineer Position We are seeking a skilled Sr Data Engineer to join our team. This role involves designing and implementing scalable data pipelines using Databricks and Kafka. Key Responsibilities: Design, implement and maintain scalable data pipelines for efficient data processing Build real-time streaming solutions for high-volume data streams...

  • Data Scientist

    1 semana atrás

    São Paulo, Brasil Data Meaning Tempo inteiro

    Data Scientist - Qualified Pipeline Location: Latam/US Position Pay: Salary depends on experience POSITION SUMMARY: Data Meaning is a front-runner in Business Intelligence and Data Analytics consulting, renowned for our high-quality consulting services throughout the US and LATAM. Our expertise lies in delivering tailored solutions in Business Intelligence,...

  • AI Specialist/Engineer

    1 semana atrás

    São Paulo, Brasil Data Meaning Tempo inteiro

    AI Specialist/Engineer – Qualified Pipeline Location: BR/LatAm/USA, Remote Position type: Full-time Contract (Short Term or Long Term) Position Summary Data Meaning is a front-runner in Business Intelligence and Data Analytics consulting, renowned for our high-quality consulting services throughout the US and beyond. Our expertise lies in delivering...

  • AI Specialist

    3 semanas atrás

    São Paulo, Brasil Data Meaning Tempo inteiro

    AI Specialist / Engineer – Qualified Pipeline Location : BR / LatAm / USA, Remote Position type : Full-time Contract (Short Term or Long Term) Position Summary Data Meaning is a front-runner in Business Intelligence and Data Analytics consulting, renowned for our high-quality consulting services throughout the US and beyond. Our expertise lies in...

  • Data Pipelines Specialist

    Há 24 horas

    São Paulo, SP, Brasil beBeeData Tempo inteiro

    Unlock Your Data Engineering Potential We are seeking a highly skilled Data Engineer to join our team. The successful candidate will design, develop and optimize data pipelines that support forecasting, pricing, and reporting operations. Key Responsibilities: Develop and maintain ETL/ELT pipelines using Azure Data Factory and Databricks.

  • Data Pipeline Specialist

    3 semanas atrás

    São Paulo, SP, Brasil beBeeDataTransformation Tempo inteiro

    Data Transformation Experts Data transformation experts design and implement data extraction, transformation, and loading processes to convert raw data into a usable format. In this role, you will work with large datasets, write complex queries, and ensure high-quality data pipelines. Key Responsibilities: Design and implement ETL processes using SQL, data...

  • Chief Data Infrastructure Specialist

    3 semanas atrás

    São Paulo, Brasil Bebeepythondeveloper Tempo inteiro

    Chief Data Infrastructure Specialist Bebeepythondeveloper • São Paulo, Brasil Descrição da vaga Senior Python Developer Position Overview This role entails driving the development of cutting‑edge data infrastructure and pipelines. The successful candidate will create automation systems, develop data integration services, and lead the design and...

  • Data Pipeline Specialist

    1 semana atrás

    São Paulo, Brasil beBeeBackend Tempo inteiro

    Job Overview We are seeking a skilled Backend Engineer to join our team and contribute to the development of our innovative data collection pipeline on AWS, built with Go and Typescript. Our focus is on delivering high-quality software solutions that prioritize innovation, quality, and accessibility. The ideal candidate will have experience working with AWS...

  • Data Pipeline Specialist

    1 semana atrás

    São Paulo, Brasil Bebeebackend Tempo inteiro

    Overview We are seeking a skilled Backend Engineer to join our team and contribute to the development of our innovative data collection pipeline on AWS, built with Go and Typescript. Our focus is on delivering high-quality software solutions that prioritize innovation, quality, and accessibility. The ideal candidate will have experience working with AWS...