Expert Data Pipeline Specialist

Há 21 horas

Porto Alegre, Rio Grande do Sul, Brasil beBeeDataEngineering Tempo inteiro

**Data Engineering Position Summary**

This Data Engineer role is designed to create, develop, and maintain complex data pipelines that incorporate threat intelligence from multiple sources. The primary focus will be on designing and implementing solutions that ensure high-quality data ingest, validation, and export automation.

The ideal candidate will have a strong background in data engineering principles, proficiency in Python, and experience with orchestration tools such as Apache Airflow or NiFi. Additionally, the ability to work effectively with cloud platforms like Snowflake, AWS, Azure, or Google Cloud Platform is essential.

  • Develop and maintain scalable data pipelines for ingesting and processing threat intelligence data from various sources.
  • Implement robust data validation processes to ensure accuracy, completeness, and consistency of data.
  • Collaborate with threat analysts to understand data requirements and design efficient solutions.
  • Design and implement automation workflows for data export processes to external systems or partners.
  • Stay up-to-date with emerging technologies and best practices in data engineering, incorporating them into our ecosystem.

Required Skills:

  • Proven experience in data engineering, with a focus on data ingest, validation, and export automation.
  • Strong programming skills in Python.
  • Experience with data pipeline orchestration tools such as Apache Airflow or NiFi.
  • Proficiency in working with cloud platforms like Snowflake, AWS, Azure, or Google Cloud Platform.
  • Excellent problem-solving skills and attention to detail.

What We Offer:

  • A dynamic and collaborative work environment.
  • Opportunities for growth and professional development.
  • A competitive compensation package.

How to Apply:

  1. Review the job description carefully.
  2. Ensure you meet the required qualifications and skills.
  3. Submit your application, including your resume and cover letter.

  • Data Pipeline Architect

    Há 20 horas

    Porto Alegre, Rio Grande do Sul, Brasil beBeeDataEngineer Tempo inteiro US$90.000 - US$120.000

    Data Engineering SpecialistNiche is seeking a skilled Data Engineer to join the Data Engineering team. The successful candidate will build and support data pipelines that can handle large volumes of complex data while ensuring scalability, data accuracy, availability, observability, security, and optimal performance.

  • Senior Data Pipeline Specialist

    Há 5 horas

    Porto Alegre, Rio Grande do Sul, Brasil beBeeDataEngineer Tempo inteiro R$91.839 - R$137.995

    Data Reliability Engineer Role">As a Data Reliability Engineer, you'll play a pivotal part in designing and implementing robust data pipeline architectures to ensure the reliability and efficiency of our data systems. Your contributions will have a direct impact on the success of our digital experiences.">About the JobCollaborate with experienced Data...

  • Cloud Data Integration Expert

    Há 21 horas

    Porto Alegre, Rio Grande do Sul, Brasil beBeeDataIntegration Tempo inteiro US$90.000 - US$110.000

    Cloud Data Integration SpecialistA key responsibility of this role is to design, develop and deploy cloud-based data integration workflows and solutions using Informatica Integration Cloud Services (IICS).The ideal candidate will have a strong understanding of data integration concepts, tools and best practices.Experience in creating and managing ETL...

  • Data Infrastructure Specialist

    Há 19 horas

    Porto Alegre, Rio Grande do Sul, Brasil beBeeDatabase Tempo inteiro R$106.688 - R$194.328

    Database Administrator ExpertWe are seeking an experienced Database Administrator to lead the development of our data solution.Designing and implementing robust ETL/ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses is crucial for this role.Integrating data from disparate sources using API integration...

  • Data Engineering Expert

    Há 23 horas

    Porto Alegre, Rio Grande do Sul, Brasil beBeeEngineering Tempo inteiro

    Join us as a Data Engineering Expert to develop and maintain scalable data pipelines and infrastructure to support our organization's data-driven initiatives.Job DescriptionWe are seeking an experienced Data Engineer to join our Data Intelligence team. The ideal candidate will have expertise in designing, building, and maintaining data pipelines, as well as...

  • Data Architectural Specialist

    Há 10 horas

    Porto Alegre, Rio Grande do Sul, Brasil beBeeDataEngineering Tempo inteiro R$48.000 - R$72.000

    Data Engineer RoleWe are seeking a skilled Data Engineer to build and maintain scalable pipelines and architectures.Key ResponsibilitiesDevelop and maintain robust data pipelines for ingestion, processing, and transformation using Python, SQL, and Apache Airflow.Contribute to the evolution of data architecture in Databricks and AWS environments, focusing on...

  • Remote Part-time Data Collection Specialist

    1 dia atrás

    Porto Alegre, Rio Grande do Sul, Brasil Lifewood Data Technologies Sdn Bhd Tempo parcial

    **Job Title**: Remote Part-Time Data Collection Specialist**Location**: Remote (Based in Brazil)**Job Summary**:Join our innovative international project as a Remote Part-Time Data Collection Specialist We are seeking enthusiastic individuals who are eager to work from the comfort of their home while contributing to a dynamic team. This role offers flexible...

  • Data Engineering Specialist

    Há 2 horas

    Porto Alegre, Rio Grande do Sul, Brasil beBeeSnowflake Tempo inteiro R$85.000 - R$123.000

    Snowflake Data Engineer Role We are seeking a highly skilled Snowflake Data Engineer to join our team. The ideal candidate will have expertise in designing, implementing, and maintaining scalable data pipelines and architecture using the Snowflake platform. The role involves working with diverse sources of data, including cloud and OLTP systems, to ingest...

  • Pipeline Workflow Specialist

    2 semanas atrás

    Porto Alegre, Rio Grande do Sul, Brasil beBeepipeline Tempo inteiro R$100.000 - R$150.000

    Pipeline Programmer Job Description**Job Summary:**We are seeking a highly skilled Pipeline Programmer to join our team. As a Pipeline Programmer, you will be responsible for building and maintaining production workflow tooling and automation. You will work closely with other developers and stakeholders to scope out and drive production programming...

  • Cloud-Based Data Integration Specialist

    2 semanas atrás

    Porto Alegre, Rio Grande do Sul, Brasil beBeeIntegration Tempo inteiro R$60.000 - R$75.000

    Cloud-Based Data Integration ExpertWe are seeking an experienced Cloud-Based Data Integration Expert to join our dynamic team. As a key member of our team, you will be responsible for designing, developing, and deploying cloud-based data integration workflows and solutions using Informatica Integration Cloud Services (IICS).Key Responsibilities:Collaborate...