Senior Data Pipeline Developer

Há 6 dias

Brasil beBeeDataEngineer Tempo inteiro

**Data Engineer Role Overview**

We are seeking a highly skilled and experienced data engineer to join our team. The primary responsibility of this role is to design, develop, and maintain data pipelines for threat intelligence ingestion, validation, and export automation flows.

Our ideal candidate will have a strong background in designing, developing, and maintaining large-scale data pipelines, as well as experience with data validation techniques and tools for ensuring data quality.

The successful candidate will also be proficient in programming languages such as Python and have experience with data pipeline orchestration tools such as Apache Airflow or similar.

Key Responsibilities:
  • Design and develop scalable data pipelines for ingesting threat intelligence data from various sources into our data ecosystem.
  • Implement data validation processes to ensure data accuracy, completeness, and consistency.
  • Collaborate with threat analysts to understand data requirements and design appropriate solutions.
  • Develop automation scripts and workflows for data export processes to external systems or partners.
  • Optimize and enhance existing data pipelines for improved performance and scalability.
  • Monitor data pipelines and troubleshoot issues as they arise, ensuring continuous data availability and integrity.
  • Document technical specifications, data flows, and procedures for data pipeline maintenance and support.
Requirements:
  • Proven experience as a Data Engineer or similar role, with a focus on data ingest, validation, and export automation.
  • Strong proficiency in Python programming language.
  • Experience with data pipeline orchestration tools such as Apache Airflow or similar.
  • Familiarity with cloud platforms such as Snowflake, AWS, Azure, or Google Cloud Platform.
  • Experience with data validation techniques and tools for ensuring data quality.
  • Experience building and deploying images using containerization technologies such as Docker and Kubernetes.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills, with the ability to work effectively in a team environment.

  • Senior Data Developer

    2 semanas atrás

    Brasil beBeeData Tempo inteiro R$120.000 - R$160.000

    Unlocking Community KnowledgeThis is an exciting opportunity to work on complex data pipelines, leveraging cutting-edge tools and technologies. As a seasoned Senior Data Developer, you will collaborate with experts to drive business growth and improve community engagement.Key ResponsibilitiesDevelop and maintain advanced data pipelines using Databricks,...

  • Senior Data Developer, Colombia

    2 semanas atrás

    Brasil Ciandt Tempo inteiro

    We aretech transformationspecialists, uniting human expertise with AI to create scalable tech solutions.With over 7,400 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.At CI&T, we are seeking a highly skilled and motivated Senior Data Developer to join our...

  • Senior Data Developer, Brazil

    2 semanas atrás

    Brasil Ciandt Tempo inteiro

    We aretech transformationspecialists, uniting human expertise with AI to create scalable tech solutions.With over 7.400 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.At CI&T, we are seeking a highly skilled and motivated Senior Data Developer to join our...

  • Senior Data Developer, Brazil

    Há 6 dias

    Brasil CI&T Software S.A. Tempo inteiro

    Position overview:As a Senior Data Developer, you will design and implement scalable data solutions that drive business value for our global clients. Working with modern data stacks in cloud environments, you'll develop robust data pipelines, ensure data quality, and implement effective data governance practices. Your expertise will be crucial in...

  • Senior Data Developer, Brazil

    Há 6 dias

    Brasil CI&T Software S.A. Tempo inteiro

    We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions. With over 7.400 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality. At CI&T, we are seeking a highly skilled and motivated Senior Data Developer to join...

  • Senior Data Developer, Brazil

    Há 6 dias

    Brasil CI&T Tempo inteiro R$90.000 - R$120.000 por ano

    We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions. With over 7.400 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality. Hi there This is Jessica from CI&T I am a Talent Analyst looking for...

  • Senior Data developer, Brazil

    1 semana atrás

    Brasil CI&T Tempo inteiro US$104.000 - US$130.878 por ano

    We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions. With over 7.400 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality. At CI&T, we are seeking a highly skilled and motivated Senior Data Developer to...

  • Senior Data Developer, Brazil

    1 semana atrás

    Brasil CI&T Tempo inteiro R$104.000 - R$130.878 por ano

    We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions. With over 7.400 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality. Hey everyone This is Thai Viapiana from CI&T's Talent Attraction Team :) I am...

  • Senior Data Pipeline Specialist

    2 semanas atrás

    Brasil beBeeDataEngineer Tempo inteiro R$60.000 - R$80.000

    Data Engineer RoleWe are seeking a skilled Data Engineer to join our data engineering team. This individual will be responsible for building and maintaining scalable, secure data pipelines that handle large volumes of complex data.The ideal candidate will have a strong background in computer science and data engineering, with experience in designing,...

  • Data Pipeline Architect

    Há 2 dias

    Brasil beBeeDataEngineering Tempo inteiro

    Data Engineering Specialist Our organization is seeking a skilled and experienced Data Engineer to join our Threat Research team. The primary responsibility of this role will be to design, develop, and maintain data pipelines for threat intelligence ingestion, validation, and export automation flows. Responsibilities: Design, develop, and maintain data...