Senior Data Pipeline Specialist

Há 2 dias

Curitiba, Paraná, Brasil beBeeDataEngineer Tempo inteiro R$90.000 - R$120.000
Job Title

We are seeking a skilled and experienced Data Engineer to join our Threat Research team.

The successful candidate will be responsible for designing, developing and maintaining data pipelines for ingesting threat intelligence data from various sources into our data ecosystem.

  • Design, develop, implement and maintain high-quality, scalable and secure data pipelines for ingesting threat intelligence data.
  • Implement robust data validation processes to ensure data accuracy, completeness and consistency.
  • Collaborate with threat analysts to understand data requirements and design appropriate solutions.
  • Develop automation scripts and workflows for data export processes to external systems or partners.
  • Optimize and enhance existing data pipelines for improved performance and scalability.
  • Monitor data pipelines and troubleshoot issues as they arise, ensuring continuous data availability and integrity.
  • Document technical specifications, data flows and procedures for data pipeline maintenance and support.
Requirements
  • Proven experience as a Data Engineer or similar role, with a focus on data ingest, validation and export automation.
  • Strong proficiency in Python.
  • Experience with data pipeline orchestration tools such as Apache Airflow, Apache NiFi or similar.
  • Familiarity with cloud platforms such as Snowflake, AWS, Azure or Google Cloud Platform.
  • Experience with data validation techniques and tools for ensuring data quality.
  • Experience building and deploying images using containerization technologies such as Docker and Kubernetes.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills, with the ability to work effectively in a team environment.

This is an exciting opportunity to work with cutting-edge technologies and contribute to the success of our Threat Research team.

We offer a competitive salary and benefits package, including opportunities for professional growth and development.

  • Senior Master Data Specialist

    Há 3 dias

    Curitiba, Paraná, Brasil beBeeMaster Tempo inteiro

    Senior Master Data SpecialistThe role of Senior Master Data Specialist is a key position in our organization, responsible for leading the development and implementation of master data management strategies. This individual will be instrumental in shaping the direction of our data management initiatives and ensuring that they align with business...

  • Data Engineering Specialist

    Há 3 dias

    Curitiba, Paraná, Brasil beBeeDataEngineering Tempo inteiro US$90.000 - US$120.000

    Job Title: Data Engineering SpecialistAbout the RoleWe are seeking a skilled and experienced Data Engineering Specialist to join our team. The ideal candidate will have a strong background in data engineering, cloud platforms, and back-end development.Key ResponsibilitiesDesign, develop, and maintain large-scale data pipelines using cloud-based services such...

  • Data Engineering Specialist

    Há 8 horas

    Curitiba, Paraná, Brasil beBeeEngineer Tempo inteiro R$100.000 - R$150.000

    Job Title:Data Engineering SpecialistDescription:We are seeking an experienced Data Engineer to join our team. Our client provides technical expertise, testing, and certification services to the global food and agricultural industry.Key Responsibilities:Data Pipeline Development: Design, build, maintain, and modernize data pipelines that process large-scale...

  • Senior Data Migration Specialist

    Há 20 horas

    Curitiba, Paraná, Brasil beBeeDataMigration Tempo inteiro R$100.000 - R$140.000

    Senior Data Migration SpecialistWe are seeking a seasoned data migration expert with expertise in commercial and procurement functions, specifically S4/HANA, to lead our team's end-to-end data migration activities.Main Responsibilities:Develop and implement comprehensive data migration strategies from preparation to final production data loads.Collaborate...

  • Senior Data Integration Specialist

    Há 2 dias

    Curitiba, Paraná, Brasil beBeeDataSpecialist Tempo inteiro R$80.000 - R$150.000

    As a data design specialist, you will utilize your technical expertise in business intelligence technologies to drive the success of our technical team. Your proficiency in data integration patterns, including batch processing, replication, APIs, event-driven architectures, and more, will be invaluable in resolving incidents, testing solutions, and modeling...

  • Senior Data Infrastructure Specialist

    Há 3 dias

    Curitiba, Paraná, Brasil beBeeData Tempo inteiro R$103.500 - R$131.000

    Sustainable transport and infrastructure solutions play a vital role in modern society. We are seeking a Data Engineer to contribute to the data productization journey, working on global projects that involve developing data pipelines, data processing for visualizations, and AI solutions.Key ResponsibilitiesThe successful candidate will deliver business...

  • Senior Ci/Cd Specialist

    Há 4 dias

    Curitiba, Paraná, Brasil Luxoft Tempo inteiro

    PLEASE APPLY WITH YOUR CV IN ENGLISHProject descriptionLuxoft is seeking talented specialist to develop and support Jenkins-based CI/CD infrastructure. The specialist will be responsible for organization of CI/CD for various AI/ML tools using Groovy pipelines, GPU-related environments virtualization using Docker and additional automation using Python and...

  • Senior Data Analyst

    Há 3 dias

    Curitiba, Paraná, Brasil beBeeData Tempo inteiro R$81.900 - R$141.550

    Power BI Developer Job OpportunityWe are seeking a skilled Power BI developer to transform business insights and drive data-driven decision making. As a senior member of our team, you will be responsible for designing and implementing data models using Power BI and Power Platform.Key Responsibilities:Develop scalable data pipelines and ETL processes using...

  • Senior Data Insights Specialist

    Há 2 dias

    Curitiba, Paraná, Brasil beBeeDataAnalyst Tempo inteiro R$90.000 - R$143.000

    Job OverviewWe are seeking a highly skilled Senior Analytics Engineer to drive business growth through data-driven insights.The ideal candidate will possess expertise in data modeling and visualization tools for complex data structures, ensuring seamless integration with cloud-based solutions.The successful candidate will be able to effectively work with...

  • Data Engineering Specialist

    Há 3 dias

    Curitiba, Paraná, Brasil beBeeDataEngineer Tempo inteiro R$79.260 - R$118.477

    Job OpportunityWe are seeking a highly skilled professional to fill a Data Engineer position in our global clinical research initiative. This is an exciting opportunity for a detail-oriented individual who is comfortable working in a collaborative, remote environment.Key Responsibilities:Collect and ingest large volumes of real-world data, including medical...