Data Engineering Specialist

3 semanas atrás

Brasília, Brasil beBeeData Tempo inteiro

Job Title: Data Architect

We are seeking a skilled and experienced Data Architect to join our team.

Responsibilities:

  • Design and Development: Design, develop, and maintain data pipelines for ingesting threat intelligence data from various sources into our data ecosystem.
  • Data Validation: Implement data validation processes to ensure data accuracy, completeness, and consistency.
  • Collaboration with Analysts: Collaborate with analysts to understand data requirements and design appropriate solutions.
  • Automation: Develop automation scripts and workflows for data export processes to external systems or partners.
  • Pipeline Optimization: Optimize and enhance existing data pipelines for improved performance and scalability.
  • Troubleshooting: Monitor data pipelines and troubleshoot issues as they arise, ensuring continuous data availability and integrity.
  • Documentation: Document technical specifications, data flows, and procedures for data pipeline maintenance and support.
  • Guidance: Provide guidance and support to other team members on data architecture best practices and methodologies.

Requirements:

  • Experience: Proven experience as a Data Architect or similar role, with a focus on data ingest, validation, and export automation.
  • Python Proficiency: Strong proficiency in Python.
  • Data Pipeline Orchestration Tools: Experience with data pipeline orchestration tools such as Apache Airflow, Apache NiFi, or similar.
  • Cloud Platforms: Familiarity with cloud platforms such as Snowflake, AWS, Azure, or Google Cloud Platform.
  • Data Validation Techniques: Experience with data validation techniques and tools for ensuring data quality.
  • Containerization Technologies: Experience building and deploying images using containerization technologies such as Docker and Kubernetes.
  • Problem-Solving Skills: Excellent problem-solving skills and attention to detail.
  • Communication and Collaboration Skills: Strong communication and collaboration skills, with the ability to work effectively in a team environment.

Why Work With Us?

As a member of our team, you will have the opportunity to work on challenging projects that drive business growth. We offer a collaborative and dynamic work environment, with opportunities for professional development and advancement.

How to Apply:

If you are interested in this position, please submit your resume and a cover letter outlining your qualifications and experience. We look forward to hearing from you

  • Data Systems Specialist

    3 semanas atrás

    Brasília, Brasil beBeeDataSystems Tempo inteiro

    About the Role We are seeking a skilled Data Systems Specialist to join our team. This individual will be responsible for designing, developing, and maintaining large-scale data systems and pipelines. The ideal candidate will have expertise in data engineering and work closely with cross-functional teams to support operational data needs and troubleshoot...

  • Product Manager

    Há 7 dias

    Brasília, Brasil CI&T Software S.A. Tempo inteiro

    We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions. With over 7,400 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality. We are looking for a Product Manager with a strong analytical mindset and passion...

  • Data Engineering Specialist

    3 semanas atrás

    Brasília, Brasil Caderno Nacional Tempo inteiro

    Responsibilities Design and Development: Design, develop, and maintain data pipelines for ingesting threat intelligence data from various sources into our data ecosystem. Data Validation: Implement data validation processes to ensure data accuracy, completeness, and consistency. Collaboration with Analysts: Collaborate with analysts to understand data...

  • Data Engineering Leader

    3 semanas atrás

    Brasília, Brasil beBeeData Tempo inteiro

    Senior Data Engineer We are seeking a highly skilled Senior Data Engineer to spearhead the design and maintenance of scalable data pipelines on AWS. This individual will ensure top-notch performance, quality, and security while collaborating with cross-functional teams to integrate data from multiple sources and fuel AI/ML initiatives. Key Responsibilities...

  • Senior Director Data Engineering

    2 semanas atrás

    Brasília, Brasil phData Tempo inteiro

    Senior Director, Data Engineering - Professional Services - Consulting (Brazil) About phData phData is an AI-forward engineering company focused on getting enterprise data and AI workloads in production for some of the largest and most well-known companies in the world. We specialize in the most complex data, machine learning, and AI problems that only the...

  • Product Manager

    Há 7 dias

    Brasília, Brasil Ci&T Software S.A. Tempo inteiro

    We aretech transformationspecialists, uniting human expertise with AI to create scalable tech solutions.With over 7,400 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history.Artificial Intelligence is our reality.We are looking for aProduct Managerwith a strong analytical mindset and passion for...

  • Product Manager

    Há 3 dias

    Brasília, Brasil Ci&T Software S.A. Tempo inteiro

    We aretech transformationspecialists, uniting human expertise with AI to create scalable tech solutions.With over 7,400 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history.Artificial Intelligence is our reality.We are looking for aProduct Managerwith a strong analytical mindset and passion for...

  • Data Specialist

    3 semanas atrás

    Brasília, Brasil beBeedata Tempo inteiro

    Job Opportunity We are seeking a skilled Data Engineer to join our team. Our company has over 12 years of experience in the market, with a global presence across 20+ countries. Our Mission To provide a rewarding work environment that fosters growth and well-being for our employees and clients alike. What We Offer A personalized career development plan...

  • Chief Data Engineering Specialist

    3 semanas atrás

    Brasília, Brasil beBeeDataEngineer Tempo inteiro

    Key Role in Modernizing E-commerce Platform The main aim of this project is to revamp, maintain, and develop an e-commerce platform for a large US-based retail company serving millions of customers each week. Main Responsibilities We are seeking an experienced Data Engineer who will be responsible for designing a solution to support processing of big data...

  • Process Optimization Specialist

    3 semanas atrás

    Brasília, Brasil beBeeEngineer Tempo inteiro

    Job Title: Process Optimization Specialist Responsible for monitoring and maintaining advanced process control systems. Key Responsibilities Include: Performing routine system checks and troubleshooting APCs Reporting performance metrics to stakeholders Developing new solutions and enhancing existing applications Providing training and support for operators...