Strategic Data Pipeline Architect

Há 3 dias

São Paulo, São Paulo, Brasil beBeeDataEngineer Tempo inteiro R$90.000 - R$120.000
Job Description

Our organization is dedicated to providing technical expertise to the global food and agricultural industry, ensuring safety, quality, and sustainability across international supply chains.

This role plays a critical part in building, maintaining, and modernizing data pipelines that process large-scale regulatory data from around the world and transform it into usable datasets for downstream applications and APIs.

The engineer will work hands-on with Python, SQL, and related tools to untangle legacy code pipelines, migrate processes to more maintainable platforms, and ensure accurate and reliable data. This role requires strong technical ability and a consulting mindset.

Key Responsibilities:
  • Designing and developing scalable data pipelines using Python and related tools.
  • Migrating legacy pipelines to more maintainable platforms such as Airflow.
  • Ensuring data accuracy, reliability, and readiness for client-facing products.
Required Skills and Qualifications

Our ideal candidate will possess the following qualifications:

  • 7+ years' experience using Python for analyzing, extracting, creating, and transforming large datasets.
  • Proficiency in Python 3+, Pandas, NumPy, and Jupyter Notebooks.
  • Deep experience with SQL and relational data using Oracle, Postgres, or MS SQL Server.
  • Solid understanding of database design principles, data modeling, and data warehousing concepts.
  • Excellent troubleshooting skills and instincts.
Preferred Skills and Qualifications

While not required, the following qualifications would be advantageous:

  • NoSQL database design and development using MongoDB, AWS DynamoDB, or Azure Cosmos DB.
  • Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and services related to data storage/processing.
  • Exposure to Terraform or other Infrastructure-as-Code tooling.
  • Proficient in Azure DevOps for source code and pipeline management.

As a self-motivated and self-directed Data Engineer, you will thrive in an Agile software development team with short, iterative delivery cycles.

  • Data Architect Assistant

    1 dia atrás

    São Paulo, São Paulo, Brasil beBeeDataEngineer Tempo inteiro R$45.000 - R$77.000

    Data Architect AssistantRole Overview: We are seeking to hire a skilled junior or mid-level professional to work on the strategic project of maintaining and evolving data ingestion processes.Key Responsibilities:Improve and maintain existing data ingestion processes using Teradata utilities.Analyze existing data structures and recommend enhancements.Support...

  • Strategic Data Architect

    Há 6 dias

    São Paulo, São Paulo, Brasil beBeeData Tempo inteiro R$96.793 - R$128.479

    ">Job OverviewAn accomplished Data Architect will play a pivotal role in shaping the company's data strategy, fostering a collaborative environment where team members can thrive and contribute to success.This position offers an exceptional opportunity to work on diverse projects, leveraging expertise to drive business growth and innovation.

  • Data Architect

    Há 2 dias

    São Paulo, São Paulo, Brasil Aravita Tempo inteiro

    About UsAt Aravita, we're not just building a product;we're building the future of AI-enabled fresh food operations. We are a fast-paced, innovative startup on a mission to solve complex problems with data. Our culture is built on collaboration, curiosity, and a passion for technology. We're looking for a brilliant Data Engineer / Cloud Architect to join our...

  • Data Architect

    Há 3 dias

    São Paulo, São Paulo, Brasil SapienX Inc. Tempo inteiro

    About UsAt Aravita, we're not just building a product; we're building the future of AI-enabled fresh food operations. We are a fast-paced, innovative startup on a mission to solve complex problems with data. Our culture is built on collaboration, curiosity, and a passion for technology. We're looking for a brilliant Data Engineer / Cloud Architect to join...

  • Senior Data Architect Position

    1 dia atrás

    São Paulo, São Paulo, Brasil beBeeData Tempo inteiro US$120.000 - US$200.000

    Chief Data ArchitectWe are seeking a skilled data architect to lead our data engineering team. As a chief data architect, you will be responsible for designing and developing robust data pipelines using modern frameworks, ensuring scalability and reliability.Key Responsibilities:Design and develop data architectures that meet business requirements.Develop...

  • Data Architect

    Há 2 dias

    São Paulo, São Paulo, Brasil SapienX Inc. Tempo inteiro

    About Us At Aravita, we're not just building a product; we're building the future of AI-enabled fresh food operations. We are a fast-paced, innovative startup on a mission to solve complex problems with data. Our culture is built on collaboration, curiosity, and a passion for technology. We're looking for a brilliant Data Engineer / Cloud Architect to join...

  • Chief Data Architect

    Há 5 dias

    São Paulo, São Paulo, Brasil beBeeDataEngineer Tempo inteiro US$99.680 - US$141.209

    Job OverviewThe Senior Data Engineer will be a key member of the Enterprise Data and Analytics team, collaborating with stakeholders to drive reporting. This includes developing data pipelines, curating and modeling data, and designing databases to enable insights and self-service across the analytics team and organization.The successful candidate will have...

  • Data Architect Position

    1 dia atrás

    São Paulo, São Paulo, Brasil beBeeData Tempo inteiro US$93.000 - US$156.000

    Job Title: Data ArchitectWe are seeking a skilled data architect to lead the design and implementation of our data engineering solutions. This is an excellent opportunity for a motivated professional to join our team and contribute to the success of our clients.Key Responsibilities:Design, implement, and maintain distributed data pipelines using tools such...

  • Senior Lead Data Architect LATAM

    Há 11 horas

    São Paulo, São Paulo, Brasil beBeeData Tempo inteiro R$1.800.000 - R$2.200.000

    Lead Data Architect LATAMWe are seeking an experienced Lead Data Architect to join our team in the LATAM region. As a key member of our data engineering team, you will be responsible for optimizing data pipelines and integrations across business intelligence reporting environments.Job Summary:The Senior Lead Data Engineer plays a critical role in designing,...

  • Chief Data Pipeline Architect

    Há 6 dias

    São Paulo, São Paulo, Brasil beBeeDataEngineer Tempo inteiro R$80.000 - R$120.000

    Data Engineer PositionWe are seeking an experienced Data Engineer to join our team. This role will be responsible for designing and developing our data platform, ensuring it meets the business needs.The successful candidate will have the opportunity to design new data pipelines, maintain existing platforms, and build processes to ingest data from various...