Strategic Data Pipeline Architect

3 semanas atrás

São Paulo, Brasil beBeeDataEngineer Tempo inteiro
Job Description

Our organization is dedicated to providing technical expertise to the global food and agricultural industry, ensuring safety, quality, and sustainability across international supply chains.

This role plays a critical part in building, maintaining, and modernizing data pipelines that process large-scale regulatory data from around the world and transform it into usable datasets for downstream applications and APIs.

The engineer will work hands-on with Python, SQL, and related tools to untangle legacy code pipelines, migrate processes to more maintainable platforms, and ensure accurate and reliable data. This role requires strong technical ability and a consulting mindset.

Key Responsibilities:
  • Designing and developing scalable data pipelines using Python and related tools.
  • Migrating legacy pipelines to more maintainable platforms such as Airflow.
  • Ensuring data accuracy, reliability, and readiness for client-facing products.
Required Skills and Qualifications

Our ideal candidate will possess the following qualifications:

  • 7+ years' experience using Python for analyzing, extracting, creating, and transforming large datasets.
  • Proficiency in Python 3+, Pandas, NumPy, and Jupyter Notebooks.
  • Deep experience with SQL and relational data using Oracle, Postgres, or MS SQL Server.
  • Solid understanding of database design principles, data modeling, and data warehousing concepts.
  • Excellent troubleshooting skills and instincts.
Preferred Skills and Qualifications

While not required, the following qualifications would be advantageous:

  • NoSQL database design and development using MongoDB, AWS DynamoDB, or Azure Cosmos DB.
  • Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and services related to data storage/processing.
  • Exposure to Terraform or other Infrastructure-as-Code tooling.
  • Proficient in Azure DevOps for source code and pipeline management.

As a self-motivated and self-directed Data Engineer, you will thrive in an Agile software development team with short, iterative delivery cycles.

  • Data Architect

    4 semanas atrás

    São Paulo, São Paulo, Brasil Aravita Tempo inteiro

    About Us At Aravita, we're not just building a product; we're building the future of AI-enabled fresh food operations. We are a fast-paced, innovative startup on a mission to solve complex problems with data. Our culture is built on collaboration, curiosity, and a passion for technology. We're looking for a brilliant Data Engineer / Cloud Architect to...

  • Data Architect

    4 semanas atrás

    São Paulo, São Paulo, Brasil Aravita Tempo inteiro

    About Us At Aravita, we're not just building a product; we're building the future of AI-enabled fresh food operations. We are a fast-paced, innovative startup on a mission to solve complex problems with data. Our culture is built on collaboration, curiosity, and a passion for technology. We're looking for a brilliant Data Engineer / Cloud Architect to...

  • Data Architect

    Há 6 dias

    São Paulo, São Paulo, Brasil Aravita Tempo inteiro US$90.000 - US$120.000 por ano

    About UsAt Aravita, we're not just building a product; we're building the future of AI-enabled fresh food operations. We are a fast-paced, innovative startup on a mission to solve complex problems with data. Our culture is built on collaboration, curiosity, and a passion for technology. We're looking for a brilliant Data Engineer / Cloud Architect to join...

  • Sr. Data Architect

    3 semanas atrás

    São Paulo, São Paulo, Brasil buscojobs Brasil Tempo inteiro

    OverviewNative / Bilingual English is required for this role (read / written / spoken).Please upload your CV Resume in English.Monthly salary : $5,000 - $6,000Our partner is a company where data drives insight and architecture drives impact. They provide advanced analytics and real-time data pipelines that power the foodservice supply chain.Along with our...

  • Data Architect

    2 semanas atrás

    São Paulo, Brasil buscojobs Brasil Tempo inteiro

    About UsAt Aravita, we're not just building a product; we're building the future of AI-enabled fresh food operations. We are a fast-paced, innovative startup on a mission to solve complex problems with data. Our culture is built on collaboration, curiosity, and a passion for technology. We're looking for a brilliant Data Engineer / Cloud...

  • Databricks Data Architect

    2 semanas atrás

    São Paulo, Brasil buscojobs Brasil Tempo inteiro

    About the Role Engagement: 12 months Celebal Technologies is seeking an experienced Data Architect with deep expertise in Azure Databricks, Unity Catalog, PySpark, and Delta Live Tables. In this role, you will lead the design, architecture, and delivery of advanced data solutions, collaborating closely with cross-functional teams to ensure scalable, secure,...

  • Big Data Solution Architect

    3 semanas atrás

    São Paulo, São Paulo, Brasil beBeeData Tempo inteiro

    Data Architect Specialist We're seeking a seasoned Data Architect Specialist to spearhead the design and implementation of large-scale data systems. Key Responsibilities: Design, develop, and maintain scalable data pipelines leveraging Snowflake, DBT, and SQL expertise Enhance DBT models and SQL scripts to meet evolving business requirements Oversee...

  • Strategic Sales Executive, Data Collaboration Platform

    2 semanas atrás

    São Paulo, Brasil AppsFlyer Tempo inteiro

    Strategic Sales Executive, Data Collaboration PlatformJoin to apply for the Strategic Sales Executive, Data Collaboration Platform role at AppsFlyerContinue with Google Continue with GoogleStrategic Sales Executive, Data Collaboration Platform14 hours ago Be among the first 25 applicantsJoin to apply for the Strategic Sales Executive, Data Collaboration...

  • Databricks Data Architect

    2 semanas atrás

    Região Geográfica Intermediária de São Paulo, Brasil buscojobs Brasil Tempo inteiro

    Overview Job Title: Solution Architect – Databricks Location: Remote Work 12 months About the Role Celebal Technologies is seeking an experienced Data Architect with deep expertise in Azure Databricks, Unity Catalog, PySpark, and Delta Live Tables. In this role, you will lead the design, architecture, and delivery of advanced data solutions,...

  • Qualified Pipeline

    3 semanas atrás

    São Paulo, São Paulo, Brasil Data Meaning Tempo inteiro

    Overview Qualified Pipeline - Senior Backend Python Developer Location: remote, LATAM Position Type: Contract, Long Term/Short Term Data Meaning is a leading Business Intelligence consulting company, an Alteryx Premier Partner, Tableau Partner, and a growing organization. We provide top consulting services to companies throughout the US, generating...