Building Large-Scale Data Pipelines Specialist

4 semanas atrás


Brasília, Brasil beBeeDataEngineer Tempo inteiro
Key Data Engineering Position

This role requires a skilled professional to build, maintain and modernize data pipelines that handle large-scale regulatory information worldwide.

The engineer will work closely with Python, SQL, and related tools to clarify legacy code, migrate processes to more maintainable platforms, and ensure data precision, reliability, and readiness for client-facing products.

Key Responsibilities:

  • Design, develop, test, and deploy data pipelines using Python, SQL, and associated tools.
  • Migrate legacy code to more maintainable platforms such as Airflow.
  • Ensure data accuracy, reliability, and readiness for client-facing products.

Requirements:

  • A minimum of 7 years' experience in using Python for analyzing, extracting, creating, and transforming large datasets.
  • Proficiency in Python 3+ and common Python libraries and tools for data engineering.
  • Deep knowledge of SQL and relational data using Oracle, Postgres, or MS SQL Server.
  • A solid understanding of database design principles, data modeling, and data warehousing concepts.

Preferred Qualifications:

  • NoSQL database design and development using MongoDB, AWS DynamoDB, or Azure Cosmos DB.
  • Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and services related to data storage/processing.
  • Experience with Terraform or other Infrastructure-as-Code tooling.
About the Organization

We are a US-based company providing technical expertise, testing, and certification services to the global food and agricultural industry. Our mission is to ensure food safety, quality, and sustainability across international supply chains.


  • Big Data Pipeline Specialist

    3 semanas atrás


    Brasília, Brasil beBeeDataEngineer Tempo inteiro

    About the Role We are seeking a skilled professional to design, develop, and maintain large-scale data systems and pipelines. This individual will work closely with cross-functional teams to support operational data needs and troubleshoot issues.

  • Data Systems Specialist

    3 semanas atrás


    Brasília, Brasil beBeeDataSystems Tempo inteiro

    About the Role We are seeking a skilled Data Systems Specialist to join our team. This individual will be responsible for designing, developing, and maintaining large-scale data systems and pipelines. The ideal candidate will have expertise in data engineering and work closely with cross-functional teams to support operational data needs and troubleshoot...

  • Data Engineer

    4 semanas atrás


    Brasília, Brasil Coda Search│Staffing Tempo inteiro

    Our client is a U.S.-based company that provides technical expertise, testing, and certification services to the global food and agricultural industry. Their mission is to ensure food safety, quality, and sustainability across international supply chains. This role is critical to building, maintaining, and modernizing data pipelines that process large-scale...


  • Brasília, Brasil beBeeDataEngineer Tempo inteiro

    Job Opportunity: Data Engineer This position involves supporting the build out of data marts on top of a Snowflake enterprise warehouse. Key responsibilities will include lifting and shifting existing data marts, building net new data marts, and further integrations. The team designs, tests, deploys, and maintains data pipelines and establishes a strong data...

  • Chief Data Systems Architect

    4 semanas atrás


    Brasília, Brasil beBeeDataEngineer Tempo inteiro

    Job Overview A leading multinational organization seeks a skilled Data Engineer with experience in Scala and Cloud AWS. This is an exceptional opportunity to leverage your technical expertise and work closely with stakeholders to deliver data-driven insights. Key Responsibilities: Design and implement scalable data systems using Scala and Cloud AWS....


  • Brasília, Brasil beBeeData Tempo inteiro

    Cloud Data Solutions Engineer Design, build and maintain cloud-based data applications on a leading platform. Key Responsibilities: Create and enhance complex data solutions to collect, parse, manage and analyze large datasets. Develop metadata-driven data pipelines for seamless data delivery. Design, develop and automate data extraction, transformation and...


  • Brasília, Brasil beBeeDataEngineer Tempo inteiro

    Our organization is seeking a skilled Data Engineer to build, maintain and modernize large-scale data pipelines that process global regulatory information. About the Role This engineer will work closely with Python, SQL and related tools to transform complex legacy code into maintainable platforms like Airflow. Key Responsibilities: Transforming legacy code...

  • Data Architect

    4 semanas atrás


    Brasília, Brasil buscojobs Brasil Tempo inteiro

    About Us At Aravita , we're not just building a product; we're building the future of AI-enabled fresh food operations. We are a fast-paced, innovative startup on a mission to solve complex problems with data. Our culture is built on collaboration, curiosity, and a passion for technology. We're looking for a brilliant Data Engineer / Cloud Architect to join...

  • Data Engineer

    4 semanas atrás


    Brasília, Brasil Insight Global Tempo inteiro

    Required Skills & Experience 4+ years of data engineering experience - building data warehouses and ETL pipelines 3+ years of experience with Snowflake Datawarehouse Strong Python scripting experience Well versed with data marts Strong understanding of SQL including: SSIS, SSAS, & SSRS Ability to work MST hours Nice to Have Skills & Experience Experience...

  • Data Engineering Specialist

    3 semanas atrás


    Brasília, Brasil Caderno Nacional Tempo inteiro

    Responsibilities Design and Development: Design, develop, and maintain data pipelines for ingesting threat intelligence data from various sources into our data ecosystem. Data Validation: Implement data validation processes to ensure data accuracy, completeness, and consistency. Collaboration with Analysts: Collaborate with analysts to understand data...