Data Engineer With Gcp

Há 24 horas


Rio Grande do Sul, Brasil buscojobs Brasil Tempo inteiro

This position is a Remote position to work from LATAM with US clients. You will be working as a consultant directly with US Clients. Must work in US PST Zone.

We offer:

  • 100% Remote Position
  • Paid National Holidays off
  • 30 to $35 USD per hour

Title: Data Engineer with GCP

We are seeking a highly motivated and experienced Data Engineer to join our Data Engineering team. In this role, you will be at the forefront of designing and developing scalable, robust data architectures and solutions utilizing the latest technologies from Google Cloud Platform (GCP) and AWS. You will collaborate closely with cross-functional teams to understand their data needs and will focus on building, optimizing, and scaling data platform solutions that drive insights for marketing strategies, personalization efforts, and operational efficiencies. As a senior member of the team, you will work closely with data scientists, machine learning engineers, data analysts, and cross-functional teams, playing a critical role in shaping the company's data architecture.

Responsibilities:

  1. Design, develop, and maintain scalable, high-performance data infrastructure to support the collection, storage, and processing of large datasets in real time and batch modes.
  2. Build reliable, reusable services and APIs that allow teams to interact with the data platform for ingestion, transformation, and querying of data.
  3. Develop internal tools and frameworks to automate and streamline data engineering processes.
  4. Collaborate with senior management, product management, and other engineers in the development of data products.
  5. Develop tools to monitor, debug, and analyze data pipelines.
  6. Design and implement data schemas and models that can scale.
  7. Mentor team members to build the company's overall expertise.
  8. Work to make The RealReal an innovator in the space by bringing passion and new ideas to work every day.

Required Skills:

  1. At least 5 years of proven experience as a Data Engineer in developing platform-level capabilities for data-driven midsize to large corporations.
  2. Strong object-oriented programming skills in languages such as Python, Java, or Scala, with experience building large-scale, fault-tolerant systems.
  3. Experience with cloud platforms (GCP, AWS, AZURE) with a strong preference for GCP.
  4. Experience with BigQuery or similar (Redshift, Snowflake, other MPP databases).
  5. Experience building data pipelines & ETL. Experience with command line and version control software (git).
  6. Excellent communication and collaboration skills.
  7. Ability to work independently and quickly become productive after joining.

Preferred Requirements:

  1. Knowledge of distributed data processing frameworks such as Apache Kafka, Flink, Spark, or similar.
  2. Experience with DBT (Data Build Tool) and Looker. Experience with machine learning pipelines or MLOps.
#J-18808-Ljbffr

  • Rio Grande do Sul, Brasil Provectus Tempo inteiro

    **Provectus, **a leading AI consultancy and solutions provider specializing in **Data Engineering** and **Machine Learning**. With a focus on helping businesses unlock the power of their data, we leverage the latest technologies to build innovative data platforms that drive results. Our Data Engineering team consists of top-tier professionals who design,...

  • Devops Engineer

    3 semanas atrás


    Rio de Janeiro, Brasil Betsol Tempo inteiro

    BETSOL is a cloud-first digital transformation and data management company offering products and IT services to enterprises in over 40 countries. BETSOL team holds several engineering patents, is recognized with industry awards, and BETSOL maintains a net promoter score that is 2x the industry average. BETSOL’s open source backup and recovery product line,...


  • Jaraguá do Sul, Santa Catarina, Brasil Jobbol Tempo inteiro

    About the Role:This is a challenging opportunity for a talented Senior Software Engineer to join our team. The successful candidate will be responsible for designing and implementing cloud-based solutions using data analysis techniques. Key Responsibilities:- Develop and maintain cloud-based software applications using data analysis techniques.- Collaborate...

  • Data Engineer

    Há 24 horas


    Rio Grande do Sul, Brasil buscojobs Brasil Tempo inteiro

    Requirements : Hands-on experience with the Azure data platform stack: Azure Databricks, Azure Data Factory, Azure Data Lake storage, Azure DevOps, Azure Functions. Experience in designing and building end-to-end pipelines. Experience with Azure DevOps CI/CD Stories, Bugs, and Issue management. Strong experience in shell scripting. Strong ETL knowledge....


  • Rio Grande do Sul, Brasil Provectus Tempo inteiro

    **Provectus, **a leading AI consultancy and solutions provider specializing in **Data Engineering** and **Machine Learning**. With a focus on helping businesses unlock the power of their data, we leverage the latest technologies to build innovative data platforms that drive results. Our Data Engineering team consists of top-tier professionals who design,...

  • Data Engineer

    3 semanas atrás


    Rio de Janeiro, Brasil Formula Tempo inteiro

    Formula.Monks, part of Media.Monks and S4 Capital, is a global consulting firm mastering AI-powered transformations for the Fortune 100. We combine long-term strategic thinking, deep enterprise experience, and a human-centered approach to help clients transform business processes and dominate their industries. About the Role As a Data Engineer , you’ll...

  • Data Engineer

    Há 24 horas


    Rio de Janeiro, Brasil - Tempo inteiro

    We are looking for the right people - people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world's largest providers of products and services to the...

  • Data Engineer

    1 dia atrás


    Rio Grande, Brasil buscojobs Brasil Tempo inteiro

    Requirements :Hands-on experience with the Azure data platform stack: Azure Databricks, Azure Data Factory, Azure Data Lake storage, Azure DevOps, Azure Functions.Experience in designing and building end-to-end pipelines.Experience with Azure DevOps CI/CD Stories, Bugs, and Issue management.Strong experience in shell scripting.Strong ETL knowledge.Experience...

  • Data Engineer

    3 semanas atrás


    Rio de Janeiro, Brasil Halliburton Energy Services Tempo inteiro

    We are looking for the right people — people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world’s largest providers of products and services to the...

  • Data Engineer

    3 semanas atrás


    Rio de Janeiro, Brasil oilandgas.org.uk Tempo inteiro

    We are looking for the right people - people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world's largest providers of products and services to the...

  • Data Engineer

    3 semanas atrás


    Rio de Janeiro, Brasil Halliburton Tempo inteiro

    We are looking for the right people — people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world’s largest providers of products and services to the...

  • Data Engineer

    Há 1 mês


    Rio de Janeiro, Brasil Halliburton Tempo inteiro

    We are looking for the right people — people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world’s largest providers of products and services to the...

  • Senior Data Engineer

    2 meses atrás


    Rio Grande, Brasil thyssenkrupp Elevator Tempo inteiro

    People are at the heart of everything we do at TK Elevator: we work as a team, we care about the safety of others and we share a common vision to keep the world moving. This is your opportunity to go further and impact the future of urban mobility. What we expectTK Elevator aims to be a leader in industrial IoT solutions, data enabled solutions software...


  • Rio de Janeiro, Brasil SLB Tempo inteiro

    Data and Infrastructure Engineer responsibility is in two main aspects. First, responsible for organizing, collecting, processing, and storing of data from different sources and transforming raw, unstructured data into formats that can be used for analysis including databases, servers, and large-scale processing systems. Second, responsible for the design,...


  • Jaraguá do Sul, Santa Catarina, Brasil Empresa de serviço de distribuição Tempo inteiro

    Job Description:As a Data Scientist with advanced analytics expertise, you will be responsible for developing and implementing complex data models and algorithms to drive business decisions.Key Responsibilities:• Design and implement data pipelines to integrate and process large datasets• Develop and train machine learning models to predict business...

  • Devops Engineer

    1 semana atrás


    Rio Grande do Sul, Brasil buscojobs Brasil Tempo inteiro

    Job Title : SENIOR DEVOPS ENGINEER (REMOTE) About : Flatiron is a global remote software development company with engineers located around the world. We unite experts from diverse backgrounds and experiences in a collaborative culture to deliver exceptional products and services for our clients. As a forward-thinking software engineering company, we provide...

  • Data Engineer

    Há 1 mês


    Rio de Janeiro, Brasil Luxoft Tempo inteiro

    PLEASE APPLY WITH YOUR CV IN ENGLISH & WITH THE REQUESTED SKILLS**Project Description:Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop...

  • Data Engineer

    Há 1 mês


    Rio de Janeiro, Brasil TIM SA Tempo inteiro

    Id da vaga: 23727 Cargo: Data Engineer - Especialista Diretoria: Chief Information Officer Breakdown: Data Solutions UO: Data Engineering Regional: TIM SA Headquarter Estado: RIO DE JANEIRO Cidade: RIO DE JANEIRO DESCRIÇÃO DO PERFIL Responsável por construir e manter todo o pipeline e soluções de dados, garantindo a gestão, otimização,...


  • Rio de Janeiro, Rio de Janeiro, Brasil Fullstack Labs Tempo inteiro

    At FullStack Labs, we strive to deliver transformational digital solutions to top organizations. We're looking for a skilled Data Engineer to join our team and help build highly-skilled software development teams.We're most proud of offering life-changing career opportunities to talented software professionals and having delivered hundreds of successful...

  • Data Warehouse Architect

    2 meses atrás


    Rio Grande do Sul, Brasil Xsolla Tempo inteiro

    We are looking to hire a Data Warehouse Architect (DWH Architect) to join our dynamic engineering team all over the world. As a DWH Architect, you will be responsible to drive and coordinate the technical execution of enterprise data warehouse solutions and services that includes understanding business requirements, solution design, Data Extraction,...