Data Engineer with GCP

Há 6 dias


Manaus, Brasil AllianceIT Inc Tempo inteiro

This position is a Remote position to work from on in LATAM working with US clients. You will be working as a consultant directly with clients US Clients. Must work in US PST Zone.


We offer:

  • 100% Remote Position
  • Paid National Holidays off
  • $30 to $35 USD per hour


Title: Data Engineer with GCP

We are seeking a highly motivated and experienced Data Engineer to join our Data Engineering team. In this role, you will be at the forefront of designing and developing scalable, robust data architectures and solutions utilizing the latest technologies from Google Cloud Platform (GCP) and AWS. You will collaborate closely with cross-functional teams to understand their data needs and will focus on building, optimizing and scaling data platform solutions that drive insights for marketing strategies, personalization efforts and operational efficiencies. As a senior member of the team, you will work closely with data scientists, machine learning engineers, data analysts and cross-functional teams, playing a critical role in shaping the company's data architecture.


Resposibilites:

  • Design, develop, and maintain scalable, high-performance data infrastructure to support the collection, storage, and processing of large datasets in real time and batch modes.
  • Build reliable, reusable services and APls that allow teams to interact with the data platform for ingestion, transformation, and querying of data.
  • Develop internal tools and frameworks to automate and streamline data engineering processes.
  • Collaborate with senior management, product management, and other engineers in the development of data products.
  • Develop tools to monitor, debug, and analyze data pipelines.
  • Design and implement data schemas and models that can scale.
  • Mentor team members to build the companys overall expertise.
  • Work to make The RealReal an innovator in the space by bringing passion and new ideas to work every day


Required Skills

  • At least 5 years of proven experience as a Data Engineer in developing platform level capabilities for a data-driven midsize to large corporations.
  • Strong object-oriented programming skills in languages such as Python, Java or Scala, wigth experience building large-scale, fault-tolerant systems.
  • Experience with cloud platforms (GCP, AWS, AZURE) with strong preference to GCP.
  • Experience with BigQuery or similar (Redshift, Snowflake, other MPP databases)
  • Experience building data pipelines & ETL Experience with command line, version control software (git)
  • Excellent communication and collaboration skills.
  • Ability to work independently and quickly become productive after joining.


Preferred Requirements:

  • Knowledge of distributed data processing frameworks such as Apache Kafka, Flink. Spark, or similar.
  • Experience with DBT (Data Build Tool) and Looker. Experience with machine learning pipelines or MLOps.

  • Data Engineer

    Há 1 mês


    Manaus, Brasil Pivotal Solutions Tempo inteiro

    This is a contract position that will start immediately through the end of the year, with possible extension through next year depending on performance.Responsibilities:Collaborate with data analysts, engineers, business stakeholders, data scientists, and other team members to understand detailed data requirements.Write code in Python and Airflow to build...

  • Data Engineer Web Scraping

    4 semanas atrás


    Manaus, Brasil buscojobs Brasil Tempo inteiro

    Before you apply, please get familiar with LuxoftMandatory Skills:PythonStrong on DevOps side of things (K8s, Docker, Jenkins)Project Description:Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and...

  • DevOps Engineer

    2 semanas atrás


    Manaus, Brasil Pride Global Tempo inteiro

    Key Responsibilities: CI/CD Pipelines: Design, implement, and manage CI/CD pipelines for AI/ML products, facilitating seamless integration and delivery across development, testing, and production environments. Infrastructure as Code (IaC): Develop and maintain IaC using tools like Terraform, Ansible, or AWS CloudFormation to ensure scalable and consistent...

  • Data Engineer

    Há 5 dias


    Manaus, Brasil buscojobs Brasil Tempo inteiro

    Requirements :Hands on experience with Azure data platform stack : Azure Databricks, Azure Data Factory, Azure Data Lake storage, Azure DevOps, Azure FunctionsExperience with designing and building end-to-end pipelinesExperience in Azure DevOps CI / CD Stories, Bugs, and Issue managementStrong experience in shell scripting is required.Strong ETL...

  • Data Engineer

    Há 6 dias


    Manaus, Brasil buscojobs Brasil Tempo inteiro

    Experience with designing and building end-to-end pipelinesExperience in Azure DevOps CI / CD Stories, Bugs, and Issue managementStrong experience in shell scripting is required.Strong ETL knowledgeExperience with SnowflakeExperience in Enterprise Data Warehousing.Ability to build pipelines to process structured and semi-structured data.Ability to work with...

  • React Engineer

    Há 2 dias


    Manaus, Brasil buscojobs Brasil Tempo inteiro

    My client is a FinTech organisation looking for an experienced Front End Engineer to join their team.Summary:As a Front-End React Engineer, you will play a pivotal role in shaping the user experience of our products. You will work with React to build responsive user interfaces.Responsibilities:Collaborate with our design and product teams to translate...

  • Data Architect

    2 meses atrás


    Manaus, Brasil HCLTech Tempo inteiro

    www.hcltech.comWe are HCLTech, one of the world’s largest and fastest growing technology and DSA companies with over 227,000 professionals across 60 countries, driving progress through industry-leading capabilities focused on Digital, Engineering and Cloud.The driving force behind this work, our people, is a diverse, creative and passionate audience that...

  • Data Architect

    3 semanas atrás


    Manaus, Brasil HCLTech Tempo inteiro

    www.hcltech.comWe are HCLTech, one of the world’s largest and fastest growing technology and DSA companies with over 227,000 professionals across 60 countries, driving progress through industry-leading capabilities focused on Digital, Engineering and Cloud.The driving force behind this work, our people, is a diverse, creative and passionate audience that...


  • Manaus, Amazonas, Brasil Luxoft Tempo inteiro

    Job Description: We are looking for a skilled Technical Business Analyst to join our team at Luxoft. This role will be responsible for delivering regulatory requirements and collaborating with business teams to document workflows and develop functional specifications.The ideal candidate will have 6+ years of experience in System and Business Analysis, strong...


  • Manaus, Amazonas, Brasil Jobbol Tempo inteiro

    Key Responsibilities:• Develop and implement scalable, efficient, and secure software applications using a range of technologies including Java and Python.• Collaborate with cross-functional teams to design and implement features that meet business requirements and improve user experience.• Participate in code reviews and contribute to the development...

  • Senior Software Engineer

    4 semanas atrás


    Manaus, Brasil Orange Quarter Tempo inteiro

    Orange Quarter have partnered with the fastest growing scale-up in the world and I’m helping them hire Senior Software Engineers for their teams in LATAM as they accelerate towards IPO.They have a market leading HR and Payroll platform that is used by over 35,000 businesses across 150+ countries.This role entails being part of a truly cross-functional...

  • Full Stack Engineer

    4 meses atrás


    Manaus, Brasil Smarter Contact Tempo inteiro

    Smarter Contact is a rapidly growing SaaS company at the forefront of revolutionizing customer engagement. Our cutting-edge platform empowers businesses to connect with their customers in meaningful ways, utilizing the latest technologies to enhance communication, streamline processes, and drive overall customer satisfaction.As we are growing our market...


  • Manaus, Brasil Luxoft Tempo inteiro

    Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics.ResponsibilitiesWeb scraping using...

  • Software Engineer

    Há 1 mês


    Manaus, Amazonas, Brasil Winnin Tempo inteiro

    About this role: We are seeking a skilled Software Engineer to join our team at {company}. The successful candidate will be responsible for designing, developing, and testing software applications.Key Responsibilities:Design and develop software applications using various programming languages and frameworks.Collaborate with cross-functional teams to...


  • Manaus, Amazonas, Brasil Jabil Circuit Tempo inteiro

    About the Role:We are seeking an experienced Industrial Engineer Manager to lead our team in planning, designing, implementing, and managing integrated production and service delivery systems. As an Industrial Engineer Manager at Jabil Circuit, you will be responsible for ensuring performance, reliability, maintainability, schedule adherence, and cost...


  • Manaus, Brasil Prosigliere Tempo inteiro

    We are seeking to bring on board a Senior BackEnd Engineer with a deep understanding of Java programming, software development methodologies and the ability to design, develop and maintain complex Java based applications, while also contributing significantly to the technical excellence of the team.ResponsibilitiesExceptional problem solving skills to...

  • Senior Software Engineer

    2 semanas atrás


    Manaus, Brasil Remobi Tempo inteiro

    Senior Software Developer - (REMOTE) Brazil About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in...

  • Senior Software Engineer

    3 semanas atrás


    Manaus, Brasil Remobi Tempo inteiro

    Senior Software Engineer / Golang DeveloperAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. Because it doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in...


  • Manaus, Brasil Interlix Staffing Tempo inteiro

    Company Overview: Our client is a startup revolutionizing the agricultural industry by providing cutting-edge AI-driven risk management solutions for specialty crop growers (fruits, vegetables, and tree nuts). Their mission is to protect farmers from unforeseen risks in an increasingly volatile climate.Position Overview: We’re seeking a Senior Software...

  • Technical Engineer Lead

    2 semanas atrás


    Manaus, Brasil Launchcode Tempo inteiro

    About Us:Launchcode is a cutting-edge technology company focused on revolutionizing the agricultural industry. Our innovative solutions leverage advanced software and IoT technologies to optimize operations and improve efficiency. We are currently seeking a skilled Technical Engineer Lead Full Stack to join our dynamic team.Important facts about this...