Sr. Big Data Engineer

1 semana atrás

Brazil, BR Tecla Tempo inteiro

*Native/Bilingual English is required for this role (read/written/spoken)


Please upload your CV Resume in English.


Monthly salary: $4,000 - $5,000 USD


Along with our partner, we are seeking a Senior Big Data Engineer to join the Customer Identity (CI) team that is central to the enterprise, focused on ensuring customer data is accurate, consistent, and readily accessible. This critical data is the foundation for essential business processes, including personalized marketing, analytical reporting, and seamless online and in-store checkout and customer service experiences.


They manage a wide array of high-performance, scalable batch and real-time services. These services are utilized at numerous customer interactions, such as in-store purchases, online orders, rewards program enrollments, and activations from various marketing channels (Email, Direct Mail, SMS, Push notifications, etc.). By leveraging modern development practices, tools, and technology platforms, the CI team builds capabilities that empower customer-facing and checkout teams to deliver personalized, relevant, and frictionless experiences, ensuring customers realize value with every interaction.


Core hours:

This team operates in every major US time zone from Pacific to Eastern. Core hours would be considered 10 am CST - 4 pm CST with 2 hours spilling over either direction based on location.


Required Skills:

Non-Negotiable Requirements

  • 5+ years of professional experience as a Data Engineer or in a closely related role.
  • Strong experience with Python.
  • Hands-on experience with Airflow.
  • Experience working with Scala.
  • Experience with Spark, Spark SQL, and Spark Streaming.
  • Experience designing and working with relational and NoSQL databases.
  • Direct experience using Apache Kafka.
  • Strong ability to write complex SQL queries.
  • Experience with GCP, including BigQuery, BigTable, and Dataproc.
  • Experience working with RESTful APIs in data pipelines.


Tech Stack:

Python, Apache Airflow, Apache Spark, Spark SQL, Spark Streaming, Kafka, Relational Databases, NoSQL Databases, GCP BigQuery, BigTable, Dataproc, RESTful APIs.


Bonus Skills:

Experience with Databriks, Snowflake, Java, Springboot.


Duration: 3 months; end date being March 31, 2026, with the possibility of being extended based on team needs.


Benefits:

  • A fully remote position with a structured schedule that supports work-life balance.
  • The opportunity to join a leading retail innovator transforming the shopping experience through cutting-edge technology.
  • Two weeks of paid vacation per year.
  • 10 paid days for local holidays.


*Please note our partner is only looking for full-time dedicated team members who are eager to fully integrate within their team.

  • Big Data Software Engineer – Backend

    2 semanas atrás

    Brazil, BR GraceMark Solutions Tempo inteiro

    Big Data Software Engineer III – Backend (Remote, Brazil)Location: Remote – BrazilSalary: $2,200 USD/month (FTE)About the Role:We are looking for a talented Big Data Software Engineer III to join the Core ML Powerback Features Team. You will work on backend systems powering user-facing features, collaborating closely with design, product, and client...

  • Data Engineer

    2 semanas atrás

    Brazil, BR GraceMark Solutions Tempo inteiro

    Hello!We currently have a great job opportunity for you!About the role:Role: Data EngineerLocation: São Paulo, Brazil Duration: 6 monthsSalary: $ 2200 USD monthly (FTE)We’re looking for a Data Engineer with backend experience to join a high-impact engineering team building large-scale user-facing products.What You’ll DoBuild and enhance backend features...

  • Azure Data Engineer

    1 semana atrás

    Brazil, BR Penta Consulting Tempo inteiro

    We are currently looking for a Portuguese speaking Data Engineer to work across Microsoft Azure solutions in delivering proactive services and workshops to premier enterprise customers in remotely in Brazil. Key ResponsibilitiesDesign and implement end-to-end data architecture solutions on Microsoft Azure.Develop and manage ETL/ELT pipelines using Azure Data...

  • Data Engineer

    2 semanas atrás

    Brazil, BR Avenue Code Tempo inteiro

    About the company:Avenue Code is the leading software consultancy focused on delivering end-to-end development solutions for digital transformation across every vertical. We’re privately held, profitable, and have been on a solid growth trajectory since day one. We care deeply about our clients, our partners, and our people. We prefer the word...

  • Data Engineer

    Há 5 dias

    Brazil, BR Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...

  • Data Engineer

    2 semanas atrás

    Brazil, BR Zunzun Solutions Tempo inteiro

    Summary:We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines. In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions. You will play a key role in modernizing our data platform on the...

  • Sr Python Data Engineer

    4 semanas atrás

    Brazil, BR Softensity Inc Tempo inteiro

    Senior Python Data EngineerAbout the ProjectResponsibilitiesDesign, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).Develop and expose RESTful APIs using FastAPI or similar frameworks.Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.Contribute...

  • Senior Data Engineer

    3 semanas atrás

    Brazil, BR Breakthrough Talent Tempo inteiro

    Senior Data EngineersBreakthrough Talent is currently supporting a leading data business build a brand new data platform to support a modern data mesh organisation. They work with national and global clients across data, software and digital consulting, and they are now looking for a Data Infrastructure Engineer to help build and scale their next generation...

  • Databricks Data Engineer

    2 semanas atrás

    Brazil, BR GlobalSource IT Tempo inteiro

    Databricks Data EngineerFully Remote Contract We’re looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake. This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and...

  • Data Analyst

    Há 5 dias

    Brazil, BR Pride Global Tempo inteiro

    We're looking for a Data Analytics & Engineering Specialist in Brazil!!Location: Remote (Brazil)Employment Type: PJ - Open EndedAbout the RoleWe are looking for a gritty problem solver and self-starter who will serve as a key interface between the Analytics and Engineering teams. In this role, you will deeply understand the needs of analytics stakeholders,...