Data Engineer

4 semanas atrás

Campinas, Brasil AgileEngine Tempo inteiro

Overview

Join to apply for the Data Engineer (Senior) ID40199 role at AgileEngine.

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned Best Place to Work awards.

About the role

Senior Data Engineer to take ownership of our data infrastructure, designing and optimizing high-performance, scalable solutions. You’ll work with AWS and big data frameworks like Hadoop and Spark to drive impactful data initiatives across the company.

What you will do
  • Design, build, and maintain large-scale data pipelines and data processing systems in AWS.
  • Develop and optimize distributed data workflows using Hadoop, Spark, and related technologies.
  • Collaborate with data scientists, analysts, and product teams to deliver reliable and efficient data solutions.
  • Implement best practices for data governance, security, and compliance.
  • Monitor, troubleshoot, and improve the performance of data systems and pipelines.
  • Mentor junior engineers and contribute to building a culture of technical excellence.
  • Evaluate and recommend new tools, frameworks, and approaches for data engineering.
MUST HAVES
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
  • 5+ years of experience in data engineering, software engineering, or related roles
  • Strong hands-on expertise with AWS services (S3, EMR, Glue, Lambda, Redshift, etc.)
  • Deep knowledge of big data ecosystems including Hadoop (HDFS, Hive, MapReduce) and Apache Spark (PySpark, Spark SQL, streaming)
  • Strong SQL skills and experience with relational and NoSQL databases
  • Proficiency in Python, Java, or Scala for data processing and automation
  • Experience with workflow orchestration tools (Airflow, Step Functions, etc.)
  • Solid understanding of data modeling, ETL/ELT processes, and data warehousing concepts
  • Excellent problem-solving skills and ability to work in fast-paced environments
  • Ability to work in German Time Zone (6-7 am to 2-3 pm Brazil/ART time)
  • Upper-Intermediate English level
NICE TO HAVES
  • Experience with real-time data streaming platforms (Kafka, Kinesis, Flink)
  • Knowledge of containerization and orchestration (Docker, Kubernetes)
  • Familiarity with data governance, lineage, and catalog tools
  • Previous leadership or mentoring experience
PERKS AND BENEFITS
  • Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
  • Competitive compensation: USD-based compensation and budgets for education, fitness, and team activities.
  • A selection of exciting projects: Projects with modern solutions development and top-tier clients, including Fortune 500 enterprises.
  • Flextime: Flexible schedule with options for remote or office work.
#J-18808-Ljbffr

  • Data Engineer

    Há 2 dias

    Campinas, Brasil Tort Experts Tempo inteiro

    Join to apply for the Data Engineer role at Tort Experts About Tort Experts We are redefining the landscape of performance marketing in the legal sector. Our mission is to democratize access to information for individuals who have been injured, connecting them with law firms that truly advocate for their rights and achieve successful outcomes. As an...

  • Principal Data Engineer

    3 semanas atrás

    Campinas, Brasil AB InBev Tempo inteiro

    Join to apply for the Principal Data Engineer role at AB InBev 3 days ago Be among the first 25 applicants Join to apply for the Principal Data Engineer role at AB InBev AB InBev is the leading global brewer and one of the world’s top 5 consumer product companies. With over 500 beer brands, we’re number one or two in many of the world’s top beer...

  • Data Engineer for Data-driven solutions development

    3 semanas atrás

    Campinas, Brasil 4flow AG Tempo inteiro

    Data Engineer for Data-driven solutions development page is loaded## Data Engineer for Data-driven solutions developmentremote type: Hybridlocations: Campinastime type: Full timeposted on: Posted Todayjob requisition id: R3630We're looking for a talented Data Engineer to join our growing team and contribute to the development of data-driven...

  • Principal Data Engineer

    4 semanas atrás

    Campinas, Brasil AB InBev Tempo inteiro

    Join to apply for the Principal Data Engineer role at AB InBev 3 days ago Be among the first 25 applicants Join to apply for the Principal Data Engineer role at AB InBev AB InBev is the leading global brewer and one of the world’s top 5 consumer product companies. With over 500 beer brands, we’re number one or two in many of the world’s top beer...

  • Senior Data Engineer

    1 semana atrás

    Greater Campinas, Brasil Vertico Tempo inteiro R$90.000 - R$120.000 por ano

    Vaga: Senior Data Engineer (Founding role)Estamos em busca de um(a) Founding Sr. Data Engineer/ Data Lead para uma empresa daindústria pet.O desafio é liderar aconstrução da área de dados do zeroe transformar informações em vantagem competitiva para o negócio. Principais responsabilidadesCriar a fundação de dados: data lake, pipelines, governança...

  • Data Engineer ID43407

    Há 18 horas

    Campinas, Brasil AgileEngine Tempo inteiro

    Overview AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. About the role As a Senior Data Engineer , you’ll...

  • Data Engineer For Data-Driven Solutions Development

    1 semana atrás

    Campinas, Brasil 4Flow Tempo inteiro

    We're looking for a talented Data Engineer to join our growing team and contribute to the development of data-driven software solutions.You'll leverage your expertise in ETL pipelines and MLOps to identify opportunities, design solutions, and translate them into real-world applicationsWhat your new challenge will look likePartner with stakeholders across the...

  • Data Engineer Manager

    Há 3 dias

    Campinas, Brasil AB InBev Growth Group Tempo inteiro

    About us AB InBev is the leading global brewer and one of the world’s top 5 consumer product companies. With over 500 beer brands, we’re number one or two in many of the world’s top beer markets, including North America, Latin America, Europe, Asia, and Africa. About ABI GrowthGroup Created in 2022, the Growth Group unifies our business-to-business...

  • Data Engineer for Data-driven solutions development

    Há 6 dias

    Campinas, São Paulo, Brasil 4flow Tempo inteiro R$90.000 - R$120.000 por ano

    We're looking for a talented Data Engineer to join our growing team and contribute to the development of data-driven software solutions. You'll leverage your expertise in ETL pipelines and MLOps to identify opportunities, design solutions, and translate them into real-world applicationsWhat your new challenge will look likePartner with stakeholders across...

  • Data Engineer Manager

    Há 17 horas

    Campinas, Brasil Bees Brasil Tempo inteiro

    O BEES é nosso aplicativo B2B, voltado a pequenos e médios varejistas do mundo todo. Usando o BEES, comerciantes e donos de bares de todo o mundo podem fazer pedidos para abastecer seus estoques, programar entregas, acessar dados do próprio negócio e muito mais. No BEES, nosso sonho é um só: fazer nossas pessoas, nossos usuários e nossos parceiros...