Data Engineer

Há 17 horas

Campinas, São Paulo, Brasil AgileEngine Tempo inteiro
Overview

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you

About the role

We are looking for a Senior Data Engineer to take ownership of our data infrastructure, designing and optimizing high-performance, scalable solutions. You'll work with AWS and big data frameworks like Hadoop and Spark to drive impactful data initiatives across the company.

What you will do
  • Design, build, and maintain large-scale data pipelines and data processing systems in AWS.
  • Develop and optimize distributed data workflows using Hadoop, Spark, and related technologies.
  • Collaborate with data scientists, analysts, and product teams to deliver reliable and efficient data solutions.
  • Implement best practices for data governance, security, and compliance.
  • Monitor, troubleshoot, and improve the performance of data systems and pipelines.
  • Mentor junior engineers and contribute to building a culture of technical excellence.
  • Evaluate and recommend new tools, frameworks, and approaches for data engineering.
MUST HAVES
  • Bachelor's or Master's degree in Computer Science, Engineering, or related field
  • 5+ years of experience in data engineering, software engineering, or related roles
  • Strong hands-on expertise with AWS services (S3, EMR, Glue, Lambda, Redshift, etc.)
  • Deep knowledge of big data ecosystems, including Hadoop (HDFS, Hive, MapReduce) and Apache Spark (PySpark, Spark SQL, streaming)
  • Strong SQL skills and experience with relational and NoSQL databases
  • Proficiency in Python, Java, or Scala for data processing and automation
  • Experience with workflow orchestration tools (Airflow, Step Functions, etc.)
  • Solid understanding of data modeling, ETL/ELT processes, and data warehousing concepts
  • Excellent problem-solving skills and ability to work in fast-paced environments
  • Ability to work in German Time Zone (6:00-7:00 am to 2:00-3:00 pm Brazil/ART time)
  • Upper-Intermediate English level
NICE TO HAVES
  • Experience with real-time data streaming platforms (Kafka, Kinesis, Flink)
  • Knowledge of containerization and orchestration (Docker, Kubernetes)
  • Familiarity with data governance, lineage, and catalog tools
  • Previous leadership or mentoring experience
PERKS AND BENEFITS
  • Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
  • Competitive compensation: We match your skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
  • A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
  • Flextime: Tailor your schedule for an optimal work-life balance, with options for remote or office work.
#J-18808-Ljbffr

  • Data Products Engineer

    Há 16 horas

    Campinas, São Paulo, Brasil beBeeAnalytics Tempo inteiro US$80.000 - US$140.000

    Job DescriptionWe are seeking a skilled Data Engineer to design, develop, and maintain high-quality data products that enable self-service analytics and support decision-making. This role involves transforming complex raw data into trusted, tested, and well-documented datasets and semantic models using modern data platforms.ResponsibilitiesDevelop and...

  • Data Engineer Azure/Databricks Sr

    3 semanas atrás

    Campinas, São Paulo, Brasil Digiage Tempo inteiro

    Buscamos um Data Engineer Sênior com foco em Azure e Databricks. Requisitos: Graduação completa em áreas relacionadas à Tecnologia da Informação. Experiência com processamento de dados massivos e ferramentas de ETL/ELT. Sólidos conhecimentos nas plataformas Azure Data Lake Storage, Azure Data Factory, Databricks e Azure Synapse. Conhecimento em...

  • Senior Data Engineer

    Há 2 dias

    Campinas, São Paulo, Brasil beBeeData Tempo inteiro R$35.000 - R$55.000

    Python Developer JobWe are establishing a highly skilled and ambitious team from the ground up that revolutionizes data management at our organization. This is an exceptional opportunity to be part of it from the beginning.Job OverviewThis role is perfect for someone who seeks to combine their Python development experience with predictive analytics and...

  • Data Engineer Azure/Databricks Pl

    3 semanas atrás

    Campinas, São Paulo, Brasil Digiage Tempo inteiro

    Buscamos Data Engineer Azure/Databricks Skills: Azure, ETL, Databricks, Inteligência Artificial. Requisitos Graduação completa em cursos relacionados à área de Tecnologia da Informação. Experiência em tecnologias de processamento de dados massivos e ferramentas de ETL/ELT. Conhecimento sólido em plataformas de Data & Analytics da Azure, como: Azure...

  • Senior Data Engineer

    Há 2 dias

    Campinas, São Paulo, Brasil beBeeDataEngineering Tempo inteiro R$95.000 - R$122.000

    Lead Data Engineering TeamWe are seeking a seasoned professional to lead our data engineering team. This role is ideal for an experienced data engineer who can leverage their expertise in designing and developing data pipeline architectures for advanced analytics, machine learning, and real-time data processing.The successful candidate will have a proven...

  • Data Engineer

    1 dia atrás

    Campinas, São Paulo, Brasil AgileEngine Tempo inteiro

    OverviewAgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.If you're looking for a place to grow, make an impact,...

  • Data Engineer

    Há 5 dias

    Campinas, São Paulo, Brasil Ciandt Tempo inteiro

    OverviewWe are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.With over 7.400 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history.Artificial Intelligence is our reality.ObjectiveThe Data Developer is a professional passionate about building...

  • Data Engineer

    2 semanas atrás

    Campinas, São Paulo, Brasil CI&T Tempo inteiro

    OverviewObjective: The Data Developer is a professional passionate about building technological solutions that encompass the entire data lifecycle. Their expertise is focused on data ingestion, transformation, governance, organization, and provisioning, ensuring that data is managed efficiently and securely.ResponsibilitiesDevelop and implement data...

  • Data Engineer

    2 semanas atrás

    Campinas, São Paulo, Brasil CI&T Tempo inteiro

    Overview Objective: The Data Developer is a professional passionate about building technological solutions that encompass the entire data lifecycle. Their expertise is focused on data ingestion, transformation, governance, organization, and provisioning, ensuring that data is managed efficiently and securely. Responsibilities Develop and implement data...

  • Data Engineer

    Há 7 dias

    Campinas, São Paulo, Brasil CI&T Software S.A. Tempo inteiro

    We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions. With over 7.400 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality. Objective: The Data Developer is a professional passionate about building...