Data Engineer

1 semana atrás

Caxias do Sul, Brasil AgileEngine Tempo inteiro

Join to apply for the Data Engineer (Senior) ID40199 role at AgileEngine

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US

If you\'re looking for a place to grow, make an impact, and work with people who care, we\'d love to meet you

ABOUT THE ROLE

We are looking for a Senior Data Engineer to take ownership of our data infrastructure, designing and optimizing high-performance, scalable solutions. You’ll work with AWS and big data frameworks like Hadoop and Spark to drive impactful data initiatives across the company.

WHAT YOU WILL DO

  • Design, build, and maintain large-scale data pipelines and data processing systems in AWS.
  • Develop and optimize distributed data workflows using Hadoop, Spark, and related technologies.
  • Collaborate with data scientists, analysts, and product teams to deliver reliable and efficient data solutions.
  • Implement best practices for data governance, security, and compliance.
  • Monitor, troubleshoot, and improve the performance of data systems and pipelines.
  • Mentor junior engineers and contribute to building a culture of technical excellence.
  • Evaluate and recommend new tools, frameworks, and approaches for data engineering.

MUST HAVES

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field;
  • 5+ years of experience in data engineering, software engineering, or related roles;
  • Strong hands-on expertise with AWS services (S3, EMR, Glue, Lambda, Redshift, etc.);
  • Deep knowledge of big data ecosystems, including Hadoop (HDFS, Hive, MapReduce) and Apache Spark (PySpark, Spark SQL, streaming);
  • Strong SQL skills and experience with relational and NoSQL databases;
  • Proficiency in Python, Java, or Scala for data processing and automation;
  • Experience with workflow orchestration tools (Airflow, Step Functions, etc.);
  • Solid understanding of data modeling, ETL/ELT processes, and data warehousing concepts;
  • Excellent problem-solving skills and ability to work in fast-paced environments;
  • Ability to work in German Time Zone (6:00 - 7:00 am to 2:00-3:00 pm Brazil/ART time);
  • Upper-Intermediate English level.

NICE TO HAVES

  • Experience with real-time data streaming platforms (Kafka, Kinesis, Flink).
  • Knowledge of containerization and orchestration (Docker, Kubernetes).
  • Familiarity with data governance, lineage, and catalog tools.
  • Previous leadership or mentoring experience.

PERKS AND BENEFITS

  • Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
  • Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
  • A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
  • Flextime: Tailor your schedule for an optimal work-life balance, with options for working from home or in the office.

Seniority level

  • Mid-Senior level

Employment type

  • Full-time

Job function

  • Industries: IT Services and IT Consulting

Referrals increase your chances of interviewing at AgileEngine by 2x

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

  • Senior Data Engineer

    1 dia atrás

    Caxias do Sul, Brasil Oowlish Tempo inteiro

    Overview Join Our Team Oowlish, one of Latin America's rapidly expanding software development companies, is seeking experienced technology professionals to enhance our diverse and vibrant team. As a valued member of Oowlish, you will collaborate with premier clients from the United States and Europe, contributing to pioneering digital solutions. Our...

  • Data Science

    2 semanas atrás

    Caxias do Sul, Brasil BairesDev Tempo inteiro

    Data Science / Data Engineer - Remote Work: At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact...

  • Senior Data Engineer

    2 semanas atrás

    Caxias do Sul, Brasil FullStack Labs Tempo inteiro

    Overview Senior Data Engineer - Remote - Latin America at FullStack Labs Join to apply for the Senior Data Engineer - Remote - Latin America role at FullStack Labs. 2 days ago Be among the first 25 applicants About FullStack FullStack is the most transparent IT talent network, connecting highly skilled individuals with top global companies and Silicon Valley...

  • Data Engineer

    2 semanas atrás

    Caxias do Sul, Brasil FullStack Labs Tempo inteiro

    Data Engineer - Remote - Latin America | FullStack Labs Join to apply for the Data Engineer - Remote - Latin America role at FullStack Labs. About FullStack FullStack is the most transparent IT talent network, connecting highly skilled individuals with top global companies and Silicon Valley startups for remote, on-demand projects. We focus on building a...

  • Senior Staff Engineer – Cybersecurity Data Protection Engineer

    3 semanas atrás

    Caxias do Sul, Rio Grande do Sul, Brasil GEICO Tempo inteiro

    Overview Employer Industry: Insurance and Cybersecurity Why consider this job opportunity: Salary up to $260,000.00 Comprehensive Total Rewards program tailored for individual and family well-being 401K savings plan with a 6% match, performance incentives, and tuition assistance Flexible work options, including the ability to work from anywhere in the U.S....

  • Middle/Senior Data Engineer

    1 semana atrás

    Rio Grande do Sul, Brasil Provectus Tempo inteiro R$90.000 - R$120.000 por ano

    Provectus helps companies adopt ML/AI to transform the ways they operate, compete, and drive value. The focus of the company is on building ML Infrastructure to drive end-to-end AI transformations, assisting businesses in adopting the right AI use cases, and scaling their AI initiatives organization-wide in such industries as Healthcare & Life Sciences,...

  • Data Engineer

    2 semanas atrás

    Caxias do Sul, Brasil Lateral Group Tempo inteiro

    Join to apply for the Data Engineer (LATAM) role at Lateral Group 1 week ago Be among the first 25 applicants Join to apply for the Data Engineer (LATAM) role at Lateral Group About The CompanyLateral stands for technology excellence. About The CompanyLateral stands for technology excellence.We’re a profitable, award-winning design and technology...

  • Data Engineer

    3 semanas atrás

    Espírito Santo, Rio Grande do Norte, Brazil buscojobs Brasil Tempo inteiro

    OverviewThis position is fully remote and is a PJ contract. Pay range is 25-29 / hr USD.Required Skills & Experience5+ years of experience as a Data Engineer with minimum 3 years of experience in Azure tool Stack (Databricks, ADF, Synapse Analytics)Good to have experience with other Azure services Azure Functions, Event Grid, etcStrong expertise in writing...

  • Data/Ai Consultant

    1 semana atrás

    Santa Cruz do Sul, Brasil Able.Digital Tempo inteiro

    We're looking for afractional Data/AI Specialistto partner with our sales team on anhourly/contract basis.In this role, you'll act as thetechnical expert during sales cycles, helping prospects understand the value of our data-driven solutions and guiding them toward the right implementation approach.This position is primarily remote, but will requireonsite...

  • Sr. Data Architect

    2 semanas atrás

    Caxias do Sul, Brasil buscojobs Brasil Tempo inteiro

    Native / Bilingual English is required for this role (read / written / spoken). Please upload your CV Resume in English. Monthly salary : $5,000 - $6,000 Overview Our partner is a company where data drives insight and architecture drives impact. They provide advanced analytics and real-time data pipelines that power the foodservice supply chain. Along...