Data Engineer

Há 7 horas

João Pessoa, Brasil AgileEngine Tempo inteiro

Join to apply for the Data Engineer (Senior) ID40199 role at AgileEngine

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you

ABOUT THE ROLE

We are looking for a Senior Data Engineer to take ownership of our data infrastructure, designing and optimizing high-performance, scalable solutions. You’ll work with AWS and big data frameworks like Hadoop and Spark to drive impactful data initiatives across the company.

WHAT YOU WILL DO

  • Design, build, and maintain large-scale data pipelines and data processing systems in AWS.
  • Develop and optimize distributed data workflows using Hadoop, Spark, and related technologies.
  • Collaborate with data scientists, analysts, and product teams to deliver reliable and efficient data solutions.
  • Implement best practices for data governance, security, and compliance.
  • Monitor, troubleshoot, and improve the performance of data systems and pipelines.
  • Mentor junior engineers and contribute to building a culture of technical excellence.
  • Evaluate and recommend new tools, frameworks, and approaches for data engineering.

MUST HAVES

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field;
  • 5+ years of experience in data engineering, software engineering, or related roles;
  • Strong hands-on expertise with AWS services (S3, EMR, Glue, Lambda, Redshift, etc.);
  • Deep knowledge of big data ecosystems , including Hadoop (HDFS, Hive, MapReduce) and Apache Spark (PySpark, Spark SQL, streaming);
  • Strong SQL skills and experience with relational and NoSQL databases;
  • Proficiency in Python, Java, or Scala for data processing and automation;
  • Experience with workflow orchestration tools (Airflow, Step Functions, etc. );
  • Solid understanding of data modeling, ETL/ELT processes, and data warehousing concepts;
  • Excellent problem-solving skills and ability to work in fast-paced environments;
  • Ability to work German TimeZone (:6 - 7 am to : 2-3 pm Brazil/ ART time),
  • Upper-Intermediate English level.

NICE TO HAVES

  • Experience with real-time data streaming platforms (Kafka, Kinesis, Flink).
  • Knowledge of containerization and orchestration (Docker, Kubernetes).
  • Familiarity with data governance, lineage, and catalog tools.
  • Previous leadership or mentoring experience.

PERKS AND BENEFITS

  • Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
  • Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
  • A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
  • Flextime: Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.

Seniority level

  • Mid-Senior level

Employment type

  • Full-time

Job function

  • Industries
  • IT Services and IT Consulting

Referrals increase your chances of interviewing at AgileEngine by 2x

Note: This job description may include other related roles listed for reference.

#J-18808-Ljbffr

  • Big Data Engineer

    Há 3 dias

    João Pessoa, Paraíba, Brasil HUNT IT - Recrutamento Especializado para TI Tempo inteiro

    Descrição: Big Data EngineerOur Client is a US technology company looking for a highly motivated Data Engineer with a passion for data, to build and implement data pipelines in cloud technologies, including SnapLogic and AWS.Responsibilities:● Develops and maintains scalable data pipelines in SnapLogic and builds out new ETL and API integrations to...

  • Data Engineer

    Há 7 horas

    João Pessoa, Brasil Coda Search│Staffing Tempo inteiro

    Get AI-powered advice on this job and more exclusive features. Our client is a U.S.-based company that provides technical expertise, testing, and certification services to the global food and agricultural industry. Their mission is to ensure food safety, quality, and sustainability across international supply chains. This role is critical to building,...

  • Lead Data Engineer

    Há 7 horas

    João Pessoa, Brasil Fusemachines Tempo inteiro

    3 weeks ago Be among the first 25 applicants About FusemachinesFusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican...

  • Cloud Data Engineering Opportunity

    Há 2 dias

    João Pessoa, Paraíba, Brasil beBeeDataEngineer Tempo inteiro US$10.360 - US$10.720

    Senior Cloud Data Engineer PositionThis role is a senior-level opportunity to work as a Cloud Data Engineer, requiring expertise in Azure tool Stack, including Databricks, ADF, and Synapse Analytics.Primary Responsibilities:Design and implement advanced solutions for complex integrations and data preprocessing tasks.Sustain activities on large-scale data...

  • Sr. Data Engineer

    Há 3 dias

    João Pessoa, Paraíba, Brasil RecargaPay Tempo inteiro

    Come Make an Impact on Millions of Brazilians At RecargaPay, we're on a mission to deliver the best payment experience for Brazilian consumers and small businesses — by building a powerful digital ecosystem where the banked and unbanked connect, and where consumers and merchants have a one-stop shop for all their financial needs. We serve over 10 million...

  • Software Engineer

    Há 2 dias

    João Pessoa, Paraíba, Brasil beBeeBlockchain Tempo inteiro US$200.000 - US$250.000

    Job OpportunityFight crime and create a safer world by leveraging blockchain data and advanced analytics to combat illicit activity.We are seeking a skilled Software Engineer to execute mission-critical systems and data services analyzing blockchain transaction activity at petabyte scale.You will be part of a team empowering governments, financial...

  • Big Data Solutions Architect

    Há 2 dias

    João Pessoa, Paraíba, Brasil beBeeData Tempo inteiro US$10.000 - US$138.000

    Job Title: Big Data EngineerThe role of a Big Data Engineer is crucial in building and implementing data pipelines in cloud technologies. As a highly motivated individual, you will develop and maintain scalable data pipelines in SnapLogic and build out new ETL and API integrations to support increasing data volume and complexity.Key Responsibilities:Develop...

  • Senior Software Engineer, Data Product

    Há 10 horas

    João Pessoa, Brasil TRM Labs Tempo inteiro

    TRM is on a mission to build a safer financial system for billions of people. We deliver a blockchain intelligence data platform to financial institutions, crypto companies, and governments to fight cryptocurrency fraud and financial crime. We consider our business — and our profit — as a way to move towards our mission sustainably and at scale. The...

  • Senior Data Engineer

    Há 7 horas

    João Pessoa, Brasil Solvd, Inc. Tempo inteiro

    Overview Solvd Inc. is a rapidly growing AI-native consulting and technology services firm delivering enterprise transformation across cloud, data, software engineering, and artificial intelligence . We work with industry-leading organizations to design, build, and operationalize technology solutions that drive measurable business outcomes. Following the...

  • Chief Data Architect

    Há 2 dias

    João Pessoa, Paraíba, Brasil beBeeDataEngineer Tempo inteiro US$70.000 - US$120.000

    Unlock the Power of Data EngineeringWe are seeking a skilled Data Engineer to design and build data platforms that propel our organization's success. This role is not just about coding and databases; it's about transforming raw data into actionable insights that drive strategic decisions and innovation.Create the foundation of our data infrastructure,...