Data Engineer

3 semanas atrás

Fortaleza, Brasil AgileEngine Tempo inteiro

Overview

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us Best Place to Work awards.

We are looking for a Senior Data Engineer to take ownership of our data infrastructure, designing and optimizing high-performance, scalable solutions. You’ll work with AWS and big data frameworks like Hadoop and Spark to drive impactful data initiatives across the company.

What you will do
  • Design, build, and maintain large-scale data pipelines and data processing systems in AWS.
  • Develop and optimize distributed data workflows using Hadoop, Spark, and related technologies.
  • Collaborate with data scientists, analysts, and product teams to deliver reliable and efficient data solutions.
  • Implement best practices for data governance, security, and compliance.
  • Monitor, troubleshoot, and improve the performance of data systems and pipelines.
  • Mentor junior engineers and contribute to building a culture of technical excellence.
  • Evaluate and recommend new tools, frameworks, and approaches for data engineering.
MUST HAVES
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
  • 5+ years of experience in data engineering, software engineering, or related roles
  • Strong hands-on expertise with AWS services (S3, EMR, Glue, Lambda, Redshift, etc.)
  • Deep knowledge of big data ecosystems, including Hadoop (HDFS, Hive, MapReduce) and Apache Spark (PySpark, Spark SQL, streaming)
  • Strong SQL skills and experience with relational and NoSQL databases
  • Proficiency in Python, Java, or Scala for data processing and automation
  • Experience with workflow orchestration tools (Airflow, Step Functions, etc.)
  • Solid understanding of data modeling, ETL/ELT processes, and data warehousing concepts
  • Excellent problem-solving skills and ability to work in fast-paced environments
  • Ability to work in German TimeZone (6:00-7:00 am to 2:00-3:00 pm Brazil/ART time)
  • Upper-Intermediate English level
NICE TO HAVES
  • Experience with real-time data streaming platforms (Kafka, Kinesis, Flink)
  • Knowledge of containerization and orchestration (Docker, Kubernetes)
  • Familiarity with data governance, lineage, and catalog tools
  • Previous leadership or mentoring experience
PERKS AND BENEFITS
  • Professional growth: Mentorship, TechTalks, and personalized growth roadmaps
  • Competitive compensation: USD-based compensation with budgets for education, fitness, and team activities
  • A selection of exciting projects: Modern solutions development with Fortune 500 enterprises and leading brands
  • Flextime: Flexible schedule with options for remote work or office presence
Job details
  • Seniority level: Mid-Senior level
  • Employment type: Full-time
  • Job function/Industries: IT Services and IT Consulting

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

  • Senior Data Engineer

    Há 2 dias

    Fortaleza, Brasil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    WE ARE HIRING DATA ENGINEER°Offer 100% remotly ONLY BrazilDirect contract with clientThe Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions on AWS, utilizing Snowflake, dbt, and modern automation tools. This role drives best practices for data quality, validation, and governance, while optimizing...

  • Cloud Data Engineer

    Há 2 dias

    Fortaleza, Brasil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    💼 Employment type: Direct Hire – Full-time, with all benefits required by Brazil law💰 Salary range: Competitive and negotiable based on experience🌐 Language: Bilingual (Advanced English – excellent verbal and written communication skills required)The Senior Cloud Data Engineer leads the design, architecture, and implementation of secure,...

  • Data Engineer_L3_ Program Tech Lead

    4 semanas atrás

    Fortaleza, Brasil Grupo Data Tempo inteiro

    Overview About the job: Data Engineer_L3_ Program Tech Lead Description: Program Tech Lead Databricks. Highly skilled Tech Lead to spearhead Snowflake and Databricks migration pipelines. The ideal candidate needs to have extensive experience in data engineering, ETL orchestration, and database management, with a strong proficiency in programming and...

  • Azure Data Engineer

    3 semanas atrás

    Fortaleza, Brasil Aubay Portugal Tempo inteiro

    Job Title: Azure Data Engineer As an experienced professional, you will be responsible for designing, building, testing and maintaining cloud applications and related services on Microsoft Azure. "> Key Responsibilities: Designing, building, testing, and maintaining cloud applications and related services on Microsoft Azure; Building metadata-driven data...

  • Cloud Data Engineer

    2 semanas atrás

    Fortaleza, Brasil Bebeecloud Tempo inteiro

    About the RoleWe are seeking a skilled Unix and Cloud Data Support Engineer to join our application development team.This role is responsible for administering and supporting Unix-based environments that host data processing services.

  • Senior Data Engineer

    4 semanas atrás

    Fortaleza, Brasil Kake Tempo inteiro

    About The Role We are seeking experienced Data Engineers to develop and deliver robust, cost-efficient data products that power analytics, reporting and decision-making across two distinct brands. What You’ll Do Build highly consumable and cost-efficient data products by synthesizing data from diverse source systems. Ingest raw data using Fivetran and...

  • Azure Data Engineer

    3 semanas atrás

    Fortaleza, Brasil Aubay Portugal Tempo inteiro

    Job Title: Azure Data Engineer As an experienced professional, you will be responsible for designing, building, testing and maintaining cloud applications and related services on Microsoft Azure. "> Key Responsibilities: Designing, building, testing, and maintaining cloud applications and related services on Microsoft Azure; Building metadata-driven data...

  • Senior data engineer

    1 semana atrás

    Fortaleza, Brasil Eightpoint Tempo inteiro

    About EightpointEightpoint is an internet technology company specializing in the agile development of products and content that address real-world interests, captivating users and driving significant growth for partners. With offices in the United States and Cayman Islands, Eightpoint collaborates with partners globally on the next generation of user-centric...

  • Data Engineer

    Há 5 dias

    Fortaleza, Brasil BairesDev Tempo inteiro

    Join to apply for the Data Engineer - Remote Work | REF# role at BairesDev . At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on...

  • Unlock Your Career Potential as a Data Engineer

    4 semanas atrás

    Fortaleza, Brasil beBeeData Tempo inteiro

    Job Title: Data Engineer We are seeking a skilled professional to join our team as a Data Engineer. As a key member of our data analytics group, you will be responsible for designing, developing, and maintaining large-scale data systems. This role involves working with various technologies such as Snowflake, DBT, SQL, and Agile Methodologies. You will...