Senior Data Engineer

Há 18 horas

São Paulo, São Paulo, Brasil AM53 Tempo inteiro R$90.000 - R$120.000 por ano

We are seeking a highly skilled and motivated Senior Data Engineer to play a key role in our significant data platform migration project. You will be responsible for designing, developing, and optimizing data pipelines and transformations as we transition from our current Airflow, PySpark, Athena, and BigQuery environment to a modern stack built on Airflow, dbt, and Snowflake. This role requires a strong understanding of data warehousing principles, excellent SQL and Python skills, and a proven ability to deliver robust and scalable data solutions.

Your Responsibilities

  • Data Migration & Pipeline Development:

Design, develop, and implement efficient and reliable data pipelines to migrate data from PySpark/Athena/BigQuery to DBT/Snowflake.

Translate complex data requirements into actionable dbt models and transformations within Snowflake.

Build and maintain Airflow DAGs for orchestrating data ingestion, transformation, and loading processes.

Optimize existing data pipelines for performance, scalability, and cost efficiency in the new Snowflake environment.

  • Data Modeling & Transformation:

Develop and maintain robust data models in Snowflake using dbt, adhering to best practices for data warehousing and analytics.

Write complex SQL queries for data extraction, transformation, and loading.

Ensure data quality, accuracy, and consistency throughout the migration and ongoing data operations.

  • Troubleshooting & Optimization:

Identify, diagnose, and resolve data-related issues, performance bottlenecks, and data discrepancies.

Proactively monitor data pipelines and systems to ensure smooth operation and data availability.

Implement performance tuning strategies within Snowflake and dbt to optimize query execution and resource utilization.

  • Collaboration & Documentation:

Collaborate closely with Lead Data Engineers, Data Analysts, and other stakeholders to understand data needs and deliver effective solutions.

Contribute to the development and maintenance of comprehensive technical documentation for data pipelines, models, and processes.

Participate in code reviews and contribute to the team's adherence to coding standards and best practices.

Requisitos:

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
  • 3+ years of experience in data engineering, with a focus on building and maintaining scalable data pipelines.
  • Solid experience with data migration projects and working with large datasets.
  • Strong hands-on experience with Snowflake, including data loading, querying, and performance optimization.
  • Proficiency in dbt (data build tool) for data transformation and modeling.
  • Proven experience with Apache Airflow for scheduling and orchestrating data workflows.
  • Expert-level SQL skills, including complex joins, window functions, and performance tuning.
  • Proficiency in Python for data manipulation, scripting, and automation for edge cases
  • Familiarity with PySpark, AWS Athena, and Google BigQuery (source systems).
  • Understanding of data warehousing concepts, dimensional modeling, and ELT principles.
  • Knowledge of building CI/CD pipelines for code deployment
  • Experience with version control systems (e.g., Github).
  • Excellent problem-solving, analytical, and communication skills.
  • Ability to work independently and as part of a collaborative team in an agile environment.
  • Must speak and write in English fluently; Effective communicator

  • Senior Data Engineer

    Há 6 dias

    São Paulo, São Paulo, Brasil Nearform Tempo inteiro R$90.000 - R$120.000 por ano

    This is acontract full-timeremote position for those based inBrazil. The initial contract is for6 months,with strong potential for extension.About UsNearform is an independent team of engineers, designers, data experts and strategists who build intelligent digital solutions and capability at pace. We create software solutions that enhance digital...

  • Data Engineer Sênior

    Há 6 dias

    São Paulo, São Paulo, Brasil Sauter Tempo inteiro R$90.000 - R$120.000 por ano

    Description:Estamos em busca de Data Engineers Seniores para se juntarem à nossa equipe de dados.Se você é apaixonado por construir pipelines de dados robustos, escaláveis e eficientes, e tem uma expertise sólida com o ecossistema do Google Cloud Platform (GCP), essa vaga é para vocêResponsabilidades e atribuições:Desenvolver e implementar cubos e...

  • Data Engineer Sênior

    Há 6 dias

    São Paulo, São Paulo, Brasil SAUTER Tempo inteiro R$90.000 - R$120.000 por ano

    Estamos em busca de Data Engineers Seniores para se juntarem à nossa equipe de dados.Se você é apaixonado por construir pipelines de dados robustos, escaláveis e eficientes, e tem uma expertise sólida com o ecossistema do Google Cloud Platform (GCP), essa vaga é para você Responsabilidades e AtribuiçõesDesenvolver e implementar cubos e tabelas...

  • Data Engineer Sênior

    Há 15 horas

    São Paulo, São Paulo, Brasil Maitha Tech Tempo inteiro R$90.000 - R$120.000 por ano

    São Paulo, SPSêniorSobre a vagaBuscamos um(a) Data Engineer Sênior para construir e gerenciar a infraestrutura de dados em um projeto de transformação digital com IA. Você será responsável por implementar arquiteturas Lakehouse usando Databricks, criar pipelines robustos e garantir a disponibilidade, confiabilidade e otimização das informações...

  • Sênior Data Engineer

    1 semana atrás

    São Paulo, São Paulo, Brasil HVAR CONSULTING Tempo inteiro R$90.000 - R$120.000 por ano

    TECNOLOGIA – SÃO PAULO / SPSobre a vaga:Estamos em busca de um Engenheiro de Dados com forte experiência em Google Cloud Platform (GCP), habilidades avançadas em SQL, Python e Google Apps Script. O profissional será responsável por desenvolver soluções de integração, automação e análise de dados, garantindo escalabilidade, segurança e...

  • Senior Data Engineer

    Há 18 horas

    São Paulo, São Paulo, Brasil Nubank Tempo inteiro R$100.000 - R$150.000 por ano

    Sobre o NubankO Nubank nasceu em 2013 com a missão de combater a complexidade para empoderar as pessoas no seu dia a dia, reinventando os serviços financeiros. Somos uma das maiores plataformas de banco digital do mundo, atendendo a milhões de clientes no Brasil, México e Colômbia. Para mais informações acesse nossa página institucional Nosso time de...

  • Senior Data Engineer

    2 semanas atrás

    São Paulo, São Paulo, Brasil Truelogic Tempo inteiro R$80.000 - R$150.000 por ano

    About TruelogicAt Truelogic we are a leading provider of nearshore staff augmentation services headquartered in New York. For over two decades, we've been delivering top-tier technology solutions to companies of all sizes, from innovative startups to industry leaders, helping them achieve their digital transformation goals.Our team of 600+ highly skilled...

  • Senior Data Engineer

    Há 6 dias

    São Paulo, São Paulo, Brasil Workana Tempo inteiro US$70.000 - US$120.000 por ano

    Workana is the largest remote work platform for talents in Latin America. Our new segment, Workana Premium, focuses on matching the most exceptional professionals with leading and innovative companies around the globe. Enjoy competitive compensation, dedicated support, and the flexibility of remote work within a dynamic environment that fosters collaboration...

  • Senior Data Engineer

    1 semana atrás

    São Paulo, São Paulo, Brasil Workana Tempo inteiro R$120.000 - R$360.000 por ano

    Workana is the largest remote work platform for talents in Latin America. Our new segment, Workana Premium, focuses on matching the most exceptional professionals with leading and innovative companies around the globe. Enjoy competitive compensation, dedicated support, and the flexibility of remote work within a dynamic environment that fosters collaboration...

  • Senior Data Engineer

    Há 13 horas

    São Paulo, São Paulo, Brasil Ebury Tempo inteiro R$104.000 - R$130.878 por ano

    Ebury is a global fintech firm dedicated to empowering businesses to expand internationally through tailored and forward-thinking financial solutions. Since our founding in 2009, we've grown to a diverse team of over 1,700 professionals across 40+ offices and 29+ markets worldwide. Joining Ebury means becoming part of a collaborative and innovative...