Data Engineer

Há 6 dias

São Paulo, São Paulo, Brasil IFIT Solutions Tempo inteiro R$80.000 - R$150.000 por ano

What will you need?

To be successful in this role you will need to have excellent analytic skills related to working with structured, semi structured and unstructured datasets, Expert SQL knowledge and experience with relational as well as no-SQL database systems.

You must have expert level Programming skills in Python/PySpark, and it would be beneficial if you have also experience in Java/Scala programming.

Furthermore, we would prefer you to have experience with Data Warehousing for large complex data sets – defining, building and optimizing data models based on use case requirements.

· University Degree in Computer Science, Information Systems, Statistics, or related field;

· Minimum 5 years of experience in the IT;

· Minimum 3 years of experience in the Data Engineer role;

· Expertise with Data Lake/Big Data Projects implementation in Cloud (preferably MS Azure) and/or On-premise platforms:

o Cloud – Azure technology stack: ADLS Gen2, Databricks (proven experience is a big plus), EventHub, Stream Analytics, Synapse Analytics, AKS, Key Vault;

o On Premise: Spark, HDFS, Hive, Hadoop distributions (Cloudera or MapR), Kafka, Airflow (or any other scheduler)

· Experience with designing and building lakehouse architectures in Parquet / Delta and Synapse Serverless or Databricks SQL (knowledge of Unity Catalogue is big plus)

· Ability to develop, maintain and distribute the code in modularized fashion

· Working experience with DevOps framework

· Very good understanding of Software Development Lifecycle, source code management, code reviews, etc.

· Experience in performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement;

· Experience in building processes supporting data transformation, data structures, metadata, dependency and workload management

You should have:

· Ability to collaborate across different teams/geographies/stakeholders/levels of seniority

· Energetic, enthusiastic and results-oriented personality

· Customer focus with an eye on continuous improvement

· Motivation and ability to perform as a consultant in data engineering projects

· Ability to work independently but also within a Team - you must be a team player

· To coach junior data engineers

· Strong will to overcome the complexities involved in developing and supporting data pipelines

· Agile mindset

Language requirements:

· English – Fluent spoken and written

· Spanish / Portuguese – Fluent in one and the other one nice to have

  • Data engineer

    1 semana atrás

    São Paulo, São Paulo, Brasil AM53 Tempo inteiro

    Data Engineer Requisitos:A Data Enginner with strong knowledge on SQL in Redshift.Fluent English

  • Data engineer

    2 semanas atrás

    São Paulo, São Paulo, Brasil Netvagas Tempo inteiro

    Data EngineerRequisitos:A Data Enginner with strong knowledge on SQL in Redshift.Fluent English

  • Data Engineer

    4 semanas atrás

    São Paulo, São Paulo, Brasil Demetria Tempo inteiro

    Join to apply for the Data Engineer (BigQuery & MongoDB) role at Demetria Continue with Google Continue with Google 2 days ago Be among the first 25 applicants Join to apply for the Data Engineer (BigQuery & MongoDB) role at Demetria Get AI-powered advice on this job and more exclusive features. Sign in to access AI-powered advicesContinue with Google...

  • Data Engineer

    2 semanas atrás

    São Paulo, São Paulo, Brasil Demetria Tempo inteiro

    Join to apply for the Data Engineer (BigQuery & MongoDB) role at Demetria Continue with Google Continue with Google 2 days ago Be among the first 25 applicants Join to apply for the Data Engineer (BigQuery & MongoDB) role at Demetria Get AI-powered advice on this job and more exclusive features. Sign in to access AI-powered advices Continue with Google...

  • Data Engineer

    2 semanas atrás

    São Paulo, São Paulo, Brasil Zarego Tempo inteiro

    Role: Data Engineer English level: B2 or higher Remote. Location: Anywhere in Latam At Zarego, we are a team of passionate developers dedicated to creating high-quality software solutions. We focus on solving complex problems and delivering innovative results. We are currently seeking an experienced Data Engineer to join our team.What we're looking for: +5...

  • Data Engineer

    1 semana atrás

    São Paulo, São Paulo, Brasil Yuno Tempo inteiro

    Join to apply for the Data Engineer role at Yuno . Remote, Latam, Full Time, Individual Contributor, +2 years of experience. Who We Are At Yuno, we are building the payment infrastructure that enables all companies to participate in the global market. Founded by a team of seasoned experts in the payments and IT industries, Yuno provides a high-performance...

  • Data Engineer

    2 semanas atrás

    São Paulo, São Paulo, Brasil Yuno Tempo inteiro

    Join to apply for the Data Engineer role at Yuno.Remote, Latam, Full Time, Individual Contributor, +2 years of experience.Who We AreAt Yuno, we are building the payment infrastructure that enables all companies to participate in the global market. Founded by a team of seasoned experts in the payments and IT industries, Yuno provides a high-performance...

  • Data Engineer, Corporate Data

    2 semanas atrás

    São Paulo, São Paulo, Brasil DoorDash Brazil Tempo inteiro

    At DoorDash, people are our most important asset. We build the capability to help our leaders make more informed decisions on identifying, attracting, developing, and retaining talent. We're looking for a Data Engineer to help us scale our analytics alongside DoorDash's enormous growth. Come build, experiment, and grow while shaping a best-in-class data team...

  • Data Engineer

    3 semanas atrás

    São Paulo, São Paulo, Brasil Yuno Tempo inteiro

    Join to apply for the Data Engineer role at Yuno . Remote, Latam, Full Time, Individual Contributor, +2 years of experience. Who We Are At Yuno, we are building the

  • Data Engineer

    2 semanas atrás

    São Paulo, São Paulo, Brasil Artefact Tempo inteiro

    Join to apply for the Data Engineer - Fluent English role at ArtefactJoin to apply for the Data Engineer - Fluent English role at ArtefactGet AI-powered advice on this job and more exclusive features.Who We AreAt Artefact LatAm, we believe in and live a culture based on empathyWho We AreAt Artefact LatAm, we believe in and live a culture based on empathyA...