Senior Data Engineer
Há 23 horas
Job Description
We are seeking a skilled
Senior Data Engineer
with a solid background in data engineering and software engineering and exposure to
machine learning.
The ideal candidate will work with
Polars
as the
primary data frame
library and contribute to building, testing, and optimizing data-driven solutions.
Key Responsibilities
- Develop robust data transformations using
Python
and
Polars
for efficient processing and analytics tasks.
- Hands-on experience in
data engineering
- Write clean, maintainable, and efficient code with a strong emphasis on software engineering principles.
- Gather data from diverse sources, transforming it efficiently, and delivering clean, reliable datasets and reports that support critical business decision-making.
- Implement and maintain unit testing and end-to-end testing.
- Utilize
Docker
for testing and development environments.
- Manage data infrastructure on
GCP
- Apply a foundational understanding of machine learning concepts in project work.
- Contribute to projects requiring some Ruby coding support.
Requirements
- 6+ years of experience in data engineering
- Strong proficiency in Python.
- Hands-on experience in data engineering, including
designing, building, and optimizing data pipelines, ETL processes,
and workflows.
- Solid software engineering skills (design, architecture, and best practices).
- Experience working with Polars (or similar data frame libraries).
- Knowledge of unit testing and end-to-end testing frameworks.
- Hands-on experience with Docker for testing purposes.
- Exposure to GCP services.
- Basic understanding of
machine learning
concepts.
- Good to have some experience with
Ruby
.
-
Senior Data Engineer
2 semanas atrás
São Paulo, São Paulo, Brasil Nearform Tempo inteiro R$90.000 - R$120.000 por anoThis is acontract full-timeremote position for those based inBrazil. The initial contract is for6 months,with strong potential for extension.About UsNearform is an independent team of engineers, designers, data experts and strategists who build intelligent digital solutions and capability at pace. We create software solutions that enhance digital...
-
Data Engineer Sênior
1 semana atrás
São Paulo, São Paulo, Brasil Maitha Tech Tempo inteiro R$90.000 - R$120.000 por anoSão Paulo, SPSêniorSobre a vagaBuscamos um(a) Data Engineer Sênior para construir e gerenciar a infraestrutura de dados em um projeto de transformação digital com IA. Você será responsável por implementar arquiteturas Lakehouse usando Databricks, criar pipelines robustos e garantir a disponibilidade, confiabilidade e otimização das informações...
-
Senior Data Engineer
1 semana atrás
São Paulo, São Paulo, Brasil Nubank Tempo inteiro R$100.000 - R$150.000 por anoSobre o NubankO Nubank nasceu em 2013 com a missão de combater a complexidade para empoderar as pessoas no seu dia a dia, reinventando os serviços financeiros. Somos uma das maiores plataformas de banco digital do mundo, atendendo a milhões de clientes no Brasil, México e Colômbia. Para mais informações acesse nossa página institucional Nosso time de...
-
Senior Data Engineer
1 semana atrás
São Paulo, São Paulo, Brasil Celebal Technologies Tempo inteiro R$90.000 - R$120.000 por anoJob Title:Data EngineerLocation:São Paulo, Brazil (Hybrid or Remote within Brazil)Employment Type:Full-timeAbout the RoleWe are looking for an experienced Data Engineer to join our data team in Brazil. The ideal candidate will design and maintain modern data pipelines and architectures, with a strong focus on Databricks development and migration projects...
-
Senior Data Engineer
1 semana atrás
São Paulo, São Paulo, Brasil AM53 Tempo inteiro R$90.000 - R$120.000 por anoWe are seeking a highly skilled and motivated Senior Data Engineer to play a key role in our significant data platform migration project. You will be responsible for designing, developing, and optimizing data pipelines and transformations as we transition from our current Airflow, PySpark, Athena, and BigQuery environment to a modern stack built on Airflow,...
-
Senior Data Engineer
1 semana atrás
São Paulo, Estado de São Paulo, Brasil Tata Consultancy Services Tempo inteiroCome to one of the biggest IT Services companies in the world!! Here you can transform your career!Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to...
-
Senior Data Engineer
1 semana atrás
São Paulo, São Paulo, Brasil Bonapolia Tempo inteiro R$80.000 - R$120.000 por anoJoin us as aSenior Data Engineer (Snowflake)and build scalable apps that make an impact. You'll explore new tech, work with the latest tools, and thrive in a fast-moving Agile team.A U.S.-based education services provider offering online and campus-based post-secondary education, primarily serving military personnel, veterans, and public service communities....
-
Senior Data Engineer
Há 2 dias
São Paulo, São Paulo, Brasil Truelogic Tempo inteiro R$80.000 - R$150.000 por anoAbout TruelogicAt Truelogic we are a leading provider of nearshore staff augmentation services headquartered in New York. For over two decades, we've been delivering top-tier technology solutions to companies of all sizes, from innovative startups to industry leaders, helping them achieve their digital transformation goals.Our team of 600+ highly skilled...
-
Senior Data Engineer
Há 17 horas
São Paulo, São Paulo, Brasil Truelogic Tempo inteiro R$120.000 - R$240.000 por anoAbout TruelogicAt Truelogic we are a leading provider of nearshore staff augmentation services headquartered in New York. For over two decades, we've been delivering top-tier technology solutions to companies of all sizes, from innovative startups to industry leaders, helping them achieve their digital transformation goals.Our team of 600+ highly skilled...
-
Senior Data Engineer
2 semanas atrás
São Paulo, São Paulo, Brasil Sinch Tempo inteiro R$90.000 - R$120.000 por anoSinch is looking for a talented and experiencedSenior Data Engineerto join our Data Engineering team. In this crucial role, you will be responsible for building, maintaining, and supportingdata pipelinesthat connect our various products globally. You will use innovative approaches and technologies, designing data architectures that empower the data domain...