Data Engineer
Há 3 dias
What will you need?
To be successful in this role you will need to have excellent analytic skills related to working with structured, semi structured and unstructured datasets, Expert SQL knowledge and experience with relational as well as no-SQL database systems.
You must have expert level Programming skills in Python/PySpark, and it would be beneficial if you have also experience in Java/Scala programming.
Furthermore, we would prefer you to have experience with Data Warehousing for large complex data sets – defining, building and optimizing data models based on use case requirements.
· University Degree in Computer Science, Information Systems, Statistics, or related field;
· Minimum 5 years of experience in the IT;
· Minimum 3 years of experience in the Data Engineer role;
· Expertise with Data Lake/Big Data Projects implementation in Cloud (preferably MS Azure) and/or On-premise platforms:
o Cloud – Azure technology stack: ADLS Gen2, Databricks (proven experience is a big plus), EventHub, Stream Analytics, Synapse Analytics, AKS, Key Vault;
o On Premise: Spark, HDFS, Hive, Hadoop distributions (Cloudera or MapR), Kafka, Airflow (or any other scheduler)
· Experience with designing and building lakehouse architectures in Parquet / Delta and Synapse Serverless or Databricks SQL (knowledge of Unity Catalogue is big plus)
· Ability to develop, maintain and distribute the code in modularized fashion
· Working experience with DevOps framework
· Very good understanding of Software Development Lifecycle, source code management, code reviews, etc.
· Experience in performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement;
· Experience in building processes supporting data transformation, data structures, metadata, dependency and workload management
You should have:
· Ability to collaborate across different teams/geographies/stakeholders/levels of seniority
· Energetic, enthusiastic and results-oriented personality
· Customer focus with an eye on continuous improvement
· Motivation and ability to perform as a consultant in data engineering projects
· Ability to work independently but also within a Team - you must be a team player
· To coach junior data engineers
· Strong will to overcome the complexities involved in developing and supporting data pipelines
· Agile mindset
Language requirements:
· English – Fluent spoken and written
· Spanish / Portuguese – Fluent in one and the other one nice to have
-
Data Engineer
2 semanas atrás
São Paulo, São Paulo, Brasil Blue Orange Digital Tempo inteiro R$80.000 - R$100.000 por anoCompany overview:Blue Orange Digital is a boutique data & AI consultancy that delivers enterprise-grade results. We design and build modern data platforms, analytics, and ML/AI Agent solutions for mid‑market and enterprise clients across Private Equity, Financial Services, Healthcare, and Retail.Our teams work with technologies like Databricks, Snowflake,...
-
Data Engineer_L3_ Program Tech Lead
1 semana atrás
São Paulo, São Paulo, Brasil Grupo Data Tempo inteiro R$120.000 - R$180.000 por anoMuito Gosto Somos o Grupo DATA O nosso propósito é simplificar a vida dos nossos clientes e fazemos isso em todo o mundo, através das nossas soluções de TI. Somos uma multinacional, que opera ativamente em Portugal, e estamos em constante expansão Adoramos trabalhar com grandes empresas e fazer crescer as empresas com as quais colaboramos....
-
AWS Data Engineer
1 semana atrás
São Paulo, São Paulo, Brasil Invictus Data & AI Tempo inteiro R$80.000 - R$120.000 por anoSobre o INVICTUS DATA & AIA Invictus Data & AI busca um(a) Engenheiro(a) de Dados AWS Pleno para integrar nosso time de dados e construir soluções escaláveis e robustas. Você será responsável por desenvolver e manter pipelines de dados, modelar dados e otimizar a performance da nossa infraestrutura de dados na AWS.A Invictus Data & AI foi fundada para...
-
Data Engineer
Há 3 dias
São Paulo, São Paulo, Brasil Instituto Ousía Tempo inteiro R$90.000 - R$120.000 por anoA Ousía Tech está contratandoEstamos em busca de um(a) Data Engineer para atuar em um cliente de grande porte na Zona Sul de São Paulo. Local: Zona Sul – SP | Modelo Híbrido Contrato: PJ Horário: Comercial (segunda a sexta) O que você fará Construção e manutenção de pipelines de dados (Python/SQL) Estruturação de...
-
Data Engineer
Há 2 dias
São Paulo, São Paulo, Brasil OpsBrasil Serviços Cloud LTDA Tempo inteiro R$120.000 - R$360.000 por anoWe're looking for a Data Engineer experienced in building scalable data and AI pipelines on AWS. You'll design and deploy RAG workflows, NodeJS APIs, and TypeScript services that integrate with AWS Bedrock and modern compute infrastructure.ResponsibilitiesBuild and maintain RAG data pipelines for LLM applications.Develop and scale NodeJS/TypeScript APIs with...
-
Senior Data Engineer
2 semanas atrás
São Paulo, São Paulo, Brasil Nearform Tempo inteiro R$90.000 - R$120.000 por anoThis is acontract full-timeremote position for those based inBrazil. The initial contract is for6 months,with strong potential for extension.About UsNearform is an independent team of engineers, designers, data experts and strategists who build intelligent digital solutions and capability at pace. We create software solutions that enhance digital...
-
Data QA Engineer
1 semana atrás
São Paulo, São Paulo, Brasil OpsBrasil Serviços Cloud LTDA Tempo inteiro R$90.000 - R$120.000 por anoWe are looking for a Data QA Engineer to ensure accuracy, reliability, and quality across data pipelines and integrations. This role involves developing and executing testing strategies, building automation frameworks, and collaborating with Data Engineers, DevOps, and Analysts to deliver high-quality, production-ready data. Responsibilities Design...
-
Data Engineer
2 semanas atrás
São Paulo, São Paulo, Brasil Jeeves Tempo inteiro US$90.000 - US$120.000 por anoJeeves is a groundbreaking financial operating system built for global businesses that provides corporate cards, cross-border payments, and spend management software within one unified platform. The company operates across 20+ countries including Brazil, Canada, Colombia, Mexico, the United Kingdom, across Europe, and the United States, and serves over 5,000...
-
Data Engineer, Corporate Data
2 semanas atrás
São Paulo, São Paulo, Brasil DoorDash Tempo inteiro R$90.000 - R$120.000 por anoAbout The TeamAt DoorDash, people are our most important asset. We build the capability to help our leaders make more informed decisions on identifying, attracting, developing, and retaining talent. We're looking for a Data Engineer to help us scale our analytics alongside DoorDash's enormous growth. Come build, experiment, and grow while shaping a...
-
Sr Data/ MLOps Engineer
2 semanas atrás
São Paulo, São Paulo, Brasil InterviewHelp Tempo inteiro R$80.000 - R$150.000 por anoRole:Sr Data/ MLOps EngineerDuration: Long-Term ContractLocation: Brazil – RemoteWe are seeking a highly motivated and experienced Data Engineer with deep expertise in the MLOps discipline to join our clients Data Engineering team. In this role, you will be responsible for designing and developing scalable, robust data architectures and MLOps...
