Data Platform Engineer
4 semanas atrás
About the Role and Reponsabilities:
In this role you will have the chance to build large additions to our platform ecosystem, contributing to an infrastructure that centralizes our ETL and streaming infrastructure, enables experimentation and data development, and powers algorithm development. You will design and build scalable engineering solutions to solve business and data problems.
Core tech stack used by this role:
-S3 using Parquet and Iceberg for data storage
-Hive and Iceberg REST catalog as our metadata store
-Spark (Python, SQL, Scala) for data transformation
-Go, Scala and Java for backend development
-Kafka for data streaming
-Kubernetes and Helm for service deployments
-AWS IAM for access control
-Datadog for logging alerting and monitoring
-Trino as our federated query engine
-Identify, develop, and evangelize tooling, approaches, and data products that raise the bar of validity in experiment design and analyses across the company
-Collaborate with multiple teams and functions to deliver deep-dive analyses and experiment design for new initiatives and high-priority business areas
-Develop and iterate on our processes to empower more efficient and rigorous experimentation
Requirements
-You have a degree in an engineering or computer science field
-You have solid experience in platform engineering, with experience on experimentation platforms
-You have experience coding at a production level in Python, Go, Scala or Java
-You've built and supported RBAC systems used by enterprise-wide teams
-You have experience supporting Iceberg-based data warehouses
Avenue Code reinforces its commitment to privacy and to all the principles guaranteed by the most accurate global data protection laws, such as GDPR, LGPD, CCPA and CPRA. The Candidate data shared with Avenue Code will be kept confidential and will not be transmitted to disinterested third parties, nor will it be used for purposes other than the application for open positions. As a Consultancy company, Avenue Code may share your information with its clients and other Companies from the CompassUol Group to which Avenue Code's consultants are allocated to perform its services.
-
Intermediate Data Platform Engineer
Há 3 dias
Brasil Elios Talent Tempo inteiroData Platform Engineer – Intermediate Key Highlights
-
Senior Data Platform Engineer
Há 3 dias
Brasil Elios Talent Tempo inteiroData Platform Engineer – Senior Key Highlights
-
Senior Data Platform Engineer
Há 2 dias
Brasil Elios Talent Tempo inteiroData Platform Engineer – Senior Key Highlights ️ Lead the design and expansion of large-scale data platform components supporting analytics, experimentation, and machine learning workloads ⚡ Architect and optimize ETL, streaming, metadata, and federated querying systems at scale Drive performance tuning, observability, and reliability efforts across...
-
Senior Data Platform Engineer
Há 3 dias
Brasil Elios Talent Tempo inteiroData Platform Engineer – Senior Key Highlights ️ Lead the design and expansion of large-scale data platform components supporting analytics, experimentation, and machine learning workloads Architect and optimize ETL, streaming, metadata, and federated querying systems at scale Drive performance tuning, observability, and reliability efforts across...
-
Platform Engineer
1 semana atrás
Índio do Brasil Flowmentum, Inc. Tempo inteiroSenior DevOps & Platform Engineer (Azure Networking | .NET 4.6 | Terraform | PowerShell | Azure DevOps) Remote | Global Team | Flexible Hours We're hiring a Senior DevOps & Platform Engineer to join our remote-first, results-driven engineering team. If you're an expert in Azure networking and have deep experience with .NET Framework 4.6, this is your...
-
Platform Engineer
1 semana atrás
Índio do Brasil Flowmentum, Inc. Tempo inteiroSenior DevOps & Platform Engineer(Azure Networking | .NET 4.6 | Terraform | PowerShell | Azure DevOps) Remote | Global Team | Flexible HoursWe're hiring a Senior DevOps & Platform Engineer to join our remote-first, results-driven engineering team. If you're an expert in Azure networking and have deep experience with .NET Framework 4.6, this is your...
-
Intermediate Data Platform Engineer
Há 2 dias
Brasil Elios Talent Tempo inteiroData Platform Engineer – Intermediate Key Highlights ️ Build and expand core data platform components powering analytics, experimentation, and algorithm development ⚡ Develop scalable ETL, streaming, and metadata systems using Spark, Kafka, and modern lakehouse technologies Support high-volume data transformation, federated querying, and performance...
-
Intermediate Data Platform Engineer
Há 3 dias
Brasil Elios Talent Tempo inteiroData Platform Engineer – Intermediate Key Highlights ️ Build and expand core data platform components powering analytics, experimentation, and algorithm development Develop scalable ETL, streaming, and metadata systems using Spark, Kafka, and modern lakehouse technologies Support high-volume data transformation, federated querying, and performance...
-
Senior Platform Engineer
4 semanas atrás
Índio do Brasil TurnKey Tech Staffing Tempo inteiroAbout the role Skyflow is a data privacy vault delivered via APIs. It helps companies isolate, protect, govern, and use sensitive data such as personal, health, or payment information securely, without losing usability. It’s built on a zero-trust architecture, meaning no one gets access to data unless explicitly allowed. Skyflow is looking for a Platform...
-
Microsoft Platform Engineer
Há 17 horas
Índio do Brasil Stefanini LATAM Tempo inteiro#VAGA para Microsoft Platform Engineer (Inglês Fluente) / Sharepoint System AdministratorEstamos em busca de um Microsoft Platform Engineer Sênior para atuar em um projeto internacional de grande porte, em uma empresa global do setor de soluções corporativas e serviços de tecnologia com foco em modernização digital e colaboração em nuvem.O...
