Data Platform Engineer

2 semanas atrás

Índio do Brasil Avenue Code Tempo inteiro

About the Role and Reponsabilities:

In this role you will have the chance to build large additions to our platform ecosystem, contributing to an infrastructure that centralizes our ETL and streaming infrastructure, enables experimentation and data development, and powers algorithm development. You will design and build scalable engineering solutions to solve business and data problems.

Core tech stack used by this role:

-S3 using Parquet and Iceberg for data storage

-Hive and Iceberg REST catalog as our metadata store

-Spark (Python, SQL, Scala) for data transformation

-Go, Scala and Java for backend development

-Kafka for data streaming

-Kubernetes and Helm for service deployments

-AWS IAM for access control

-Datadog for logging alerting and monitoring

-Trino as our federated query engine

-Identify, develop, and evangelize tooling, approaches, and data products that raise the bar of validity in experiment design and analyses across the company

-Collaborate with multiple teams and functions to deliver deep-dive analyses and experiment design for new initiatives and high-priority business areas

-Develop and iterate on our processes to empower more efficient and rigorous experimentation

Requirements

-You have a degree in an engineering or computer science field

-You have solid experience in platform engineering, with experience on experimentation platforms

-You have experience coding at a production level in Python, Go, Scala or Java

-You’ve built and supported RBAC systems used by enterprise-wide teams

-You have experience supporting Iceberg-based data warehouses

Avenue Code reinforces its commitment to privacy and to all the principles guaranteed by the most accurate global data protection laws, such as GDPR, LGPD, CCPA and CPRA. The Candidate data shared with Avenue Code will be kept confidential and will not be transmitted to disinterested third parties, nor will it be used for purposes other than the application for open positions. As a Consultancy company, Avenue Code may share your information with its clients and other Companies from the CompassUol Group to which Avenue Code’s consultants are allocated to perform its services.

  • Data Platform Engineer

    2 semanas atrás

    Índio do Brasil Avenue Code Tempo inteiro

    About the Role and Reponsabilities:In this role you will have the chance to build large additions to our platform ecosystem, contributing to an infrastructure that centralizes our ETL and streaming infrastructure, enables experimentation and data development, and powers algorithm development. You will design and build scalable engineering solutions to solve...

  • Data Platform Engineer

    Há 4 dias

    Índio do Brasil Avenue Code Tempo inteiro

    About the Role and Reponsabilities:In this role you will have the chance to build large additions to our platform ecosystem, contributing to an infrastructure that centralizes our ETL and streaming infrastructure, enables experimentation and data development, and powers algorithm development. You will design and build scalable engineering solutions to solve...

  • Senior Platform Engineer

    Há 7 dias

    Índio do Brasil TurnKey Tech Staffing Tempo inteiro

    About the role Skyflow is a data privacy vault delivered via APIs. It helps companies isolate, protect, govern, and use sensitive data such as personal, health, or payment information securely, without losing usability. It’s built on a zero-trust architecture, meaning no one gets access to data unless explicitly allowed. Skyflow is looking for a Platform...

  • Senior Data Engineer

    1 semana atrás

    Índio do Brasil Prosigliere Tempo inteiro

    Looking for an experienced Senior Data Engineer to join the Prosigliere team.DescriptionWe are seeking a highly skilled and motivated Data Engineer to join our growing team. The ideal candidate will be instrumental in designing, building, and maintaining robust and scalable data pipelines and infrastructure. This role requires a deep understanding of data...

  • Data Engineer Trainee/Junior

    2 semanas atrás

    Índio do Brasil Birlasoft Tempo inteiro

    We're Hiring: Data Engineer Trainee/Junior (Remote)Are you passionate about data and excited to kickstart your career in a tech-driven environment?Join our Data & Analytics team as a Data Engineer Trainee/Junior and grow your skills while contributing to impactful data solutions. What You’ll DoSupport the development of data pipelines and analytics...

  • Senior Data Engineer

    1 semana atrás

    Índio do Brasil Prosigliere Tempo inteiro

    Looking for an experienced Senior Data Engineer to join the Prosigliere team. Description We are seeking a highly skilled and motivated Data Engineer to join our growing team. The ideal candidate will be instrumental in designing, building, and maintaining robust and scalable data pipelines and infrastructure. This role requires a deep understanding of...

  • Senior Data Engineer

    2 semanas atrás

    Índio do Brasil Sky Systems, Inc. (SkySys) Tempo inteiro

    About the RoleWe’re partnering with a leading global commerce technology organization to expand their Data Engineering & Analytics team. This is an exciting opportunity for senior-level Data Engineers who are passionate about building modern data solutions, optimizing data pipelines, and driving impactful data-driven decisions within a global enterprise...

  • Azure Platform Engineer/ Architect

    2 semanas atrás

    Índio do Brasil Tata Consultancy Services Tempo inteiro

    Role Overview:We are is seeking a hands-on Azure Platform Engineer/Architect with strong architectural knowledge of Azure PaaS services and DevOps skills. This person will work closely with backend engineers and automation teams to design, implement, and deploy cloud-native solutions on Azure. The role requires expertise in Azure services, Infrastructure as...

  • Data Engineer Trainee/Junior

    2 semanas atrás

    Índio do Brasil Birlasoft Tempo inteiro

    We're Hiring: Data Engineer Trainee/Junior (Remote) Are you passionate about data and excited to kickstart your career in a tech-driven environment? Join our Data & Analytics team as a Data Engineer Trainee/Junior and grow your skills while contributing to impactful data solutions. What You’ll Do - Support the development of data pipelines and...

  • Data Engineer Trainee/Junior

    Há 4 dias

    Índio do Brasil Birlasoft Tempo inteiro

    🚀 We're Hiring: Data Engineer Trainee/Junior (Remote)Are you passionate about data and excited to kickstart your career in a tech-driven environment?Join our Data & Analytics team as a Data Engineer Trainee/Junior and grow your skills while contributing to impactful data solutions.🔍 What You'll DoSupport the development of data pipelines and analytics...