Lead Data Engineer

Há 1 mês


Brasil Sigma Software Group Tempo inteiro

We are seeking an experienced and visionary Lead Data Engineer to join our Stellar team

As the Lead Data Engineer, you will be a key player in designing and implementing the robust data infrastructure to power our data-heavy company. You will collaborate with cross-functional teams to build core data pipelines, store data in optimal engines and formats, and feed our machine-learning models.

This is an individual contributor role with the potential to lead. You will work closely with our VP of Technology to define and implement a strategic vision for data engineering within the organization.

Your expertise in Spark and Scala will be critical for success.

Customer

Our client is a CTV advertising platform purpose-built for performance marketers.

They leverage massive data and cutting-edge science to automate and optimize TV advertising to drive business outcomes.

Project

The solution combines media buying, optimization, measurement, and attribution in one, efficient platform.

The platform is built by industry leaders with a long history in programmatic advertising, digital media, and ad verification who have now purpose-built a CTV performance platform advertisers can trust to grow their business.

Responsibilities

  • Design and implement robust data infrastructure using Spark with Scala
  • Collaborate with our cross-functional teams to design data solutions that meet business needs
  • Build out our core data pipelines, store data in optimal engines and formats, and feed our machine-learning models
  • Leverage and optimize AWS resources
  • Collaborate closely with the Data Science team

Requirements

  • Minimum of 7 years of experience in data engineering
  • Proven experience building data infrastructure using Spark with Scala
  • Familiarity with data lakes, cloud warehouses, and storage formats
  • Strong proficiency in AWS services
  • Expertise in SQL for data manipulation and extraction
  • Excellent written and verbal communication skills
  • Bachelor’s degree in Computer Science or a related field

Nice to have:

  • Experience in AdTech
  • Familiarity with Elastic Map Reduce (EMR)
  • Previous experience leading and/or building out a Data Engineering function
  • Proven experience working closely with Data Science teams on machine learning pipelines

  • Lead Data Engineer

    Há 1 mês


    Brasil Remobi Tempo inteiro

    Lead Data Engineer About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. Because it doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world. Our...

  • Data Tech Lead

    2 meses atrás


    Brasil Birlasoft Tempo inteiro

    Data Tech Lead Main Responsibilities: Lead data engineers and scientists in designing, developing, and implementing data-driven solutions. Work with stakeholders to identify and understand data-related business needs Design and implement ETL pipelines into data warehouses or data lakes. Maintain data models and schemas for analytics and reporting. ...

  • Data Engineer

    2 semanas atrás


    Brasil Blueclip Tempo inteiro

    As Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works. About Our Search We are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by...

  • Data Engineer

    Há 6 dias


    Brasil Remobi Tempo inteiro

    Data Engineer - (REMOTE) Brazil About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world....

  • Data Engineer

    3 semanas atrás


    Brasil Birlasoft Tempo inteiro

    Data Engineer - Cognite Qualifications Experience with Cognite Solutions Experience in data governance and modern platforms like Data Fabric and Data Mesh. Ability to work in complex environments with large data volumes, including cloud and hybrid implementations. Hands-on experience in Data Science and AI/ML projects, with proficiency in advanced...

  • Data Engineer Pl/Sr

    4 semanas atrás


    Brasil Neo BI Solution Tempo inteiro

    Estamos contratando: Data Engineer Pleno/Sênior para estruturação de Data Lake na plataforma Azure Sobre a posição: Estamos expandindo nossa equipe e buscamos um profissional Data Engineer para apoiar um de nossos clientes na estruturação de um Data Lake na plataforma Azure. Responsabilidades: Desenvolver e manter pipelines de dados utilizando...


  • Brasil Remobi Tempo inteiro

    Senior Data Engineer About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. Because it doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world. ...

  • Data Engineer LATAM

    4 semanas atrás


    Brasil Mark & Bridges Technology Inc. Tempo inteiro

    Data Engineer LATAM Estamos em busca de engenheiro de dados experiente para atuar em projetos estratégicos utilizando Azure Data Factory, Databricks, Synapse Analytics e PySpark. A posição é voltada para profissionais localizados na América Latina/Nearshore, com contratação em regime PJ. Responsabilidades: Atuação direta no time do cliente nos...

  • Data Platform Engineer

    3 semanas atrás


    Brasil Schub Tempo inteiro

    Disclaimer: Please note that this job post appears to be in Brazil , but it is a remote position. We welcome applicants from any location in America. If you are an experienced Data Engineer looking to grow personally and professionally, apply now!   Who are we?  We are devoted to building and delivering secure, compliant, cloud-native data...


  • Brasil Everest AI Tempo inteiro €800

    About us Startup - Experienced Data Engineer Supply chain and logistics is going through a technological evolution and customer expectations around delivery have become more demanding. We are an AI startup solving the most complex problems in the $800bn trucking industry in the US. Our platform empowers trucking companies to operate efficiently and...

  • Data Engineer

    2 semanas atrás


    Brasil Zazmic Inc Tempo inteiro

    Job Title: Senior Data Engineer (Apache Spark, GCP) Join our dynamic data team, where you’ll have the opportunity to shape the future of our data infrastructure and drive innovation across the organization. We’re looking for a highly skilled Data Engineer who thrives in a fast-paced environment and is passionate about leveraging cutting-edge...


  • Brasil HCLTech Tempo inteiro

    Sobre a vaga Data Engineer Analyst - BI, HCLTech São Paulo, São Paulo (Hybrid) / Tempo integral We are looking for a highly talented and self-motivated Data Engineer Analyst to join us on our journey to advance the technology world through innovation and creativity. Key Skills SQL & Data Warehousing / Business Intelligence skills ETL/ data...

  • Data Science Engineer

    3 meses atrás


    Brasil Andela Tempo inteiro

    Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive long-term career opportunities with leading organizations, access to a global community of...

  • Data Engineer Mid-Level

    4 semanas atrás


    Brasil Birlasoft Tempo inteiro

    Data Developer Engineer - Mid-Level Qualifications Experience in data governance and modern platforms like Data Fabric and Data Mesh. Ability to work with large data volumes, including cloud and hybrid implementations. Hands-on experience in Data Science and AI/ML projects, with proficiency in advanced Python and PySpark. Knowledge of databases such as...

  • Data Engineer Sr

    3 semanas atrás


    Brasil Infosys Tempo inteiro

    Infosys Brasil está em busca de profissionais com o perfil de Data Engineer Sr Descrição da vaga: Este profissional terá um papel chave no envolvimento com a equipe de negócios e funcional no fornecimento de soluções técnicas mais adequadas, em conformidade com os padrões de desenvolvimento do cliente e da Infosys. Também apoiará a...

  • Data Engineer

    3 semanas atrás


    Brasil Wipro Tempo inteiro

    We are one of the largest and leading global technology services, consulting and corporate processes companies in the world. We are present in more than 69 countries and our team is composed of more than 220,000 employees working on six continents. We are technological partners of the largest companies in the world. We proudly serve more than 1500 customers...


  • Brasil Aptonet Inc Tempo inteiro

    As a Senior Data Engineer (Python/Spark) , you will play a crucial role in building and maintaining robust data ingestion pipelines, applications, and data processing systems. You will work on cutting-edge technologies and be responsible for designing, implementing, and optimizing solutions that support our Data Product Hub. Key Responsibilities: Develop...

  • Senior Data Engineer

    2 semanas atrás


    Brasil inspired! Tempo inteiro

    ** PLEASE CONSIDER THE REQUIRED QUALIFICATIONS AND ENGLISH PROFICIENCY FOR THIS POSITION ** We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and optimizing data pipelines and architectures. You will leverage your Azure, Databricks, Data Warehousing, SQL, and...

  • Data Engineer

    Há 1 mês


    Brasil Sigma Software Group Tempo inteiro

    Sigma Software is looking for an experienced Data Engineer to join our growing engineering team. This opportunity is for you if you want to work with a tightly knit team of data engineers solving challenging problems using cutting-edge data collection, transformation, analysis, and monitoring tools in the cloud. Sounds exciting? Then keep reading! CUSTOMER...


  • Brasil Sigma Software Group Tempo inteiro

    Sigma Software is looking for an experienced Senior Data Engineer to join our growing engineering team. This opportunity is for you if you want to work with a tightly knit team of data engineers solving challenging problems using cutting-edge data collection, transformation, analysis, and monitoring tools in the cloud. Sounds like you? We are waiting for...