Senior Data Engineer

1 semana atrás

Brazil Sigma Software Group Tempo inteiro

Our growing data teams are seeking a savvy Senior Data Engineer to join them and help build and evolve the next generation of Audience & Identity data platforms that handle data at scale and use state-of-the-art technologies to unlock the data’s business value.


If you’re excited about working with cutting-edge technology in a fast-paced environment, we’d love to have you on board. Don’t hesitate — join our team today


Customer

Our client has superior end-to-end technology, a premium marketplace, and best-in-market advisory services that power the world’s advertising businesses of the largest media and entertainment companies. For example, Fox, NBC Universal, Viacom in the USA, Sky, Channel 4, RTE, and Mediaset in Europe.


Project

We are working on a solution to simplify segment ingestion, audience construction, and activation for targeted placements and campaigns. Our platform bridges the gap by combining buyers’ consumer insights with sellers’ media viewership and geographic data, addressing identity fragmentation and unifying audiences across devices.


Responsibilities

  • Design, implement, and maintain scalable data pipelines to ingest and transform large volumes of data from various sources
  • Optimize streaming and batch data processing and storage solutions for performance and scalability
  • Monitor system performance, troubleshoot issues, and implement solutions to ensure high availability and reliability
  • Collaborate with product managers and other stakeholders to understand data requirements and deliver data solutions that meet business needs
  • Communicate technical concepts and solutions effectively to non-technical stakeholders
  • Stay abreast of emerging technologies and best practices in data engineering. Identify opportunities to improve data processes, tools, and infrastructure to enhance efficiency and effectiveness
  • Document data pipelines, processes, and systems to ensure clarity and maintainability
  • Share knowledge and best practices with team members to foster a culture of learning and collaboration
  • Work with and mentor Junior Data Engineers


Requirements

  • 5+ years of hands-on experience in the Software Development field and/or Big Data
  • Strong experience in Scala or Java
  • Proficient in Databricks with a solid foundation in Spark
  • Experience with CI/CD tools (Jenkins)
  • Familiarity with shell, ability to work well with command lines, and a solid knowledge of data structures, algorithms, and system design
  • Work experience with ETL pipelines
  • Strong skills in SQL and experience with at least one of the major database platforms
  • At least an Upper-Intermediate level of English


Would be a plus

  • Experience with Python, and Golang
  • Experience in the media or advertising industry
  • Experience with graph databases (GraphX, Neo4J) and related analysis
  • Experience with Kubernetes, Terraform, and ELK
  • Experience with Snowflake
  • AWS certification and previous experience with AWS services such as S3, EMR, EKS, Glue, EC2, IAM, CloudFormation, Athena, Lambda, and others

  • Senior Data Engineer

    2 meses atrás

    Brazil Remobi Tempo inteiro

    Senior Data EngineerAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. Because it doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world.Our clients...

  • Senior Data Engineer

    1 semana atrás

    Brazil, BR Aptonet Inc Tempo inteiro

    As a Senior Data Engineer (Python/Spark) , you will play a crucial role in building and maintaining robust data ingestion pipelines, applications, and data processing systems. You will work on cutting-edge technologies and be responsible for designing, implementing, and optimizing solutions that support our Data Product Hub.Key Responsibilities:Develop and...

  • Senior Data Engineer

    2 semanas atrás

    Brazil Aptonet Inc Tempo inteiro

    As a Senior Data Engineer (Python/Spark) , you will play a crucial role in building and maintaining robust data ingestion pipelines, applications, and data processing systems. You will work on cutting-edge technologies and be responsible for designing, implementing, and optimizing solutions that support our Data Product Hub.Key Responsibilities:Develop and...

  • Senior Data Engineer

    1 semana atrás

    Brazil Aptonet Inc Tempo inteiro

    As a Senior Data Engineer (Python/Spark) , you will play a crucial role in building and maintaining robust data ingestion pipelines, applications, and data processing systems. You will work on cutting-edge technologies and be responsible for designing, implementing, and optimizing solutions that support our Data Product Hub. Key Responsibilities: Develop...

  • Data Engineer Pl/Sr

    Há 1 mês

    Brazil Neo BI Solution Tempo inteiro

    Estamos contratando: Data Engineer Pleno/Sênior para estruturação de Data Lake na plataforma AzureSobre a posição:Estamos expandindo nossa equipe e buscamos um profissional Data Engineer para apoiar um de nossos clientes na estruturação de um Data Lake na plataforma Azure.Responsabilidades:Desenvolver e manter pipelines de dados utilizando Azure Data...

  • Senior Data Engineer

    Há 1 mês

    Sao Paulo, Sao Paulo, Brazil Cognizant Tempo inteiro

    Who We Are Cognizant (Nasdaq-100: CTSH) engineers modern businesses. We help our clients modernize technology, reimagine processes and transform experiences so they can stay ahead in our fast-changing world. Together, we’re improving everyday life. See how at: www.cognizant.com. Senior Data Engineer sWhat you’ll do The Sr. Data Engineer role at our...

  • Senior Data Engineer

    3 semanas atrás

    Brazil inspired! Tempo inteiro

    ** PLEASE CONSIDER THE REQUIRED QUALIFICATIONS AND ENGLISH PROFICIENCY FOR THIS POSITION **We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and optimizing data pipelines and architectures. You will leverage your Azure, Databricks, Data Warehousing, SQL, and...

  • Senior Data Engineer

    1 semana atrás

    Brazil Sandbox Group Tempo inteiro

    About the role This is a 100% remote position As a Senior Data Engineer, is responsible for the development, construction, maintenance, and testing of architectures, such as databases and large-scale processing systems. Is responsible play a pivotal role in optimizing data systems and building them from the ground up, working closely with data analysts to...

  • Senior Data Engineer

    1 semana atrás

    Brazil, BR Sandbox Group Tempo inteiro

    About the roleThis is a 100% remote positionAs a Senior Data Engineer, is responsible for the development, construction, maintenance, and testing of architectures, such as databases and large-scale processing systems. Is responsible play a pivotal role in optimizing data systems and building them from the ground up, working closely with data analysts to help...

  • Senior Data Engineer

    4 semanas atrás

    Brazil Sandbox Group Tempo inteiro

    About the roleThis is a 100% remote positionAs a Senior Data Engineer, is responsible for the development, construction, maintenance, and testing of architectures, such as databases and large-scale processing systems. Is responsible play a pivotal role in optimizing data systems and building them from the ground up, working closely with data analysts to help...

  • Senior Data Engineer

    2 meses atrás

    Brazil Sigma Software Group Tempo inteiro

    Sigma Software is looking for an experienced Senior Data Engineer to join our growing engineering team. This opportunity is for you if you want to work with a tightly knit team of data engineers solving challenging problems using cutting-edge data collection, transformation, analysis, and monitoring tools in the cloud.Sounds like you?We are waiting for you...

  • Senior Data Engineer

    Há 3 dias

    Região Geográfica Intermediária de Juiz de Fora, Minas Gerais, Brazil Sigma Software Group Tempo inteiro

    Job Opportunity: Senior Data EngineerSigma Software Group is seeking an experienced Senior Data Engineer to join our engineering team. This opportunity is ideal for a data engineer who wants to work with a tightly knit team of data engineers solving challenging problems using cutting-edge data collection, transformation, analysis, and monitoring tools in the...

  • Senior Data Engineer

    Há 1 mês

    Brazil Andela Tempo inteiro

    Senior Data Engineer Andela Location Requirement: Brazil, Canada, Egypt. About Andela Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive long-term...

  • Data Engineer

    1 semana atrás

    Brazil Blueclip Tempo inteiro

    As Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works. About Our Search We are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by...

  • Data Engineer

    1 semana atrás

    Brazil, BR Blueclip Tempo inteiro

    As Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works.About Our SearchWe are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by machine...

  • Data Engineer

    3 semanas atrás

    Brazil Blueclip Tempo inteiro

    As Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works.About Our SearchWe are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by machine...

  • Data Engineer

    1 semana atrás

    Brazil Remobi Tempo inteiro

    Data Engineer - (REMOTE) Brazil About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the...

  • Data Engineer

    1 semana atrás

    Brazil, BR Remobi Tempo inteiro

    Data Engineer - (REMOTE) BrazilAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world.Our...

  • Data Engineer

    2 semanas atrás

    Brazil Remobi Tempo inteiro

    Data Engineer - (REMOTE) BrazilAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world.Our...

  • Data Engineer

    4 semanas atrás

    Brazil Birlasoft Tempo inteiro

    Data Engineer - CogniteQualificationsExperience with Cognite SolutionsExperience in data governance and modern platforms like Data Fabric and Data Mesh.Ability to work in complex environments with large data volumes, including cloud and hybrid implementations.Hands-on experience in Data Science and AI/ML projects, with proficiency in advanced Python and...