Senior Data Engineer

2 meses atrás

Brazil Sigma Software Group Tempo inteiro

Our growing data teams are seeking a savvy Senior Data Engineer to join them and help build and evolve the next generation of Audience & Identity data platforms that handle data at scale and use state-of-the-art technologies to unlock the data’s business value.


If you’re excited about working with cutting-edge technology in a fast-paced environment, we’d love to have you on board. Don’t hesitate — join our team today


Customer

Our client has superior end-to-end technology, a premium marketplace, and best-in-market advisory services that power the world’s advertising businesses of the largest media and entertainment companies. For example, Fox, NBC Universal, Viacom in the USA, Sky, Channel 4, RTE, and Mediaset in Europe.


Project

We are working on a solution to simplify segment ingestion, audience construction, and activation for targeted placements and campaigns. Our platform bridges the gap by combining buyers’ consumer insights with sellers’ media viewership and geographic data, addressing identity fragmentation and unifying audiences across devices.


Responsibilities

  • Design, implement, and maintain scalable data pipelines to ingest and transform large volumes of data from various sources
  • Optimize streaming and batch data processing and storage solutions for performance and scalability
  • Monitor system performance, troubleshoot issues, and implement solutions to ensure high availability and reliability
  • Collaborate with product managers and other stakeholders to understand data requirements and deliver data solutions that meet business needs
  • Communicate technical concepts and solutions effectively to non-technical stakeholders
  • Stay abreast of emerging technologies and best practices in data engineering. Identify opportunities to improve data processes, tools, and infrastructure to enhance efficiency and effectiveness
  • Document data pipelines, processes, and systems to ensure clarity and maintainability
  • Share knowledge and best practices with team members to foster a culture of learning and collaboration
  • Work with and mentor Junior Data Engineers


Requirements

  • 5+ years of hands-on experience in the Software Development field and/or Big Data
  • Strong experience in Scala or Java
  • Proficient in Databricks with a solid foundation in Spark
  • Experience with CI/CD tools (Jenkins)
  • Familiarity with shell, ability to work well with command lines, and a solid knowledge of data structures, algorithms, and system design
  • Work experience with ETL pipelines
  • Strong skills in SQL and experience with at least one of the major database platforms
  • At least an Upper-Intermediate level of English


Would be a plus

  • Experience with Python, and Golang
  • Experience in the media or advertising industry
  • Experience with graph databases (GraphX, Neo4J) and related analysis
  • Experience with Kubernetes, Terraform, and ELK
  • Experience with Snowflake
  • AWS certification and previous experience with AWS services such as S3, EMR, EKS, Glue, EC2, IAM, CloudFormation, Athena, Lambda, and others

  • Data Engineer

    4 semanas atrás

    Brazil Premier Group Recruitment Tempo inteiro

    Data EngineerContract$32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...

  • Data Engineer

    4 semanas atrás

    Brazil Premier Group Recruitment Tempo inteiro

    Data Engineer Contract $32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...

  • Data Engineer

    4 semanas atrás

    Brazil, BR Premier Group Recruitment Tempo inteiro

    Data EngineerContract$32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...

  • Senior Data Engineer

    2 meses atrás

    Brazil Luxoft Tempo inteiro

    ResponsibilitiesDesign, build, and maintain scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.Work with Azure and GCP platforms, specifically managing services like Azure Databricks, Azure SQL Server, BigQuery, DataProc, and Azure Machine Learning.Develop and maintain CI/CD pipelines using GitHub Actions to...

  • Senior Data Engineer

    2 meses atrás

    Brazil, BR Luxoft Tempo inteiro

    ResponsibilitiesDesign, build, and maintain scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.Work with Azure and GCP platforms, specifically managing services like Azure Databricks, Azure SQL Server, BigQuery, DataProc, and Azure Machine Learning.Develop and maintain CI/CD pipelines using GitHub Actions to...

  • Data Engineer

    2 meses atrás

    Brazil, BR Blueclip Tempo inteiro

    As Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works.About Our SearchWe are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by machine...

  • Data Engineer

    2 meses atrás

    Brazil Blueclip Tempo inteiro

    As Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works.About Our SearchWe are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by machine...

  • Data Engineer

    2 meses atrás

    Brazil Blueclip Tempo inteiro

    As Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works. About Our Search We are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by...

  • Senior Data Engineer

    3 semanas atrás

    Brazil HCLTech Tempo inteiro

    www.hcltech.comWe are HCLTech, one of the world’s largest and fastest growing technology and DSA companies with over 227,000 professionals across 60 countries, driving progress through industry-leading capabilities focused on Digital, Engineering and Cloud.The driving force behind this work, our people, is a diverse, creative and passionate audience that...

  • Data Engineer

    2 meses atrás

    Brazil Remobi Tempo inteiro

    Data Engineer - (REMOTE) Brazil About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the...

  • Data Engineer

    2 meses atrás

    Brazil, BR Remobi Tempo inteiro

    Data Engineer - (REMOTE) BrazilAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world.Our...

  • Data Engineer

    2 meses atrás

    Brazil Remobi Tempo inteiro

    Data Engineer - (REMOTE) BrazilAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world.Our...

  • Senior Python Engineer

    2 semanas atrás

    Brazil YASH Technologies Tempo inteiro

    Hello We are actively looking for a Senior Python Engineer. If you or your consultant are actively looking for a new job please share your profile. Role: Senior Python Engineer Duration: 2+ Months Location: Brazil ( REMOTE ) Mandatory Skills : Experience with Airflow on Kubernetes or KEDA We are seeking a highly skilled Senior Python Engineer to...

  • Senior Python Engineer

    2 semanas atrás

    Brazil YASH Technologies Tempo inteiro

    Hello We are actively looking for a Senior Python Engineer. If you or your consultant are actively looking for a new job please share your profile.Role: Senior Python EngineerDuration: 2+ Months Location: Brazil ( REMOTE ) Mandatory Skills : Experience with Airflow on Kubernetes or KEDAWe are seeking a highly skilled Senior Python Engineer to join our...

  • Senior Python Engineer

    2 semanas atrás

    Brazil, BR YASH Technologies Tempo inteiro

    Hello We are actively looking for a Senior Python Engineer. If you or your consultant are actively looking for a new job please share your profile.Role: Senior Python EngineerDuration: 2+ Months Location: Brazil ( REMOTE ) Mandatory Skills : Experience with Airflow on Kubernetes or KEDAWe are seeking a highly skilled Senior Python Engineer to join our...

  • Senior Data Engineer

    2 meses atrás

    Brazil, BR Sigma Software Group Tempo inteiro

    Our growing data teams are seeking a savvy Senior Data Engineer to join them and help build and evolve the next generation of Audience & Identity data platforms that handle data at scale and use state-of-the-art technologies to unlock the data’s business value.If you’re excited about working with cutting-edge technology in a fast-paced environment,...

  • Senior Data Engineer

    2 meses atrás

    Brazil Sigma Software Group Tempo inteiro

    Our growing data teams are seeking a savvy Senior Data Engineer to join them and help build and evolve the next generation of Audience & Identity data platforms that handle data at scale and use state-of-the-art technologies to unlock the data’s business value.If you’re excited about working with cutting-edge technology in a fast-paced environment,...

  • Senior Android Engineer

    2 meses atrás

    Brazil, BR BetterEngineer Tempo inteiro

    Better Engineers. Better Results. BetterEngineers connects accomplished Software Engineers across the Americas with our portfolio of high-growth and newsworthy technology companies in the United States. Senior Engineers in the BetterEngineers network work remotely with some of the most interesting tech companies in the world. Join us today and experience a...

  • Senior Android Engineer

    2 meses atrás

    Brazil BetterEngineer Tempo inteiro

    Better Engineers. Better Results. BetterEngineers connects accomplished Software Engineers across the Americas with our portfolio of high-growth and newsworthy technology companies in the United States. Senior Engineers in the BetterEngineers network work remotely with some of the most interesting tech companies in the world. Join us today and experience a...

  • Senior Data Engineer

    2 semanas atrás

    Brazil, BR Acendeo Tempo inteiro

    About the CompanyYou will join a growing team driven by innovation, experimentation, and a deep understanding of our customers. As a team member, you'll work closely with your cross-functional partners across Product Management, Data Engineering, and Platform Engineering as we build next-generation products.English Skills a MUST C1 or C2 onlyAbout the...