Senior Data Engineer

2 meses atrás


brasil Sigma Software Group Tempo inteiro

Our growing data teams are seeking a savvy Senior Data Engineer to join them and help build and evolve the next generation of Audience & Identity data platforms that handle data at scale and use state-of-the-art technologies to unlock the data’s business value.


If you’re excited about working with cutting-edge technology in a fast-paced environment, we’d love to have you on board. Don’t hesitate — join our team today


Customer

Our client has superior end-to-end technology, a premium marketplace, and best-in-market advisory services that power the world’s advertising businesses of the largest media and entertainment companies. For example, Fox, NBC Universal, Viacom in the USA, Sky, Channel 4, RTE, and Mediaset in Europe.


Project

We are working on a solution to simplify segment ingestion, audience construction, and activation for targeted placements and campaigns. Our platform bridges the gap by combining buyers’ consumer insights with sellers’ media viewership and geographic data, addressing identity fragmentation and unifying audiences across devices.


Responsibilities

  • Design, implement, and maintain scalable data pipelines to ingest and transform large volumes of data from various sources
  • Optimize streaming and batch data processing and storage solutions for performance and scalability
  • Monitor system performance, troubleshoot issues, and implement solutions to ensure high availability and reliability
  • Collaborate with product managers and other stakeholders to understand data requirements and deliver data solutions that meet business needs
  • Communicate technical concepts and solutions effectively to non-technical stakeholders
  • Stay abreast of emerging technologies and best practices in data engineering. Identify opportunities to improve data processes, tools, and infrastructure to enhance efficiency and effectiveness
  • Document data pipelines, processes, and systems to ensure clarity and maintainability
  • Share knowledge and best practices with team members to foster a culture of learning and collaboration
  • Work with and mentor Junior Data Engineers


Requirements

  • 5+ years of hands-on experience in the Software Development field and/or Big Data
  • Strong experience in Scala or Java
  • Proficient in Databricks with a solid foundation in Spark
  • Experience with CI/CD tools (Jenkins)
  • Familiarity with shell, ability to work well with command lines, and a solid knowledge of data structures, algorithms, and system design
  • Work experience with ETL pipelines
  • Strong skills in SQL and experience with at least one of the major database platforms
  • At least an Upper-Intermediate level of English


Would be a plus

  • Experience with Python, and Golang
  • Experience in the media or advertising industry
  • Experience with graph databases (GraphX, Neo4J) and related analysis
  • Experience with Kubernetes, Terraform, and ELK
  • Experience with Snowflake
  • AWS certification and previous experience with AWS services such as S3, EMR, EKS, Glue, EC2, IAM, CloudFormation, Athena, Lambda, and others

  • Senior Data Engineer

    4 semanas atrás


    Brasil Luxoft Tempo inteiro

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Luxoft. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.Key Responsibilities:Design and implement...

  • Senior Data Engineer

    2 semanas atrás


    Brasil HCLTech Tempo inteiro

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at HCLTech. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines using cloud-native tools in a modern data stack.Responsibilities:• Design and implement end-to-end data pipelines using...


  • Brasil Data Privacy Tempo inteiro

    About the RoleWe're seeking a highly skilled Senior/Staff Software Engineer to join our Data Platform team. As a key member of our team, you will be responsible for designing, developing, and deploying scalable and reliable data infrastructure for our products and services.Key ResponsibilitiesDesign and develop highly available and scalable data services to...


  • Brasil Data Privacy Tempo inteiro

    About TRM LabsTRM Labs is a mission-driven company that aims to build a safer financial system for billions of people. We deliver a blockchain intelligence data platform to financial institutions, crypto companies, and governments to fight cryptocurrency fraud and financial crime.Job DescriptionWe are seeking a highly skilled Software Engineer to join our...

  • Data Engineer Specialist

    2 semanas atrás


    Brasil MG Info | Data Driven Culture Tempo inteiro

    Job Title: Data Engineer SpecialistWe are seeking a highly qualified Senior Data Engineer to join our team at MG Info | Data Driven Culture. This professional will be involved in the development and management of critical components of a data platform.The ideal candidate will have strong proficiency in Python, Apache Airflow, REST APIs, KEDA, Azure DevOps,...


  • Brasil SGF Global Tempo inteiro

    Company Overview:SGF Global is a leading provider of data-driven solutions. We are seeking an experienced Senior Azure Data Factory Engineer to join our team.Estimated Salary: $120,000 - $180,000 per yearJob Description:As a Senior Azure Data Factory Engineer at SGF Global, you will be responsible for designing and implementing scalable data pipelines using...

  • Senior Data Engineer

    4 semanas atrás


    Brasil AgileEngine, LLC Tempo inteiro

    {"h1": "Data Analysis and Engineering Expert","p": "We are seeking a highly skilled Data Analysis and Engineering Expert to join our team at AgileEngine, LLC. As a Senior Data Engineer, you will be responsible for assessing census/eligibility, medical, and Rx claims data, mapping incoming data dictionaries to our data dictionary, merging information into the...

  • Senior Data Engineer

    2 semanas atrás


    Brasil Acendeo Tempo inteiro

    About AcendeoWe are a growing team driven by innovation and experimentation. As a team member, you'll work closely with your cross-functional partners across Product Management, Data Engineering, and Platform Engineering to build next-generation products.English Skills RequiredC1 or C2 level of English is a must for this role.About the RoleAs a Senior Data...

  • Senior Data Engineer

    2 semanas atrás


    Brasil Sigma Software Tempo inteiro

    Job Title: Senior Data Engineer - Scala ExpertJob Summary:We are seeking a highly skilled Senior Data Engineer to join our dynamic team at Sigma Software. As a key player in our data engineering team, you will be responsible for designing, implementing, and maintaining robust data pipelines and infrastructure.Key Responsibilities:Design and implement...

  • Data Engineer

    4 semanas atrás


    Brasil Planahead Tempo inteiro

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Planahead. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using cutting-edge tools and technologies.Collaborate with cross-functional teams to ensure...


  • brasil DeepRec.ai Tempo inteiro

    Senior Data Engineer – ML Services and Data Pipelines Location: Remote Employment Type: Contract Experience: 5+ years 3 month contract + multiple extensions possible Our client is based in the USA but employs a remote workforce. You should be available for team meetings at 8am PT and have some cross over for team collaboration in PST/ET timezone. Happy...


  • brasil DeepRec.ai Tempo inteiro

    Senior Data Engineer – ML Services and Data PipelinesLocation: RemoteEmployment Type: ContractExperience: 5+ years3 month contract + multiple extensions possibleOur client is based in the USA but employs a remote workforce. You should be available for team meetings at 8am PT and have some cross over for team collaboration in PST/ET timezone. Happy to hire...


  • Brasil DeepRec.ai Tempo inteiro

    Senior Data Engineer – ML Services and Data Pipelines Location: Remote Employment Type: Contract Experience: 5+ years 3 month contract + multiple extensions possible Our client is based in the USA but employs a remote workforce. You should be available for team meetings at 8am PT and have some cross over for team collaboration in PST/ET timezone....

  • Data Engineer

    Há 1 mês


    brasil Premier Group Recruitment Tempo inteiro

    Data EngineerContract$32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...

  • Data Engineer

    Há 1 mês


    brasil Premier Group Recruitment Tempo inteiro

    Data Engineer Contract $32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...

  • Data Engineer

    Há 1 mês


    Brasil Premier Group Recruitment Tempo inteiro

    Data Engineer Contract $32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...


  • Brasil Teachable, Inc. Tempo inteiro

    About TeachableTeachable is a leading platform for creator-educators to share their knowledge and reach millions of students worldwide. As a dynamic and cross-cultural team, we're committed to delivering market-leading products that prioritize creator control and flexibility.About the RoleWe're seeking a highly skilled Senior Data Engineer to join our Data...


  • Brasil Lean Tech Tempo inteiro

    Job OverviewLean Tech is a dynamic organization that offers a unique opportunity for professionals to grow their careers and contribute to cutting-edge developments in multiple industries.We are seeking a skilled Senior Data Engineer to join our team. The ideal candidate will have a strong background in designing and implementing data pipelines, working with...

  • Senior Data Engineer

    2 semanas atrás


    Brasil Rocket Lawyer Tempo inteiro

    About Rocket LawyerWe are a leading online legal service platform that believes everyone deserves access to affordable and simple legal services. With a global presence and a team of passionate professionals, we are expanding our platform to capture audiences worldwide.About the RoleWe are seeking an experienced Data Engineer to join our data engineering...

  • Senior Software Engineer

    4 semanas atrás


    Brasil Ignitho Technologies Inc. Tempo inteiro

    Job Title: Senior Software EngineerAt Ignitho Technologies Inc., we are seeking a highly skilled Senior Software Engineer to join our team.Key Responsibilities:Design and implement scalable .NET applications hosted on Azure cloud services, with a focus on Azure Kubernetes Services.Develop and optimize SQL databases, ensuring efficient data retrieval and...