Senior Data Engineer

2 semanas atrás

Brasília, Distrito Federal, Brasil Sigma Software Group Tempo inteiro
Sigma Software Group: Senior Data Engineer

We are seeking a skilled Senior Data Engineer to design, implement, and maintain scalable data pipelines and systems that handle large volumes of data from various sources.

Our client is a leading provider of end-to-end technology, premium marketplace, and advisory services to the world's largest media and entertainment companies.

We are working on a solution to simplify segment ingestion, audience construction, and activation for targeted placements and campaigns.

Key Responsibilities:
  • Design and implement scalable data pipelines to ingest and transform large volumes of data from various sources.
  • Optimize streaming and batch data processing and storage solutions for performance and scalability.
  • Monitor system performance, troubleshoot issues, and implement solutions to ensure high availability and reliability.
  • Collaborate with product managers and other stakeholders to understand data requirements and deliver data solutions that meet business needs.
  • Communicate technical concepts and solutions effectively to non-technical stakeholders.
  • Stay up-to-date with emerging technologies and best practices in data engineering.
  • Document data pipelines, processes, and systems to ensure clarity and maintainability.
  • Share knowledge and best practices with team members to foster a culture of learning and collaboration.
  • Work with and mentor Junior Data Engineers.
Requirements:
  • 5+ years of hands-on experience in the Software Development field and/or Big Data.
  • Strong experience in Scala or Java.
  • Proficient in Databricks with a solid foundation in Spark.
  • Experience with CI/CD tools (Jenkins).
  • Familiarity with shell, ability to work well with command lines, and a solid knowledge of data structures, algorithms, and system design.
  • Work experience with ETL pipelines.
  • Strong skills in SQL and experience with at least one of the major database platforms.
  • At least an Upper-Intermediate level of English.
Preferred Qualifications:
  • Experience with Python, and Golang.
  • Experience in the media or advertising industry.
  • Experience with graph databases (GraphX, Neo4J) and related analysis.
  • Experience with Kubernetes, Terraform, and ELK.
  • Experience with Snowflake.
  • AWS certification and previous experience with AWS services such as S3, EMR, EKS, Glue, EC2, IAM, CloudFormation, Athena, Lambda, and others.

  • Senior Data Engineer

    4 semanas atrás

    Brasília, Distrito Federal, Brasil Sigma Software Group Tempo inteiro

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team and help build and evolve our data platforms. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines to ingest and transform large volumes of data from various sources.Key Responsibilities:Design and...

  • Senior Data Engineer

    Há 5 dias

    Brasília, Distrito Federal, Brasil HCLTech Tempo inteiro

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at HCLTech. As a Senior Data Engineer, you will play a key role in designing, implementing, and maintaining data pipelines using cloud-native tools in a modern data stack.Responsibilities:Design and implement end-to-end data pipelines using cloud-native...

  • Senior Data Engineer

    Há 4 dias

    Brasília, Distrito Federal, Brasil HCLTech Tempo inteiro

    Job Title: Senior Data EngineerWe are HCLTech, a leading technology and DSA company with a global presence. We are seeking a highly skilled Senior Data Engineer to join our team.Job Summary:The Senior Data Engineer will design, implement, and maintain data pipelines using cloud-native tools in a modern data stack. The successful candidate will have expertise...

  • Senior Data Engineer

    4 semanas atrás

    Brasília, Distrito Federal, Brasil Sigma Software Group Tempo inteiro

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team and contribute to the development of our data platforms. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines to ingest and transform large volumes of data from various sources.Key...

  • Senior Data Engineer

    2 semanas atrás

    Brasília, Distrito Federal, Brasil Sigma Software Tempo inteiro

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our dynamic team at Sigma Software. As a key player in our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement scalable data pipelines to ingest and...

  • Senior Data Engineer

    2 semanas atrás

    Brasília, Distrito Federal, Brasil Sigma Software Group Tempo inteiro

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team and contribute to the development of our next-generation data platforms. As a key member of our data team, you will be responsible for designing, implementing, and maintaining scalable data pipelines to ingest and transform large volumes of data from various sources.Key...

  • Senior Data Engineer

    4 semanas atrás

    Brasília, Distrito Federal, Brasil Luxoft Tempo inteiro

    Job DescriptionRole SummaryWe are seeking a highly skilled Senior Data Engineer to join our team at Luxoft. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.Key ResponsibilitiesDesign and implement...

  • Senior Data Architect

    2 semanas atrás

    Brasília, Distrito Federal, Brasil Sigma Software Group Tempo inteiro

    Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to join our growing data teams and contribute to the development of cutting-edge data platforms that handle large datasets and leverage state-of-the-art technologies to unlock business value.Key Responsibilities:Design and implement scalable data architectures to support business...

  • Senior Data Architect

    4 semanas atrás

    Brasília, Distrito Federal, Brasil Luxoft Tempo inteiro

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Luxoft. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.Key Responsibilities:Design and develop...

  • Senior Data Architect

    Há 6 dias

    Brasília, Distrito Federal, Brasil Luxoft Tempo inteiro

    Job Description**Senior Data Engineer**We are seeking a highly skilled Senior Data Engineer to join our team at Luxoft. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.Key Responsibilities:Design and develop data...

  • Senior Data Architect

    4 semanas atrás

    Brasília, Distrito Federal, Brasil Luxoft Tempo inteiro

    Job DescriptionJob Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Luxoft. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.Key Responsibilities:Design...

  • Senior Data Architect

    2 semanas atrás

    Brasília, Distrito Federal, Brasil Luxoft Tempo inteiro

    Job Description**Senior Data Engineer**We are seeking a highly skilled Senior Data Engineer to join our team at Luxoft. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.Key Responsibilities:Design and develop data...

  • Senior Data Architect

    2 semanas atrás

    Brasília, Distrito Federal, Brasil Luxoft Tempo inteiro

    Job Description**Senior Data Engineer**We are seeking a highly skilled Senior Data Engineer to join our team at Luxoft. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.Key Responsibilities:Design and develop data...

  • Senior Data Engineer Architect

    3 semanas atrás

    Brasília, Distrito Federal, Brasil Acendeo Tempo inteiro

    About the RoleWe are seeking a highly skilled Senior Data Engineer Architect to join our growing team at Acendeo. As a key member of our data engineering team, you will play a critical role in designing and implementing scalable data pipelines that drive business growth and innovation.Key ResponsibilitiesDesign and develop high-performance data pipelines...

  • Senior Data Architect

    2 semanas atrás

    Brasília, Distrito Federal, Brasil Luxoft Tempo inteiro

    Job Description**Senior Data Engineer**We are seeking a highly skilled Senior Data Engineer to join our team at Luxoft. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.Key Responsibilities:Design and develop data...

  • Senior Data Engineer

    Há 1 mês

    Brasília, Distrito Federal, Brasil WEX Inc. Tempo inteiro

    About the RoleWe're seeking a highly skilled Data Engineer to join our Data Platform team at WEX Inc. As a key member of our team, you'll play a critical role in designing, building, and maintaining our data infrastructure and workflows.Key ResponsibilitiesCollaborate with stakeholders to understand business requirements and implement SQL-first...

  • Senior Data Architect

    Há 1 mês

    Brasília, Distrito Federal, Brasil Thoughtworks Inc. Tempo inteiro

    Job Title: Senior Data EngineerAt Thoughtworks Inc., we are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a key role in building, maintaining, and testing the software architecture and infrastructure for managing data applications.Key Responsibilities:Develop and operate modern data architecture...

  • Senior Data Engineer

    3 semanas atrás

    Brasília, Distrito Federal, Brasil Qubika Tempo inteiro

    Unlock Your Potential with QubikaWe're on the hunt for a talented Sr DataOps/DevOps Engineer to help us shape the future of software solutions. As a key member of our team, you'll be responsible for designing, developing, and deploying high-quality software solutions that make a real impact.What We're Looking ForStrong experience with Microsoft Azure (at...

  • Senior Data Scientist, Blockchain Expert

    Há 1 mês

    Brasília, Distrito Federal, Brasil Sage Lake Senior Living Tempo inteiro

    Senior Data Scientist, Full StackWe are seeking a highly skilled Senior Data Scientist to join our team at TRM Labs. As a key member of our data science team, you will be responsible for developing advanced machine learning models and algorithms to detect and prevent cryptocurrency fraud and financial crime.Key Responsibilities:Design and implement custom...

  • Data Engineer

    Há 4 dias

    Brasília, Distrito Federal, Brasil ITTConnect Tempo inteiro

    Job Title: Data EngineerITTConnect is seeking a skilled Data Engineer to join our team. As a Data Engineer, you will play a key role in designing, building, and maintaining large-scale data processing systems using cutting-edge technologies.Key Responsibilities:Design and implement data pipelines using Python and SQLDevelop and maintain large-scale data...