Data Engineer

Há 5 dias

Brazil Salt Tempo inteiro

Data Engineer – Consumer Goods – LATAM

Day rate: £150 - £300

Duration: 1 – 3 months

Start: ASAP


My new client in the consumer goods sector are embarking on an exciting project, focusing on analysing marketing data. This project integrates data from various sources, like Adverity, campaign briefs, and marketing reports. We aim to build a robust data infrastructure that will enable weekly analysis of campaign performance, audience segmentation, and ROI calculation. The pilot is designed to be scalable, with plans to extend it to other brands and integrate more data.


They are looking for a Data Engineer to design, implement, and maintain the data infrastructure for this innovative marketing analytics project. The ideal candidate will have strong skills in data integration, warehousing, and processing, with the ability to work on a standalone system that will be the foundation for future expansion.


Primary Responsibilities

  1. Data Source Integration
  • Set up and maintain connectors for various data sources, with a primary focus on Adverity integration
  • Develop and optimize data extraction and ingestion pipelines
  • Implement data transformation and cleaning processes for marketing data
  1. Data Warehousing
  • Design and implement a scalable data warehouse schema suitable for marketing analytics
  • Set up efficient ETL/ELT processes for weekly data loading
  • Develop data partitioning and indexing strategies for optimal query performance
  1. Data Quality and Governance
  • Implement comprehensive data quality checks and validation rules
  • Establish data lineage tracking systems
  • Develop and enforce data governance policies in line with UK regulations
  1. Analytics Support
  • Collaborate with data analysts to understand and support their data needs
  • Optimize data models for campaign performance analysis, audience segmentation, and ROI calculations
  • Develop and maintain data pipelines for generating weekly insights
  1. System Architecture
  • Design and implement a modular, scalable architecture that can expand to other brands and countries
  • Ensure the system can handle increasing data volumes and complexity over time


Qualifications

  • Strong programming skills in Python
  • Extensive experience with SQL and data warehousing concepts
  • Proficiency in designing and implementing ETL/ELT processes


Preferred Skills

  • Experience with cloud platforms (AWS, GCP, or Azure)
  • Knowledge of data governance and compliance requirements
  • Basic understanding of DevOps practices and tools
  • English speaking


Technologies

While we're open to various technology solutions, experience with some of the following is beneficial:

  • Data Integration: Apache Airflow, Talend, or similar ETL tools
  • Data Warehousing: Snowflake, Amazon Redshift, or similar
  • Data Quality: Great Expectations, Deequ, or similar
  • Data Processing: Apache Spark, dbt, or similar
  • Version Control: Git

We encourage candidates to bring their expertise and suggest optimal solutions for our needs.

Nice-to-Have DevOps Skills

While not required, familiarity with the following DevOps practices would be beneficial:

  • Infrastructure as Code (e.g., Terraform, CloudFormation)
  • Containerization (e.g., Docker)
  • CI/CD pipelines
  • Monitoring and logging systems

  • Data Engineer

    1 semana atrás

    Brazil Premier Group Recruitment Tempo inteiro

    Data EngineerContract$32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...

  • Data Engineer

    1 semana atrás

    Brazil Premier Group Recruitment Tempo inteiro

    Data Engineer Contract $32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...

  • Data Engineer

    1 semana atrás

    Brazil, BR Premier Group Recruitment Tempo inteiro

    Data EngineerContract$32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...

  • Data Engineer

    Há 1 mês

    Brazil, BR Blueclip Tempo inteiro

    As Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works.About Our SearchWe are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by machine...

  • Data Engineer

    Há 1 mês

    Brazil Blueclip Tempo inteiro

    As Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works. About Our Search We are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by...

  • Data Engineer

    2 meses atrás

    Brazil Blueclip Tempo inteiro

    As Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works.About Our SearchWe are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by machine...

  • Data Engineer

    Há 1 mês

    Brazil, BR Remobi Tempo inteiro

    Data Engineer - (REMOTE) BrazilAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world.Our...

  • Data Engineer

    Há 1 mês

    Brazil Remobi Tempo inteiro

    Data Engineer - (REMOTE) Brazil About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the...

  • Data Engineer

    Há 1 mês

    Brazil Remobi Tempo inteiro

    Data Engineer - (REMOTE) BrazilAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world.Our...

  • Data Engineer

    4 semanas atrás

    São Paulo, Brazil, BR Pride Global Tempo inteiro

    As a Data Engineer, you will be a key member of our data team, focusing on designing, developing, and maintaining data solutions for our data warehouse, data lake, and Dataverse environments. with specific focus on sourcing data and developing data solutions. In this role you will be primarily responsible for the development of data workflows, views, and...

  • Senior Data Engineer

    4 semanas atrás

    Brazil, BR Luxoft Tempo inteiro

    ResponsibilitiesDesign, build, and maintain scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.Work with Azure and GCP platforms, specifically managing services like Azure Databricks, Azure SQL Server, BigQuery, DataProc, and Azure Machine Learning.Develop and maintain CI/CD pipelines using GitHub Actions to...

  • Senior Data Engineer

    4 semanas atrás

    Brazil Luxoft Tempo inteiro

    ResponsibilitiesDesign, build, and maintain scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.Work with Azure and GCP platforms, specifically managing services like Azure Databricks, Azure SQL Server, BigQuery, DataProc, and Azure Machine Learning.Develop and maintain CI/CD pipelines using GitHub Actions to...

  • Data Engineer

    5 meses atrás

    São Paulo, Brazil, BR CriticalRiver Inc. Tempo inteiro

    Title: Data EngineerLocation: Sao Paulo BrazilRemote: Need to Support in USA PST time zoneDuration: Fulltime Interview process:Live Hacker rank test on Advanced SQL questions.Technical screeningClient live Hacker rank interview. Summary:Need a minimum of 6 years experience in SQL, with hands-on experience in writing complex queries and optimizing database...

  • Data Engineer

    Há 1 mês

    Brazil PrimeIT Tempo inteiro

    A PrimeIT é uma empresa de referência, com mais de 17 anos de experiência na prestação de serviços tecnológicos de IT, Telecomunicações e Engenharia.Especializados em Team Extension, Managed Services, Custom Software e Nearshore, contamos actualmente com uma equipa de mais de 2350 profissionais que colaboram em projectos nacionais e internacionais...

  • Senior Data Engineer

    Há 3 dias

    Brazil HCLTech Tempo inteiro

    www.hcltech.comWe are HCLTech, one of the world’s largest and fastest growing technology and DSA companies with over 227,000 professionals across 60 countries, driving progress through industry-leading capabilities focused on Digital, Engineering and Cloud.The driving force behind this work, our people, is a diverse, creative and passionate audience that...

  • Azure Data Engineer LATAM

    4 semanas atrás

    Brazil Mark & Bridges Technology Inc. Tempo inteiro

    Data Engineer LATAMEstamos em busca de engenheiro de dados experiente para atuar em projetos estratégicos utilizando Azure Data Factory, Databricks, Synapse Analytics e PySpark. A posição é voltada para profissionais localizados na América Latina/Nearshore.Responsabilidades:Atuação direta no time do cliente nos EUA, contribuindo para a otimização de...

  • Azure Data Engineer LATAM

    4 semanas atrás

    Brazil, BR Mark & Bridges Technology Inc. Tempo inteiro

    Data Engineer LATAMEstamos em busca de engenheiro de dados experiente para atuar em projetos estratégicos utilizando Azure Data Factory, Databricks, Synapse Analytics e PySpark. A posição é voltada para profissionais localizados na América Latina/Nearshore.Responsabilidades:Atuação direta no time do cliente nos EUA, contribuindo para a otimização de...

  • Data Engineer

    Há 6 dias

    Brazil, BR Salt Tempo inteiro

    Data Engineer – Consumer Goods – LATAM Day rate: £150 - £300Duration: 1 – 3 monthsStart: ASAPMy new client in the consumer goods sector are embarking on an exciting project, focusing on analysing marketing data. This project integrates data from various sources, like Adverity, campaign briefs, and marketing reports. We aim to build a robust data...

  • Data Engineer

    Há 5 dias

    Brazil Salt Tempo inteiro

    Data Engineer – Consumer Goods – LATAM Day rate: £150 - £300Duration: 1 – 3 monthsStart: ASAPMy new client in the consumer goods sector are embarking on an exciting project, focusing on analysing marketing data. This project integrates data from various sources, like Adverity, campaign briefs, and marketing reports. We aim to build a robust data...

  • Data Engineer Sr

    4 semanas atrás

    Brazil Mirante Tecnologia Tempo inteiro

    A Mirante Tecnologia é uma empresa sólida e confiável que atua desde 1998 em diversos segmentos do mercado, transformando ideais e necessidades em produtos e serviços de alto valor agregado, por meio da concepção de soluções versáteis e inteligentes. O foco da Mirante está na agilidade para atender o cliente e o mercado na velocidade das suas...