Senior Data Engineer

3 semanas atrás


Brazil, BR Luxoft Tempo inteiro

Project Description:

The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.


Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart.


Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to business.


Responsibilities:

We are looking for Data Engineer who will be responsible for designing a solution for a big retail company. The main focus is to support processing of big data volumes and integrate solution to current architecture.


Mandatory Skills Description:

  • Strong, recent hands-on expertise with Azure Data Factory and Synapse is a must (3+ years).
  • Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and retrieval.
  • Hands-on experience with Power BI, including data modeling, report and dashboard development, and building interactive, business-ready visualizations based on enterprise data sources.
  • Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions.
  • Extensive experience with building robust and scalable ETL/ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses.
  • Ability to integrate data from disparate sources, including databases, APIs, and external data providers, using appropriate techniques such as API integration or message queuing.
  • Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data/Delta Lakehouse, Data Vault)
  • Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages.
  • Experience integrating metadata and governance processes into cloud-based data platforms
  • Certification in Azure, Databricks, or other relevant technologies is an added advantage
  • Experience with cloud-based analytical databases.
  • Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix.
  • Experience with Python and Python-based ETL tools.
  • Experience with shell scripting in Bash, Unix or windows shell is preferable.


Languages:

  • English: B2 Upper Intermediate


**ONLY CLT CONTRACTS *


  • Senior Data Engineer

    Há 24 horas


    Brazil, BR Pride Global Tempo inteiro

    We're Hiring: Senior Data Engineer | Remote from Brazil | Fluent English required | Location: Remote – Brazil onlyContact: TemporaryAre you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing e-commerce and circular fashion?We're looking for a Senior Data...

  • Senior Data Engineer

    Há 24 horas


    Brazil, BR CriticalRiver Inc. Tempo inteiro

    Job Title: Senior Data Engineer (Snowflake & Observability Implementation)Location: LATAM [Remote] Duration: 6 MonthsNeed to work on PST hoursMandatory Skills : SnowflakeDBT, Splunk, OpsGenie, Snowflake + Streamlit, Splunk Dashboards and Version Control & IaCRole OverviewWe are seeking a proactive and hands-on Senior Data Engineer to drive the execution...

  • Sr Data Engineer

    Há 24 horas


    Brazil, BR Unlimitail Tempo inteiro

    Sobre nós:A Unlimitail é uma joint venture entre o Grupo Carrefour e o Grupo Publicis, que tem como objetivo atender ao crescente mercado de retail media na Europa e América Latina, desenvolvendo soluções eficazes para as principais necessidades do mercado: vender mais, personalização, oportunidades para as marcas, medição e transparência e...

  • Data Engineer

    3 semanas atrás


    Brazil, BR emagine - Portugal Tempo inteiro

    Profile: Data / ETL Engineer (AWS)We are looking for a Data / ETL Engineers with strong experience building and operating data pipelines in AWS.Core skills & experience:• Solid understanding of relational databases, with strong SQL skills (experience with Microsoft SQL Server preferred)• Strong Python development skills, particularly for data processing...

  • Senior Data Engineer

    2 semanas atrás


    Brazil, BR Jusfy Tempo inteiro

    A Jusfy está em busca de um Sr Data Engineer para compor o time! Somos uma startup jurídica que busca constantemente soluções para facilitar a vida dos advogados e advogadas brasileiros. Atuamos na área de tecnologia, desenvolvendo produtos e ferramentas que auxiliam na produtividade diária dos nossos clientes.Somos uma empresa jovem e muito...

  • Data Engineer

    Há 24 horas


    Brazil, BR Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...

  • Data Engineer

    2 semanas atrás


    Brazil, BR Exactius Tempo inteiro

    About ExactiusExactius works with companies to solve complex digital marketing challenges and achieve ambitious growth goals. We bring executive leadership and cross-functional execution teams that can not only form the strategy but can execute and deliver the result. These teams always include a proven performance marketing CMO, along with campaign and CRM...

  • Data Engineer

    Há 24 horas


    Brazil, BR Brick Abode Tempo inteiro

    We’re Hiring: Data EngineerWe’re looking for a Data Engineer with solid Machine Learning and Optimization experience. This is a full-time remote position on a PJ contract, offering the opportunity to work on challenging and impactful projects.Skills:PythonMachine Learning EngineeringEnglishScikit-learn, XGBoost & LightGBMTime series forecastingDeep...

  • Data Engineer

    2 semanas atrás


    Brazil, BR Avenue Code Tempo inteiro

    Avenue Code is the leading software consultancy focused on delivering end-to-end development solutions for digital transformation across every vertical. We’re privately held, profitable, and have been on a solid growth trajectory since day one. We care deeply about our clients, our partners, and our people. We prefer the word ‘partner’ over...

  • Data Engineer

    3 semanas atrás


    Brazil, BR Vista Applied Solutions Group Inc Tempo inteiro

    Job Summary:We are seeking a Data Engineer to enhance the resilience and operational stability of our data pipelines, from factory floor to cloud repositories. This critical role will focus on building robust monitoring and support systems, and on accelerating our ability to understand and resolve system and pipeline breakdownsResponsibilities:Design,...