Data Engineer

Há 4 dias

Belo Horizonte, Brasil Luxoft Tempo inteiro

Project Description:

  • The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.


  • Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart.


  • Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to business.


Responsibilities:

  • We are looking for Data Engineer who will be responsible for designing a solution for a big retail company. The main focus is to support processing of big data volumes and integrate solution to current architecture.


Mandatory Skills Description:

- Strong, recent hands-on expertise with Azure Data Factory and Synapse is a must (3+ years).

- Experience in leading a distributed team.

- Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and retrieval.

- Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions.

- Extensive experience with building robust and scalable ETL/ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses.

- Ability to integrate data from disparate sources, including databases, APIs, and external data providers, using appropriate techniques such as API integration or message queuing.

- Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data/Delta Lakehouse, Data Vault)

- Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages.

- Experience integrating metadata and governance processes into cloud-based data platforms

- Certification in Azure, Databricks, or other relevant technologies is an added advantage

- Experience with cloud-based analytical databases.

- Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix.

- Experience with Python and Python-based ETL tools.

- Experience with shell scripting in Bash, Unix or windows shell is preferable.


Nice-to-Have Skills Description:

- Experience with Elasticsearch

- Familiarity with containerization and orchestration technologies (Docker, Kubernetes).

- Troubleshooting and Performance Tuning:
Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis.

- Collaboration and Communication:
Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams.


Languages:

English:
B2 Upper Intermediate

  • Data Engineer

    Há 5 horas

    Belo Horizonte, Brasil Caderno Nacional Tempo inteiro

    Data Engineer - Detalhes da Vaga. ? Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart. ?Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption...

  • Senior Data Engineer

    Há 5 horas

    Belo Horizonte, Brasil Caderno Nacional Tempo inteiro

    Senior Data Engineer - Detalhes da Vaga. ? This is a full-time, 100% remote opportunity exclusive to candidates located in Brazil. ? You''ll be working with a fast-paced US-based company, leading innovations in sustainable commerce and data-driven operations. ??? What You'll DoDesign, develop, and maintain robust, scalable data infrastructure across...

  • Data Engineer

    1 semana atrás

    Belo Horizonte, Brasil buscojobs Brasil Tempo inteiro

    This position is fully remote and is a PJ contract. Pay range is 25-29 / hr USD. Required Skills & Experience 5+ years of experience as a Data Engineer with minimum 3 years of experience in Azure tool stack (Databricks, ADF, Synapse Analytics) Good to have experience with other Azure services Azure Functions, Event Grid, etc Strong expertise in writing...

  • Senior Data Engineer

    Há 3 horas

    Belo Horizonte, Brasil Pride Global Tempo inteiro

    We're Hiring: Senior Data Engineer (MLOps) | Remote from Brazil | Fluent English required| USD-Hourly payLocation : Remote – Brazil only? Language : Fluent English requiredAre you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing e-commerce and circular...

  • Data Engineer

    Há 5 horas

    Belo Horizonte, Brasil Caderno Nacional Tempo inteiro

    Data Engineer - Detalhes da Vaga. ? S. ?-based company that provides technical expertise, testing, and certification services to the global food and agricultural industry. ? Their mission is to ensure food safety, quality, and sustainability across international supply chains. ?This role is critical to building, maintaining, and modernizing data pipelines...

  • Data Engineer

    1 semana atrás

    Belo Horizonte, Brasil Luxoft Tempo inteiro

    Project Description:The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration,...

  • Data/Ai Engineer

    Há 4 dias

    Belo Horizonte, Brasil Able.Digital Tempo inteiro

    We are seeking a fractional Data/AI Specialist to support our sales team on a per-hour/contract basis.This role will primarily serve as a Sales Engineer, providing technical expertise during sales calls and helping prospects understand the value of our data-driven solutions.Key Responsibilities Join sales calls as the technical expert, answering customer...

  • Data Engineer

    2 semanas atrás

    Belo Horizonte, Minas Gerais, Brasil Luxoft Tempo inteiro

    Project Description:The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration,...

  • Senior Platform Data Engineer

    1 semana atrás

    Belo Horizonte, Brasil Grid Dynamics Tempo inteiro

    Join to apply for the Senior Platform Data Engineer role at Grid Dynamics6 months ago Be among the first 25 applicantsJoin to apply for the Senior Platform Data Engineer role at Grid DynamicsGet AI-powered advice on this job and more exclusive features.We are seeking a Senior Platform Data Engineer to join our team of experts.This role focuses on developing...

  • Data Engineer

    Há 5 horas

    Belo Horizonte, Brasil Caderno Nacional Tempo inteiro

    Data Engineer - Detalhes da Vaga. ? Somos uma empresa tech-first e estamos em fase de rápida expansão, com grandes desafios de dados e automação pela frente. ?Estamos em busca de uma pessoa Sênior Data Engineer para fazer parte do nosso time de dados. ? Você será responsável por projetar, construir e manter pipelines robustas e escaláveis de coleta...