Data Engineer

3 semanas atrás

Brazil Luxoft Tempo inteiro

Project Description:

  • The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.


  • Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart.


  • Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to business.


Responsibilities:

  • We are looking for Data Engineer who will be responsible for designing a solution for a big retail company. The main focus is to support processing of big data volumes and integrate solution to current architecture.


Mandatory Skills Description:

• Strong, recent hands-on expertise with Azure Data Factory and Synapse is a must (3+ years).

• Experience in leading a distributed team.

• Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and retrieval.

• Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions.

• Extensive experience with building robust and scalable ETL/ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses.

• Ability to integrate data from disparate sources, including databases, APIs, and external data providers, using appropriate techniques such as API integration or message queuing.

• Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data/Delta Lakehouse, Data Vault)

• Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages.

• Experience integrating metadata and governance processes into cloud-based data platforms

• Certification in Azure, Databricks, or other relevant technologies is an added advantage

• Experience with cloud-based analytical databases.

• Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix.

• Experience with Python and Python-based ETL tools.

• Experience with shell scripting in Bash, Unix or windows shell is preferable.


Nice-to-Have Skills Description:

• Experience with Elasticsearch

• Familiarity with containerization and orchestration technologies (Docker, Kubernetes).

• Troubleshooting and Performance Tuning: Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis.

• Collaboration and Communication: Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams.


Languages:

English: B2 Upper Intermediate

  • Senior Data Engineer

    3 semanas atrás

    Brazil Pride Global Tempo inteiro

    We're Hiring: Senior Data Engineer (MLOps) | Remote from Brazil | Fluent English required | USD-Hourly pay Location: Remote – Brazil only Language: Fluent English required Are you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing e-commerce and circular...

  • Data Engineer

    3 semanas atrás

    Brazil Elios Talent Tempo inteiro

    Data Engineer – Microsoft Azure (Contractor) Remote (Brazil, supporting EST/CST hours) | 4–5 Month Contract | Collaboration via Teams Overview We are seeking a Data Engineer (short-term contractor) to design and implement data acquisition and ETL processes in Microsoft Azure to support enterprise reporting needs. You will be responsible for...

  • Data Engineer

    3 semanas atrás

    Federative Republic Of Brazil Elios Talent Tempo inteiro

    Data Engineer – Microsoft Azure (Contractor) Remote (Brazil, supporting EST/CST hours) | 4–5 Month Contract | Collaboration via Teams Overview We are seeking a Data Engineer (short-term contractor) to design and implement data acquisition and ETL processes in Microsoft Azure to support enterprise reporting needs. You will be responsible for...

  • Data Engineer

    3 semanas atrás

    Brazil Luxoft Tempo inteiro

    Project Description: - The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week. - Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration,...

  • Senior Data Engineer

    3 semanas atrás

    Brazil Pride Global Tempo inteiro

    🚀 We're Hiring: Senior Data Engineer (MLOps) | Remote from Brazil | Fluent English required | USD-Hourly pay📍Location: Remote – Brazil only 🗣️Language: Fluent English requiredAre you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing e-commerce and...

  • Senior Data Engineer

    3 semanas atrás

    Brazil, BR Pride Global Tempo inteiro

    We're Hiring: Senior Data Engineer (MLOps) | Remote from Brazil | Fluent English required | USD-Hourly payLocation: Remote – Brazil only ️Language: Fluent English requiredAre you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing e-commerce and circular...

  • Senior Data Engineer

    3 semanas atrás

    Brazil Pride Global Tempo inteiro

    We're Hiring: Senior Data Engineer (MLOps) | Remote from Brazil | Fluent English required | USD-Hourly pay Location : Remote – Brazil only ️Language : Fluent English required Are you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing e-commerce and...

  • Data Engineer

    3 semanas atrás

    Brazil Elios Talent Tempo inteiro

    Data Engineer – Microsoft Azure (Contractor) Remote (Brazil, supporting EST/CST hours) | ⏳ 4–5 Month Contract | Collaboration via Teams Overview We are seeking a Data Engineer (short-term contractor) to design and implement data acquisition and ETL processes in Microsoft Azure to support enterprise reporting needs. You will be responsible for...

  • Data Engineer

    3 semanas atrás

    Brazil Elios Talent Tempo inteiro

    💻 Data Engineer – Microsoft Azure (Contractor)📍 Remote (Brazil, supporting EST/CST hours) | ⏳ 4–5 Month Contract | 🌐 Collaboration via TeamsOverviewWe are seeking a Data Engineer (short-term contractor) to design and implement data acquisition and ETL processes in Microsoft Azure to support enterprise reporting needs. You will be responsible...

  • Data Engineer

    3 semanas atrás

    Brazil, BR Elios Talent Tempo inteiro

    Data Engineer – Microsoft Azure (Contractor) Remote (Brazil, supporting EST/CST hours) | ⏳ 4–5 Month Contract | Collaboration via TeamsOverviewWe are seeking a Data Engineer (short-term contractor) to design and implement data acquisition and ETL processes in Microsoft Azure to support enterprise reporting needs. You will be responsible for...