Data Engineer

4 semanas atrás

Brazil Luxoft Tempo inteiro

Project Description:

- The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.

- Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart.

- Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to business.

Responsibilities:

- We are looking for Data Engineer who will be responsible for designing a solution for a big retail company. The main focus is to support processing of big data volumes and integrate solution to current architecture.

Mandatory Skills Description:

• Strong, recent hands-on expertise with Azure Data Factory and Synapse is a must (3+ years).

• Experience in leading a distributed team.

• Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and retrieval.

• Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions.

• Extensive experience with building robust and scalable ETL/ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses.

• Ability to integrate data from disparate sources, including databases, APIs, and external data providers, using appropriate techniques such as API integration or message queuing.

• Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data/Delta Lakehouse, Data Vault)

• Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages.

• Experience integrating metadata and governance processes into cloud-based data platforms

• Certification in Azure, Databricks, or other relevant technologies is an added advantage

• Experience with cloud-based analytical databases.

• Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix.

• Experience with Python and Python-based ETL tools.

• Experience with shell scripting in Bash, Unix or windows shell is preferable.

Nice-to-Have Skills Description:

• Experience with Elasticsearch

• Familiarity with containerization and orchestration technologies (Docker, Kubernetes).

• Troubleshooting and Performance Tuning: Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis.

• Collaboration and Communication: Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams.

Languages:

English: B2 Upper Intermediate

  • Data Engineer

    Há 2 dias

    Brazil Tecla Tempo inteiro

    *Native/Bilingual English is required for this role (read/written/spoken)Please upload your CV Resume in English.Monthly salary: $4,000 - $5,000 USDOur partner is entering its next phase of growth, expanding their platform and building intelligent systems that transform how banks and credit unions understand and serve their small business customers....

  • Senior Data Engineer

    4 semanas atrás

    Brazil Pride Global Tempo inteiro

    We're Hiring: Senior Data Engineer (MLOps) | Remote from Brazil | Fluent English required | USD-Hourly pay Location: Remote – Brazil only Language: Fluent English required Are you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing e-commerce and circular...

  • Senior Data Engineer

    Há 4 dias

    Brazil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    WE ARE HIRING DATA ENGINEER°Offer 100% remotly ONLY BrazilDirect contract with clientThe Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions on AWS, utilizing Snowflake, dbt, and modern automation tools. This role drives best practices for data quality, validation, and governance, while optimizing...

  • Senior Data Engineer

    Há 2 dias

    Brazil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    WE ARE HIRING DATA ENGINEER° Offer 100% remotly ONLY Brazil Direct contract with client The Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions on AWS, utilizing Snowflake, dbt, and modern automation tools. This role drives best practices for data quality, validation, and governance, while...

  • Data Engineer

    4 semanas atrás

    Brazil Elios Talent Tempo inteiro

    Data Engineer – Microsoft Azure (Contractor) Remote (Brazil, supporting EST/CST hours) | 4–5 Month Contract | Collaboration via Teams Overview We are seeking a Data Engineer (short-term contractor) to design and implement data acquisition and ETL processes in Microsoft Azure to support enterprise reporting needs. You will be responsible for...

  • Cloud Data Engineer

    Há 4 dias

    Brazil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    💼 Employment type: Direct Hire – Full-time, with all benefits required by Brazil law💰 Salary range: Competitive and negotiable based on experience🌐 Language: Bilingual (Advanced English – excellent verbal and written communication skills required)The Senior Cloud Data Engineer leads the design, architecture, and implementation of secure,...

  • Cloud Data Engineer

    Há 2 dias

    Brazil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    Employment type: Direct Hire – Full-time, with all benefits required by Brazil law Salary range: Competitive and negotiable based on experience Language: Bilingual (Advanced English – excellent verbal and written communication skills required) The Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data...

  • Senior Data Engineer

    Há 4 dias

    Brazil Flatiron Software Tempo inteiro

    AboutFlatiron is a global remote software development company with engineers located around the world. We unite experts from diverse backgrounds and experiences in a collaborative culture to deliver exceptional products and services for our clients. As a forward-thinking software engineering company, we provide industry-leading solutions to complex problems...

  • Lead Data Engineer

    Há 2 dias

    Brazil Acendeo Tempo inteiro

    Lead Data Engineer Description We are looking for a highly experienced Lead Data Engineer to lead and guide the technical evolution of our enterprise data lake. This role will combine hands-on development, tactical guidance, team leadership, and partner engagement across our technical team. English fluency is a MUST for this role! Only candidates with level...

  • Data Engineer

    4 semanas atrás

    Brazil Insight Global Tempo inteiro

    Required Skills & Experience 4+ years of data engineering experience - building data warehouses and ETL pipelines 3+ years of experience with Snowflake Datawarehouse Strong Python scripting experience Well versed with data marts Strong understanding of SQL including: SSIS, SSAS, & SSRS Ability to work MST hours Nice to Have Skills &...