Data Engineer

Há 21 horas

Brasil Luxoft Tempo inteiro

Project Description:

  • The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.
    • Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart.
      • Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to business.

Responsibilities:

  • We are looking for Data Engineer who will be responsible for designing a solution for a big retail company. The main focus is to support processing of big data volumes and integrate solution to current architecture.

Mandatory Skills Description:


• Strong, recent hands-on expertise with Azure Data Factory and Synapse is a must (3+ years).


• Experience in leading a distributed team.


• Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and retrieval.


• Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions.


• Extensive experience with building robust and scalable ETL/ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses.


• Ability to integrate data from disparate sources, including databases, APIs, and external data providers, using appropriate techniques such as API integration or message queuing.


• Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data/Delta Lakehouse, Data Vault)


• Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages.


• Experience integrating metadata and governance processes into cloud-based data platforms


• Certification in Azure, Databricks, or other relevant technologies is an added advantage


• Experience with cloud-based analytical databases.


• Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix.


• Experience with Python and Python-based ETL tools.


• Experience with shell scripting in Bash, Unix or windows shell is preferable.

Nice-to-Have Skills Description:


• Experience with Elasticsearch


• Familiarity with containerization and orchestration technologies (Docker, Kubernetes).


• Troubleshooting and Performance Tuning: Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis.


• Collaboration and Communication: Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams.

Languages:

English: B2 Upper Intermediate

  • Data Engineer

    Há 6 dias

    Brasil International institute of training islamabad Tempo inteiro

    Role DescriptionThis is a full-time remote role for a Data Engineer at International Institute of Training Islamabad. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics.QualificationsData Engineering, Data Modeling, and ETL skillsData Warehousing and Data Analytics...

  • Data Engineer

    Há 6 dias

    Brasil International Institute Of Training Islamabad Tempo inteiro

    Role DescriptionThis is a full-time remote role for a Data Engineer at International Institute of Training Islamabad. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics.QualificationsData Engineering, Data Modeling, and ETL skillsData Warehousing and Data Analytics...

  • Data Engineer

    Há 2 dias

    Brasil Elios Talent Tempo inteiro

    Data Engineer – Microsoft Azure (Contractor) Remote (Brazil, supporting EST/CST hours) | 4–5 Month Contract | Collaboration via TeamsOverviewWe are seeking a Data Engineer (short-term contractor) to design and implement data acquisition and ETL processes in Microsoft Azure to support enterprise reporting needs. You will be responsible for integrating...

  • Data Engineer

    Há 4 dias

    Brasil International institute of training islamabad Tempo inteiro

    Role Description This is a full-time remote role for a Data Engineer at International Institute of Training Islamabad. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics. Qualifications Data Engineering, Data Modeling, and ETL skills Data Warehousing and Data...

  • DATA ENGINEER

    Há 7 dias

    Brasil 4DF Connect Tempo inteiro

    OverviewDATA ENGINEER ( SnowFlake ) role at 4DF ConnectWe\'re hiring a Data Engineer with advanced skills in Snowflake, Databricks, and Azure (Terraform). Strong experience in data pipelines, ETL, and data migration is required. Advanced English is a must. You\'ll drive technical decisions and collaborate across teams.What you\'ll doAs a Data Engineer, you...

  • Data Engineer

    4 semanas atrás

    Brasil Launchpad Technologies Inc. Tempo inteiro

    Join to apply for the Data Engineer role at Launchpad Technologies Inc.Join to apply for the Data Engineer role at Launchpad Technologies Inc. Senior Data Engineer – Scalable Pipelines for AI Agent InfrastructureWe're looking for a Senior Data Engineer to design, build, and maintain the data foundation behind our next-generation AI agent platform. You'll...

  • Data Engineer

    Há 13 horas

    Brasil Insight Global Tempo inteiro

    100% Remote Data Engineer 1 year contract to start, high possibility of extensionsHiring this week - must be able to start a new opportunity in 2 weeksMust-Haves:3+ Years of Data Engineering experienceAdvanced proficiency in SQL, with extensive experience writing complex queries.Intermediate level experience within Linux & Python.Linux User level...

  • Senior Data Engineer

    Há 17 horas

    Brasil beBeeDataEngineering Tempo inteiro US$80.000 - US$120.000

    Senior Data Engineer - Azure RemoteThis role involves designing, developing, and maintaining large-scale data processing systems using Azure Data Factory.RequirementsBachelor's degree in Computer Science or related field.Minimum 5 years of experience with data engineering, including Azure Data Factory and Databricks.Excellent knowledge of SQL for data...

  • Data Engineer

    Há 2 dias

    Brasil Insight Global Tempo inteiro

    100% Remote Data Engineer 1 year contract to start, high possibility of extensions Hiring this week - must be able to start a new opportunity in 2 weeks Must-Haves: 3+ Years of Data Engineering experience Advanced proficiency in SQL, with extensive experience writing complex queries. Intermediate level experience within Linux & Python. Linux User...

  • Data Engineer

    2 semanas atrás

    Brasil Insight Global Tempo inteiro

    Insight Global – Brazil RemoteJob Title: Data Engineer (azure)Type: Long term Contract Position (6 months extending, multi year long contract)Compensation: 18,000-21,000 BRL Per MonthLocation: RemoteInterview Process: Immediate Interviews Available – 1 roundStart Date: ASAP (9/8)Priority scheduling for candidates who:Submit resume promptlyAre available...