Data Engineer

Há 2 dias

Salvador, Brasil Luxoft Tempo inteiro

Project Description:- The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.- Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart.- Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to business.Responsibilities:- We are looking for Data Engineer who will be responsible for designing a solution for a big retail company.The main focus is to support processing of big data volumes and integrate solution to current architecture.Mandatory Skills Description:• Strong, recent hands-on expertise with Azure Data Factory and Synapse is a must (3+ years).• Experience in leading a distributed team.• Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and retrieval.• Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions.• Extensive experience with building robust and scalable ETL/ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses.• Ability to integrate data from disparate sources, including databases, APIs, and external data providers, using appropriate techniques such as API integration or message queuing.• Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data/Delta Lakehouse, Data Vault)• Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages.• Experience integrating metadata and governance processes into cloud-based data platforms• Certification in Azure, Databricks, or other relevant technologies is an added advantage• Experience with cloud-based analytical databases.• Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix.• Experience with Python and Python-based ETL tools.• Experience with shell scripting in Bash, Unix or windows shell is preferable.Nice-to-Have Skills Description:• Experience with Elasticsearch• Familiarity with containerization and orchestration technologies (Docker, Kubernetes).• Troubleshooting and Performance Tuning: Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis.• Collaboration and Communication: Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams.Languages:English: B2 Upper Intermediate

  • Data Engineer

    2 semanas atrás

    Salvador, Brasil buscojobs Brasil Tempo inteiro

    Overview This is a full-time remote role for a Data Engineer at International Institute of Training Islamabad. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics. Qualifications Data Engineering, Data Modeling, and ETL skills Data Warehousing and Data Analytics skills...

  • Data Engineer

    3 semanas atrás

    Salvador, Brasil buscojobs Brasil Tempo inteiro

    Overview This position is fully remote and is a PJ contract. Pay range is 25-29 / hr USD. Required Skills & Experience 5+ years of experience as a Data Engineer with minimum 3 years of experience in Azure tool Stack (Databricks, ADF, Synapse Analytics) Good to have experience with other Azure services (Azure Functions, Event Grid, etc.) Strong...

  • Senior Data Engineer

    3 semanas atrás

    Salvador, Bahia, Brasil Pride Global Tempo inteiro

    We're Hiring: Senior Data Engineer (MLOps) | Remote from Brazil | Fluent English required | USD-Hourly payLocation: Remote – Brazil only Language: Fluent English requiredAre you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing e-commerce and circular...

  • Data Engineer

    Há 2 dias

    Salvador, Brasil Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...

  • Data Engineer

    4 semanas atrás

    Salvador, Bahia, Brasil Insight Global Tempo inteiro

    Required Skills & Experience4+ years of data engineering experience - building data warehouses and ETL pipelines3+ years of experience with Snowflake DatawarehouseStrong Python scripting experienceWell versed with data martsStrong understanding of SQL including: SSIS, SSAS, & SSRSAbility to work MST hoursNice to Have Skills & ExperienceExperience working...

  • Data Engineer

    3 semanas atrás

    Salvador, Brasil Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to...

  • Unlock Cloud Potential As A Data Engineer

    1 semana atrás

    Salvador, Brasil Bebeecloudengineer Tempo inteiro

    Azure Data Engineer JobWe are seeking a skilled Azure Data Engineer to design, build, test and maintain cloud applications and related services.This role requires strong understanding of core concepts - Azure data storage, Azure compute, data connections, APIs, data bricks, data factory, data lake and azure synapse on cloud.Main Responsibilities:Design,...

  • Data Engineer

    2 semanas atrás

    Salvador, Brasil BairesDev Tempo inteiro

    Join to apply for the Data Engineer (Junior) - Remote Work role at BairesDev At BairesDev, we\'ve been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world\'s Top 1% of tech talent, works remotely...

  • Senior Data Platform Engineer

    3 semanas atrás

    Salvador, Bahia, Brasil EPAM Systems Tempo inteiro

    We are seeking a talented Senior Data DevOps Engineer to join our remote team, working on a groundbreaking project in the healthcare industry that leverages advanced data analytics and machine learning to improve patient outcomes. In this role, you will play a critical role in designing, building, and maintaining the infrastructure and tools necessary to...

  • Data Engineer

    3 semanas atrás

    Salvador, Brasil AgileEngine Tempo inteiro

    Join to apply for the Data Engineer (Senior) ID40199 role at AgileEngine . AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and startups across 17+ industries, with a people-first culture and multiple Best Place to Work awards. Overview We are looking for a Senior Data Engineer to take ownership of our data...