Big Data Engineer

1 semana atrás

Brasil beBeeDataEngineer Tempo inteiro R$80.000 - R$120.000

Job Description:

We are seeking a skilled professional to design and implement a data solution for a large retail company.

  • The successful candidate will be responsible for supporting the processing of big data volumes and integrating the solution into our current architecture.


Required Skills and Qualifications:

We require a strong recent hands-on expertise with Azure Data Factory and Synapse (3+ years).

  • Experience in leading a distributed team.
  • Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and retrieval.
  • Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks.
  • Extensive experience with building robust and scalable ETL/ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses.
  • Ability to integrate data from disparate sources, including databases, APIs, and external data providers.
  • Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data/Delta Lakehouse, Data Vault).
  • Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages.
  • Experience integrating metadata and governance processes into cloud-based data platforms.
  • Certification in Azure, Databricks, or other relevant technologies is an added advantage.
  • Experience with cloud-based analytical databases.
  • Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix.
  • Experience with Python and Python-based ETL tools.
  • Experience with shell scripting in Bash, Unix or Windows shell is preferable.
Seniority Level and Employment Type:

Mid-Senior level, Full-time

Industries:

IT Services and IT Consulting

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

],

  • Big Data Engineer

    Há 7 dias

    Brasil HUNT IT - Recrutamento Especializado para TI Tempo inteiro

    Descrição: Big Data EngineerOur Client is a US technology company looking for a highly motivated Data Engineer with a passion for data, to build and implement data pipelines in cloud technologies, including SnapLogic and AWS.Responsibilities:● Develops and maintains scalable data pipelines in SnapLogic and builds out new ETL and API integrations to...

  • Chief Big Data Architect

    1 dia atrás

    Brasil beBeeData Tempo inteiro R$90.000 - R$135.000

    Big Data Engineer PositionWe are seeking a skilled professional to join our team as a Big Data Engineer. As a key member of our organization, you will be responsible for designing solutions that support the processing and integration of large data volumes into our current architecture.Responsibilities:Data Modeling and Design: Design and implement efficient...

  • Data Engineer

    Há 4 dias

    Brasil Luxoft Tempo inteiro

    Project Description:The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration,...

  • Data Engineer

    Há 2 dias

    Brasil Luxoft Tempo inteiro

    Project Description: The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week. Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart. ...

  • Data Scientist Pleno

    Há 2 dias

    Brasil Big Data Tempo inteiro

    Quer trabalhar numa empresa pioneira em big data analytics no Brasil? Nosso(a) Cientista de Dados Pleno será responsável pela projeção, desenvolvimento e implementação de modelos de recomendações; elaboração de informações para tomada de decisão, identificação de fonte de dados valiosas, construção de algoritmos de aprendizagem de máquina,...

  • Data Engineer

    Há 3 dias

    Brasil Luxoft Tempo inteiro

    Project Description: The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week. Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart....

  • Senior Data Engineer

    Há 6 dias

    Brasil LuxeVision Consulting LLC Tempo inteiro US$90.000 - US$120.000 por ano

    About Us:The RoleKey Responsibilities:Design, develop, and maintain scalable data architectures and pipelines. Develop and manage ETL processes to extract, transform, and load data into data warehouses. Collaborate with data scientists, analysts, and business stakeholders to define data needs and requirements. Ensure the quality and integrity of data,...

  • Advanced Data Engineer

    Há 7 dias

    Brasil beBeeDataScience Tempo inteiro R$120.000 - R$150.000

    Data Engineer PositionOverview:A leading organization is seeking a skilled Data Engineer to join its team. The successful candidate will be responsible for designing, implementing, and maintaining large-scale data systems.The ideal candidate will have experience with Scala, cloud-based technologies, and big data platforms. Strong analytical and...

  • Senior Data Engineer

    Há 3 dias

    Brasil beBeeData Tempo inteiro R$80.000 - R$100.000

    We are seeking an experienced Senior Data Engineer to lead the design, development, and implementation of data solutions that enable our organization to make informed decisions and improve overall performance.ResponsibilitiesDesign and develop scalable data architectures that meet business requirementsCollaborate with cross-functional teams to understand...

  • Senior Data Engineer

    3 semanas atrás

    Brasil Pride Global Tempo inteiro

    We're Hiring: Senior Data Engineer (MLOps) | Remote from Brazil | Fluent English required | USD-Hourly pay Location : Remote – Brazil only Language : Fluent English required Are you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing e-commerce and circular...