Senior Data Engineer

Há 2 dias


brasil Luxoft Tempo inteiro

Responsibilities

Design, build, and maintain scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.

Work with Azure and GCP platforms, specifically managing services like Azure Databricks, Azure SQL Server, BigQuery, DataProc, and Azure Machine Learning.

Develop and maintain CI/CD pipelines using GitHub Actions to automate the deployment of data engineering solutions.

Utilize GitHub for version control, ensuring that all code changes are tracked, reviewed, and managed effectively.

Work closely with cross-functional teams to define requirements, design solutions, and deliver high-quality data engineering outputs.


Skills Must have

  • It is expected that the engineer:
  • Is proficient in Data Engineering concepts (Object Storage, Data Pipelines, ELTs, Data Modeling, etc.)
  • Is proficient in Software Engineering concepts (Continuous Integration, Continuous Deployment, Unit Testing, Coverage, Linting, Version Control System, etc.)
  • Have knowledge or understanding the basic concepts of Software Development lifecycle (Release Engineering, Deployments, Code review, Requirements definition)
  • Platforms - Azure Databricks, SQL Server, Azure Machine Learning, Azure Blob Storage
  • Programming Language - Python, PySpark
  • CI/CD - GitHub Actions, GitHub
  • VCS - GitHub


LANGUAGES

  • English: B2 Upper Intermediate


  • Senior Data Engineer

    2 meses atrás


    Brasil Remobi Tempo inteiro

    Senior Data Engineer About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. Because it doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world. ...

  • Senior Data Engineer

    3 semanas atrás


    Brasil Aptonet Inc Tempo inteiro

    As a Senior Data Engineer (Python/Spark) , you will play a crucial role in building and maintaining robust data ingestion pipelines, applications, and data processing systems. You will work on cutting-edge technologies and be responsible for designing, implementing, and optimizing solutions that support our Data Product Hub. Key Responsibilities: Develop...

  • Senior Data Engineer

    4 semanas atrás


    Brasil inspired! Tempo inteiro

    ** PLEASE CONSIDER THE REQUIRED QUALIFICATIONS AND ENGLISH PROFICIENCY FOR THIS POSITION ** We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and optimizing data pipelines and architectures. You will leverage your Azure, Databricks, Data Warehousing, SQL, and...


  • Brasil Sandbox Group Tempo inteiro

    About the role This is a 100% remote position As a Senior Data Engineer, is responsible for the development, construction, maintenance, and testing of architectures, such as databases and large-scale processing systems. Is responsible play a pivotal role in optimizing data systems and building them from the ground up, working closely with data analysts to...

  • Senior Data Engineer

    2 meses atrás


    Brasil Sigma Software Group Tempo inteiro

    Sigma Software is looking for an experienced Senior Data Engineer to join our growing engineering team. This opportunity is for you if you want to work with a tightly knit team of data engineers solving challenging problems using cutting-edge data collection, transformation, analysis, and monitoring tools in the cloud. Sounds like you? We are waiting for...


  • Brasil Luxoft Tempo inteiro

    Responsibilities Design, build, and maintain scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python. Work with Azure and GCP platforms, specifically managing services like Azure Databricks, Azure SQL Server, BigQuery, DataProc, and Azure Machine Learning. Develop and maintain CI/CD pipelines using GitHub...


  • brasil Luxoft Tempo inteiro

    Responsibilities Design, build, and maintain scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python. Work with Azure and GCP platforms, specifically managing services like Azure Databricks, Azure SQL Server, BigQuery, DataProc, and Azure Machine Learning. Develop and maintain CI/CD pipelines using GitHub Actions...

  • Senior Data Engineer

    2 meses atrás


    Brasil Andela Tempo inteiro

    Senior Data Engineer Andela Location Requirement: Brazil, Canada, Egypt. About Andela Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive...

  • Data Engineer

    4 semanas atrás


    Brasil Blueclip Tempo inteiro

    As Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works. About Our Search We are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by...

  • Data Engineer

    Há 3 dias


    brasil Blueclip Tempo inteiro

    As Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works. About Our Search We are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by machine...

  • Data Engineer

    3 semanas atrás


    Brasil Remobi Tempo inteiro

    Data Engineer - (REMOTE) Brazil About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world....

  • Data Engineer

    Há 3 dias


    brasil Remobi Tempo inteiro

    Data Engineer - (REMOTE) Brazil About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world. Our...

  • Data Engineer

    Há 2 dias


    brasil Remobi Tempo inteiro

    Data Engineer - (REMOTE) BrazilAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world.Our...

  • Data Engineer

    Há 1 mês


    Brasil Birlasoft Tempo inteiro

    Data Engineer - Cognite Qualifications Experience with Cognite Solutions Experience in data governance and modern platforms like Data Fabric and Data Mesh. Ability to work in complex environments with large data volumes, including cloud and hybrid implementations. Hands-on experience in Data Science and AI/ML projects, with proficiency in advanced...

  • Senior Data Engineer

    3 semanas atrás


    Brasil Sigma Software Group Tempo inteiro

    Our growing data teams are seeking a savvy Senior Data Engineer to join them and help build and evolve the next generation of Audience & Identity data platforms that handle data at scale and use state-of-the-art technologies to unlock the data’s business value. If you’re excited about working with cutting-edge technology in a fast-paced environment,...


  • brasil Sigma Software Group Tempo inteiro

    Our growing data teams are seeking a savvy Senior Data Engineer to join them and help build and evolve the next generation of Audience & Identity data platforms that handle data at scale and use state-of-the-art technologies to unlock the data’s business value.If you’re excited about working with cutting-edge technology in a fast-paced environment,...


  • Brasil BetterEngineer Tempo inteiro

    Better Engineers. Better Results. BetterEngineers connects accomplished Software Engineers across the Americas with our portfolio of high-growth and newsworthy technology companies in the United States. Senior Engineers in the BetterEngineers network work remotely with some of the most interesting tech companies in the world. Join us today and experience a...


  • brasil BetterEngineer Tempo inteiro

    Better Engineers. Better Results. BetterEngineers connects accomplished Software Engineers across the Americas with our portfolio of high-growth and newsworthy technology companies in the United States. Senior Engineers in the BetterEngineers network work remotely with some of the most interesting tech companies in the world. Join us today and experience a...


  • brasil BetterEngineer Tempo inteiro

    Better Engineers. Better Results. BetterEngineers connects accomplished Software Engineers across the Americas with our portfolio of high-growth and newsworthy technology companies in the United States. Senior Engineers in the BetterEngineers network work remotely with some of the most interesting tech companies in the world. Join us today and experience a...

  • Data Engineer

    4 semanas atrás


    Brasil Zazmic Inc Tempo inteiro

    Job Title: Senior Data Engineer (Apache Spark, GCP) Join our dynamic data team, where you’ll have the opportunity to shape the future of our data infrastructure and drive innovation across the organization. We’re looking for a highly skilled Data Engineer who thrives in a fast-paced environment and is passionate about leveraging cutting-edge...