Distributed Data Systems Engineer

Há 21 horas

São Paulo, São Paulo, Brasil beBeeDataEngineer Tempo inteiro R$80.000 - R$180.000

As a Data Engineer, you will be responsible for designing and implementing large-scale data processing systems. This includes working with big data technologies such as Snowflake, Databricks, Hadoop, AWS, Azure, and distributed storage solutions like Kafka, HDFS, S3/ADLS, and Elastic.

Required Skills and Qualifications
  • Familiarity with the full software development lifecycle, including unit testing, integration testing, and production deployment to platforms such as Snowflake, Databricks, Hadoop, AWS, or Azure.
  • Experience with mainstream data ingestion tools like StreamSets, Apache NiFi, or Azure Data Factory, and distributed storage solutions such as Kafka, HDFS, S3/ADLS, or Elastic.
  • Strong working knowledge of SQL and the ability to write, debug, and optimize queries.

Additionally, we require proficiency in programming languages such as Python, Databricks SQL, PySpark, Spark SQL, Spark DataFrame, and Spark Structured Streaming. Experience with version control using Github and continuous integration using Github Actions is also essential.

We also expect our ideal candidate to have experience with design principles, specifically SOLID design principles.

The following are desirable skills:

  • Domain expertise in Oil & Gas
  • Experience with WITS/WITSML and CosmoDB
  • Knowledge of Databricks CLI

We are looking for a talented Data Engineer who can join our team and contribute to the development of innovative data processing solutions.

  • Software Engineer

    Há 6 dias

    São Paulo, São Paulo, Brasil beBeeDistributedStorage Tempo inteiro US$90.000 - US$120.000

    Job Description:">We are seeking a skilled Software Engineer to join our team in building modelling software for distributed storage systems. The ideal candidate will have experience with Ceph and a passion for open-source technologies.">Required Skills and Qualifications:">">Experience with writing modern, maintainable Python code">Familiarity with Ceph...

  • Distributed Systems Software Engineer, Python

    2 semanas atrás

    São Paulo, São Paulo, Brasil Canonical Tempo inteiro

    Distributed Systems Software Engineer, Python / Go 3 months ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. We are seeking a software engineer with a passion for building and validating resilient distributed systems. At Canonical you can build a career and drive the success of those leveraging Canonical's...

  • Quality Engineer

    2 semanas atrás

    São Paulo, São Paulo, Brasil GeorgiaTEK Systems Inc. Tempo inteiro

    Job Title: Quality Engineer (Python)Department: Engineering / Quality AssuranceAbout the RoleWe are seeking a skilled Quality Engineer with strong Python expertise to join our growing engineering team. This role is ideal for someone passionate about ensuring high-quality software through robust testing, modern automation practices, and strong collaboration...

  • Data Engineer

    Há 5 dias

    São Paulo, São Paulo, Brasil Yuno Tempo inteiro

    Join to apply for the Data Engineer role at Yuno.Remote, Latam, Full Time, Individual Contributor, +2 years of experience.Who We AreAt Yuno, we are building the payment infrastructure that enables all companies to participate in the global market. Founded by a team of seasoned experts in the payments and IT industries, Yuno provides a high-performance...

  • Distributed Systems Architect

    2 semanas atrás

    São Paulo, São Paulo, Brasil beBeeInfrastructurespecialist Tempo inteiro R$120.000 - R$150.000

    About the JobWe are seeking a seasoned infrastructure expert to lead our distributed systems and ensure high reliability in our digital platforms. This role requires strong leadership skills, strategic thinking, and technical expertise to manage large-scale distributed systems or messaging platforms.Key ResponsibilitiesDesign and implement efficient...

  • Expert Distributed System Developer

    Há 6 dias

    São Paulo, São Paulo, Brasil beBeeElixirDeveloper Tempo inteiro R$80.000 - R$150.000

    Backend Engineer - ElixirWe're looking for a skilled Backend Engineer to join our team and contribute to the development of high-performance, distributed systems using Elixir.About the RoleThis is a challenging role that requires a deep understanding of concurrent programming, fault-tolerant architecture, and system design. As a Backend Engineer, you will be...

  • System Software Engineer

    3 semanas atrás

    São Paulo, São Paulo, Brasil Canonical Tempo inteiro

    System Software Engineer - Ubuntu Networking Join to apply for the System Software Engineer - Ubuntu Networking role at Canonical System Software Engineer - Ubuntu Networking 12 hours ago Be among the first 25 applicants Join to apply for the System Software Engineer - Ubuntu Networking role at Canonical Get AI-powered advice on this job and more...

  • Data Engineer_L3_ Program Tech Lead

    Há 5 dias

    São Paulo, São Paulo, Brasil Grupo Data Tempo inteiro US$90.000 - US$120.000 por ano

    Muito Gosto Somos o Grupo DATA O nosso propósito é simplificar a vida dos nossos clientes e fazemos isso em todo o mundo, através das nossas soluções de TI. Somos uma multinacional, que opera ativamente em Portugal, e estamos em constante expansão Adoramos trabalhar com grandes empresas e fazer crescer as empresas com as quais colaboramos....

  • Distributed Systems Manager

    Há 6 dias

    São Paulo, São Paulo, Brasil beBeeEngineer Tempo inteiro US$80.890 - US$121.070

    Job DescriptionWe are seeking a seasoned engineering manager to lead our BootStack team in designing, building, and operating modern distributed systems on private infrastructure for customers.Manage a growing engineering team to optimize the quality and velocity of both development and operationsIdentify and measure team health indicatorsImplement...

  • Senior Data Systems Engineer

    Há 2 dias

    São Paulo, São Paulo, Brasil beBeeDataEngineer Tempo inteiro US$105.000 - US$140.000

    Job SummaryWe are seeking an experienced Data Engineer to lead our team in designing and implementing scalable, high-performance data systems. The ideal candidate will have a strong background in data engineering, with experience in building and maintaining big data pipelines.Key ResponsibilitiesDesign and implement scalable data systems, leveraging...