Sr Data Engineer

1 semana atrás

Cuiabá, Brasil Luxoft Tempo inteiro

Before you apply, please get familiar with Luxoft

- Luxoft locations: https://career.Luxoft.Com/locations/
- Logeek Magazine: https://career.Luxoft.Com/logeek-magazine/
- Luxoft Alumni Club: https://career.Luxoft.Com/alumni/

Responsibilities:

- Design and implement scalable data pipelines using Databricks and Kafka
- Build and maintain real-time streaming solutions for high-volume data
- Collaborate with cross-functional teams to integrate data flows into broader systems
- Optimize performance and reliability of data processing workflows
- Ensure data quality, lineage, and compliance across streaming and batch pipelines
- Participate in agile development processes and contribute to technical documentation

Mandatory Skills Description:

- +5 years of experience in data engineering roles
- Proven expertise with Databricks (Spark, Delta Lake, notebooks, performance tuning)
- Strong hands-on experience with Apache Kafka (topics, producers/consumers, schema registry)
- Solid understanding of streaming frameworks (e.G., Spark Structured Streaming, Flink, or similar)
- Experience with cloud platforms (AWS, Azure, or GCP)
- Proficiency in Python or Scala for data pipeline development
- Familiarity with CI/CD pipelines (GitLab, Jenkins) and agile tools (Jira)
- Exposure to data lakehouse architectures and best practices
- Knowledge of data governance, security, and observability

Project Description:

- We are seeking a skilled and hands-on Data Engineer with proven experience in Databricks, Apache Kafka, and real-time data streaming solutions.

  • Sr Data Engineer

    Há 6 dias

    Cuiabá, Brasil Luxoft Tempo inteiro

    Before you apply, please get familiar with Luxoft Luxoft locations:Logeek Magazine:Luxoft Alumni Club:Responsibilities:Design and implement scalable data pipelines using Databricks and KafkaBuild and maintain real-time streaming solutions for high-volume dataCollaborate with cross-functional teams to integrate data flows into broader systemsOptimize...

  • Sr Data Engineer

    Há 6 dias

    Cuiabá, Brasil Luxoft Tempo inteiro

    Before you apply, please get familiar with Luxoft Luxoft locations: Logeek Magazine: Luxoft Alumni Club: Responsibilities: Design and implement scalable data pipelines using Databricks and Kafka Build and maintain real-time streaming solutions for high-volume data Collaborate with cross-functional teams to integrate data flows into broader...

  • Data Engineer

    3 semanas atrás

    Cuiabá, Brasil HeartCentrix Solutions Tempo inteiro

    We are seeking a highly skilled Python Data Engineer with an AI / ML focus to join our client’s growing data & analytics team in Brazil. This role is ideal for someone who loves building scalable data pipelines, operationalizing machine learning workflows, and partnering closely with data scientists to bring models into production. You will design,...

  • Data Engineer

    2 semanas atrás

    Cuiabá, Brasil Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!!Here you can transform your career!Why to join TCS?Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development.The ideal scenario to expand ideas through the right tools, contributing to...

  • Data Engineer

    1 semana atrás

    Cuiabá, Brasil Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!!Here you can transform your career!Why to join TCS?Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development.The ideal scenario to expand ideas through the right tools, contributing to...

  • Data Engineer

    Há 3 dias

    Cuiabá, Brasil Zunzun Solutions Tempo inteiro

    Summary: We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines. In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions. You will play a key role in modernizing our data platform on...

  • Data Engineer

    Há 21 horas

    Cuiabá, Brasil Zunzun Solutions Tempo inteiro

    Summary: We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines. In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions. You will play a key role in modernizing our data platform on...

  • Data Engineer

    Há 10 horas

    Cuiabá, Brasil Zunzun Solutions Tempo inteiro

    Summary: We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines.In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions.You will play a key role in modernizing our data platform on the...

  • Data Engineer

    3 semanas atrás

    Cuiabá, Brasil Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...

  • Data Engineer

    1 semana atrás

    Cuiabá, Brasil Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...