Middle Big Data Engineer

4 semanas atrás


Brazil, BR KITRUM Tempo inteiro
KITRUM, a tech company with a "People First" approach. Our mission is simple: bring together top development teams that share our values.

We operate with a global footprint, boasting developer teams in multiple countries, including Ukraine, the USA, Poland, Kazakhstan, Spain, Brazil and etc. Our team has nearly 250 members, including 150 experienced developers.

We're looking for a Middle Big Data Engineer for an American project. It is an online library with 1.5 million users and 60 million materials. It's like YouTube for those who love to read.

Requirements

— 3+ years of experience in data engineering creating or managing end-to-end data pipelines on large complex datasets.

— Proficiency in Spark

— Expertise in Scala, and/or Python

— Fluency with at least one dialect of SQL

— Level of English: Upper-Intermediate

As a plus

— Experience with Streaming platforms, typically based around Kafka

— Experience in Terraform, Airflow

— Strong grasp of AWS data platform services and their strengths/weaknesses

— Strong experience using Jira, Slack, JetBrains IDEs, Git, GitLab, GitHub, Docker, Jenkins

— Experience using DataBricks

Responsibilities

— Manage data quality and integrity

— Assist with building tools and technology to ensure that downstream customers can have faith in the data they're consuming

— Cross-functional work with the Data Science or Content Engineering teams to troubleshoot, process, or optimize business-critical pipelines

— Work with Core Platform to implement better processing jobs for scaling the consumption of streaming data sets

Benefits

— High compensation according to your technical skills

— Long-term projects (12m+) with great Customers

— 5-day working week, 8-hour working day, flexible schedule

— Democratic management style & friendly environment

— WFH mode

— Annual Paid vacation

— 30 b/days + unpaid vacation

— Paid sick leaves

— 6 b/days per year

— Corporate Perks (external training, English course, business speaking club, corporate events/team buildings)

— Professional and personal growth
  • Lead Data Engineer

    Há 2 dias


    Brazil, BR Mindera - Brazil Tempo inteiro

    Here at Mindera, we are continuously developing a fantastic team and would love it for you to join us. We are looking for experienced engineers with an appetite for solving complex problems and building seamless user interactions to world-class standards.As a Data Engineer, you will be responsible for building, maintaining, scaling, and integrating big...

  • Data Engineer

    Há 1 mês


    Brazil, BR Instituto de Pesquisas Eldorado Tempo inteiro

    Buscamos pessoas apaixonadas por tecnologia. Alguém que se motive por desafios e atue com autonomia. Precisa gostar de trabalhar em equipe e possuir espírito colaborativo.Responsabilidades e atribuições:Desenvolvimento do backend de aplicações web;Implementar e realizar testes unitários no software desenvolvido para garantia da qualidade;Atuar em...

  • Data Engineer

    Há 2 dias


    Brazil, BR Wipro Tempo inteiro

    We are one of the largest and leading global technology services, consulting and corporate processes companies in the world. We are present in more than 69 countries and our team is composed of more than 220,000 employees working on six continents. We are technological partners of the largest companies in the world. We proudly serve more than 1500 customers...


  • Brazil, BR Andela Tempo inteiro

    Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive long-term career opportunities with leading organizations, access to a global community of...


  • Brazil, BR System Soft Technologies Tempo inteiro

    Job Description: Machine Learning Engineer Client is seeking a highly skilled and talented Machine Learning Engineer to join our innovative team. In this role, you will apply your expertise in machine learning and data analysis techniques to develop and deploy cutting-edge models and algorithms that enable us to extract valuable insights from complex and...

  • Data Engineer

    4 semanas atrás


    São Paulo, Brazil, BR CriticalRiver Inc. Tempo inteiro

    Title: Data EngineerLocation: Sao Paulo BrazilRemote: Need to Support in USA PST time zoneDuration: Fulltime Interview process:Live Hacker rank test on Advanced SQL questions.Technical screeningClient live Hacker rank interview. Summary:Need a minimum of 6 years experience in SQL, with hands-on experience in writing complex queries and optimizing database...


  • Brazil, BR System Soft Technologies Tempo inteiro

    Job Summary:Client is seeking a highly skilled and talented Machine Learning Engineer to join our innovative team. In this role, you will apply your expertise in machine learning and data analysis techniques to develop and deploy cutting-edge models and algorithms that enable us to extract valuable insights from complex and diverse data sources. As a Machine...

  • Software Engineer

    Há 6 dias


    Brazil, BR Etleap Tempo inteiro

    Software Engineer - Integrations Etleap came to be out of the frustration with how much time data wrangling takes away from the actual analysis. We were just tired of spending time building and maintaining data pipelines. Then we noticed, so is everyone else! That is why we’ve created an intuitive ETL tool that easily enables the data analysts themselves...

  • Big Data Developer

    2 semanas atrás


    São Paulo, Brazil, BR Tata Consultancy Services Tempo inteiro

    Tata Consultancy Services (TCS) é líder global em serviços de TI, consultoria e soluções de negócios com uma grande rede de centros de inovação e entrega.Fomos reconhecidos como um Top Employer Global e nossa capacidade de fornecer carreiras holísticas de longo prazo com base no aprendizado contínuo impulsionado pelo nosso ecossistema de...

  • BI Engineer

    1 semana atrás


    Brazil, BR Stellantis South America Tempo inteiro

    Do you have a passion for building innovative data pipelines and transforming raw data into actionable insights? Are you an expert in programming languages like Spark, SQL, and Python, and thrive in a collaborative environment? If so, we want to hear from you!About the role:We are seeking a talented and experienced Data Engineer to join our growing team. In...


  • Brazil, BR System Soft Technologies Tempo inteiro

    Job Summary:The client is looking for a Machine Learning Engineer:ML Engineer- working with data science team. Helping automate things for the data science team to get things to the cloud. Testing is a skill they need. Batch scripting, automated testing will be a daily activity. Help teams deploy to the cloud. Responsibilities:Study and transform data...

  • AI Engineer

    Há 6 dias


    Brazil, BR KODIF Tempo inteiro

    Job DescriptionAbout usKodif is a Silicon Valley-based seed-stage startup founded by former Uber and Amazon engineers and a Stanford MBA. We’re building a low-code platform that enables non-technical teams to build automated customer experiences without engineering. We are backed by Village Global, Bling Capital, and other venture investors.Our mission is...

  • SR Engineer

    Há 6 dias


    Brazil, BR Aloware Tempo inteiro

    **THIS POSITION IS OPEN TO ALL LATAM COUNTRIES**About Us:Founded in 2018, Aloware is a dynamic and fast-growing contact center as a software (CCaaS) startup that has achieved a remarkable 100% year-over-year growth for the past three years. Our transformative calling and texting software caters to a diverse array of industries, primarily serving mid-market...


  • Brazil, BR Sigma Software Group Tempo inteiro

    We are looking for a well-rounded Senior Database Reliability Engineer who will be responsible for the daily operations, ensuring the seamless functioning of databases. This includes executing regular maintenance tasks to enhance performance and establishing routine backup strategies for securing critical data. The position involves investigating and...

  • Data Engineer

    3 semanas atrás


    São Paulo, Brazil, BR Tata Consultancy Services Tempo inteiro

    Tata Consultancy Services (TCS) é líder global em serviços de TI, consultoria e soluções de negócios com uma grande rede de centros de inovação e entrega.Nossa missão é ajudar os clientes a alcançar seus objetivos de negócios, fornecendo consultoria inovadora e de primeira classe e tornar uma alegria para todas as partes interessadas trabalhar...

  • Windows OS Engineer

    4 semanas atrás


    São Paulo, Brazil, BR Hyqoo Tempo inteiro

    Job Title: Windows/OS EngineerLocation: Hybrid (2 days onsite/Week)Address: (Rod. Pres. Dutra, Km 154 - s/n - Jardim das Industrias, São José dos Campos - SP, 12240-420, Brazil)We are seeking a dedicated and experienced Windows/OS Engineer to join our dynamic IT team. As a Windows/OS Engineer, you will be at the forefront of managing and maintaining the...


  • Brazil, BR Securecy Tempo inteiro

    Securecy, a prominent cybersecurity firm, is seeking a diligent Cyber Security Engineer to join our remote team. We welcome individuals from all locations to contribute to our mission of enhancing digital security practices.Employment Type: Full-time (Contract or Regular)ResponsibilitiesDevelop, implement, and manage security measures to protect systems and...

  • Network Cloud Engineer

    4 semanas atrás


    São Paulo, Brazil, BR Hyqoo Tempo inteiro

    Title: Network Cloud Engineer Location: Hybrid (2 days onsite/Week)Must have skills:3-5+ years of supporting and understanding a large enterprise network.years of demonstrated success designing, deploying and/or managing highly available Network Cloud Solutions in AWS and AZR (CWAN, vHub, native Firewall and load-balancer)years of demonstrated success...


  • Brazil, BR iVedha Inc. Tempo inteiro

    MICROSOFT SYSTEM ENGINEERCompany DescriptioniVedha Inc. is a leading NextGen software-powered global cloud managed services provider and managed hybrid cloud services provider. With a reputation for providing innovative solutions, iVedha empowers businesses on their digital transformation journey through disruptive technologies. The company serves clients...


  • Brazil, BR crewAI Tempo inteiro

    As a Senior Fullstack Software Engineer at crewAI, you will play a pivotal role in developing scalable, innovative software solutions that drive our mission forward. You'll work closely with a talented team of engineers, researchers, and AI enthusiasts, contributing to projects that leverage the power of large language models (LLMs) and our unique crewAI...