Senior Data Infrastructure Engineer

Há 2 dias

Natal, Rio Grande do Norte, Brasil EPAM Systems Tempo inteiro
Overview

We are seeking a Senior Data Infrastructure Engineer , responsible for supporting a data processing infrastructure cluster. The selected individual will have a pivotal role in sustaining, improving, and resolving problems from the AWS level down to specific data pipeline arrangements. Responsibilities will include deploying updates, establishing new instances, and overseeing continuous deployment pipelines to guarantee efficient functioning.

Responsibilities
  • Address incidents and diagnose problems from AWS to data pipeline config
  • Resolve identified problems or escalate them to the data team with detailed reasoning
  • Apply enhancements within the infrastructure to boost efficiency and dependability
  • Configure new instances according to project specifications
  • Oversee and improve continuous deployment (CD) pipelines
  • Cooperate with diverse engineering teams to incorporate their contributions into the infrastructure
  • Guarantee the security of the system and adherence to relevant regulations
  • Track system performance and suggest enhancement measures
  • Record infrastructure modifications and refresh system documentation as necessary
Requirements
  • At least 3 years of relevant experience in a data infrastructure role
  • Proficiency in AWS and Kubernetes (K8S)
  • Understanding of Terraform for infrastructure as code (IaC) applications
  • Expertise in either Airflow or Spark for data pipeline execution
  • Qualifications in managing CI/CD tools like Jenkins
  • Capability to operate autonomously and within a collaborative environment
  • Exceptional problem-solving abilities and meticulous attention to detail
Nice to have
  • Background in Flink and Databricks
  • Proficiency in Spinnaker for CD management
  • Ability to quickly adapt and master new technologies
We offer
  • International projects with top brands
  • Work with global teams of highly skilled, diverse peers
  • Employee financial programs
  • Paid time off and sick leave
  • Upskilling, reskilling and certification courses
  • Unlimited access to the LinkedIn Learning library and 22,000+ courses
  • Global career opportunities
  • Volunteer and community involvement opportunities
  • EPAM Employee Groups
  • Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn
#J-18808-Ljbffr

  • Cloud Infrastructure Leader

    1 semana atrás

    Natal, Rio Grande do Norte, Brasil beBeeDevops Tempo inteiro US$104.449 - US$143.772

    Senior DevOps Engineer OpportunityWe're seeking a skilled Senior DevOps Engineer to lead our infrastructure initiatives and drive the development of robust systems.Develop and maintain advanced CI/CD pipelines, integrating cutting-edge tools and techniques.Architect and manage scalable cloud infrastructure solutions, leveraging advanced cloud services.Lead...

  • Lead Data Infrastructure Architect

    1 dia atrás

    Natal, Rio Grande do Norte, Brasil beBeeData Tempo inteiro US$90.000 - US$130.000

    Job OverviewWe are seeking a skilled and experienced data infrastructure professional to support our large-scale data processing infrastructure cluster.

  • Data Platform Engineer

    1 semana atrás

    Natal, Rio Grande do Norte, Brasil Bairesdev Tempo inteiro

    Join to apply for the Data Platform Engineer - Remote Work | REF#263487 role at BairesDev1 week ago Be among the first 25 applicantsJoin to apply for the Data Platform Engineer - Remote Work | REF#263487 role at BairesDevAt BairesDev, we've been leading the way in technology projects for over 15 years.We deliver cutting-edge solutions to giants like Google...

  • Senior Devops Engineer

    Há 6 dias

    Natal, Rio Grande do Norte, Brasil Bairesdev Tempo inteiro

    Join to apply for the Senior DevOps Engineer - Remote Work | REF#282518 role at BairesDev4 months ago Be among the first 25 applicantsJoin to apply for the Senior DevOps Engineer - Remote Work | REF#282518 role at BairesDevAt BairesDev, we've been leading the way in technology projects for over 15 years.We deliver cutting-edge solutions to giants like Google...

  • Senior DevOps Engineer

    1 semana atrás

    Natal, Rio Grande do Norte, Brasil BairesDev Tempo inteiro

    Join to apply for the Senior DevOps Engineer - Remote Work | REF# role at BairesDev 4 months ago Be among the first 25 applicants Join to apply for the Senior DevOps Engineer - Remote Work | REF# role at BairesDev At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google...

  • Data Platform Engineer

    1 semana atrás

    Natal, Rio Grande do Norte, Brasil BairesDev Tempo inteiro

    Join to apply for the Data Platform Engineer - Remote Work | REF# role at BairesDev 1 week ago Be among the first 25 applicants Join to apply for the Data Platform Engineer - Remote Work | REF# role at BairesDev At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and...

  • Software Engineer Senior

    Há 6 dias

    Natal, Rio Grande do Norte, Brasil Galgo Tempo inteiro

    OverviewJoin to apply for the Software Engineer Senior role at GalgoGalgo is a fast-growing fintech focused on motorcycle sales and financing. We are a purpose-driven company, the first and only financial institution focused on the underbanked sector in Chile, Mexico, and Colombia. Our mission is to create better opportunities for integration and progress...

  • Software Engineer Senior

    Há 4 dias

    Natal, Rio Grande do Norte, Brasil Galgo Tempo inteiro

    Overview Join to apply for the Software Engineer Senior role at Galgo Galgo is a fast-growing fintech focused on motorcycle sales and financing. We are a purpose-driven company, the first and only financial institution focused on the underbanked sector in Chile, Mexico, and Colombia. Our mission is to create better opportunities for integration and...

  • Senior Data Architect

    1 dia atrás

    Natal, Rio Grande do Norte, Brasil beBeeData Tempo inteiro R$60.000 - R$80.000

    Job Title: Senior Data ArchitectAbout the RoleWe are seeking an experienced data architect to lead our organization's data strategy and design. As a senior data architect, you will be responsible for developing and implementing data architectures that meet our business needs.Key Responsibilities:Design and build scalable data platforms using Microsoft...

  • High-Performance AI Solutions Developer

    1 dia atrás

    Natal, Rio Grande do Norte, Brasil beBeeAI Tempo inteiro US$120.000 - US$150.000

    Senior AI/Machine Learning EngineerWe are seeking a highly skilled Senior AI/ML Engineer to play a pivotal role in designing, developing, and deploying AI-powered solutions that enhance immersive, high-performance web experiences for global clients.The successful candidate will combine hands-on technical work with strategic solution design, requiring...