Senior Data DevOps Engineer

4 semanas atrás

Brasil EPAM Systems Tempo inteiro

We are seeking a Senior Data DevOps Engineer to join our remote team, working on a cutting-edge project that involves developing and maintaining large-scale big data infrastructure.

In this role, you will play a crucial role in ensuring the reliability, scalability, and performance of our big data infrastructure. You will work closely with cross-functional teams, including data scientists, data engineers, and software developers, to deploy, operate, monitor, optimize, and troubleshoot our big data infrastructure.

Responsibilities
  1. Develop and maintain infrastructure as code for big data components, using tools such as Terraform, Kubernetes, and Helm.
  2. Deploy, operate, monitor, optimize, and troubleshoot large-scale big data infrastructure, ensuring high availability, reliability, and performance.
  3. Collaborate with cross-functional teams, including data scientists, data engineers, and software developers, to design, implement, and maintain data pipelines and processing workflows.
  4. Automate data processing tasks, using shell scripts, Python, and other programming languages.
  5. Ensure compliance with security and data privacy policies and regulations.
  6. Participate in on-call rotation to provide 24/7 support for critical production systems.
  7. Continuously improve the performance, scalability, and reliability of our big data infrastructure, using monitoring and alerting tools.
  8. Provide technical guidance and mentorship to junior team members.
Requirements
  1. At least 3 years of experience in DevOps, with a focus on data infrastructure and operations.
  2. Hands-on experience with big data components.
  3. Expertise in deploying, operating, monitoring, optimizing, and troubleshooting large-scale big data infrastructure.
  4. Proficient in shell scripting, Python, and SQL, with a deep understanding of data pipeline and data processing concepts.
  5. Experience in cloud computing platforms, such as AWS, Azure, and GCP, with a focus on cloud operations and infrastructure as code development and maintenance.
  6. Proficiency in infrastructure automation tools, such as Terraform, CloudFormation, CDK, and Kubernetes.
  7. Strong knowledge of Unix-based operating systems and networking concepts.
  8. Fluent spoken and written English at an upper-intermediate level or higher.
Nice to have
  1. Experience with machine learning frameworks and tools, such as TensorFlow, PyTorch, and Scikit-learn.
  2. Familiarity with data visualization tools, such as Tableau and Power BI.
  3. Knowledge of container orchestration platforms, such as Docker Swarm and Amazon ECS.
  4. Experience with CI/CD pipelines, using tools such as Jenkins and GitLab.
We offer
  1. International projects with top brands.
  2. Work with global teams of highly skilled, diverse peers.
  3. Healthcare benefits.
  4. Employee financial programs.
  5. Paid time off and sick leave.
  6. Upskilling, reskilling, and certification courses.
  7. Unlimited access to the LinkedIn Learning library and 22,000+ courses.
  8. Global career opportunities.
  9. Volunteer and community involvement opportunities.
  10. EPAM Employee Groups.
  11. Award-winning culture recognized by Glassdoor, Newsweek, and LinkedIn.
#J-18808-Ljbffr

  • Senior Data DevOps Engineer

    4 semanas atrás

    Brasil EPAM Systems Tempo inteiro

    1 day ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.We are looking for a Senior Data DevOps Engineer to join our remote team.You will be responsible for implementing a fully automated CI/CD process for the delivery of data processing, collaborating with cross-functional teams and establishing best...

  • Senior Data DevOps Engineer

    4 semanas atrás

    Brasil EPAM Systems Tempo inteiro

    1 week ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.We are seeking a highly skilled remote Senior Data DevOps Engineer to join our remote team.As a Senior Data DevOps Engineer, you will be responsible for the development and maintenance of infrastructure as code, utilizing your expertise in Pulumi (or...

  • Senior Data DevOps Engineer

    4 semanas atrás

    Brasil EPAM Systems Tempo inteiro

    We are seeking a highly experienced remote Senior Data DevOps Engineer to help us design, build, and deploy data pipelines using AWS technologies and related tools.The ideal candidate will have at least 3 years of experience, with strong expertise in Data Operations, AWS, and Linux. The candidate should also have hands-on experience with Terraform or other...

  • Senior MLOps DevOps Engineer

    4 semanas atrás

    Brasil Saventic Health Tempo inteiro

    Senior MLOps DevOps Engineer (Healthcare AI)Join to apply for the Senior MLOps DevOps Engineer (Healthcare AI) role at Saventic HealthContinue with Google Continue with GoogleSenior MLOps DevOps Engineer (Healthcare AI)Join to apply for the Senior MLOps DevOps Engineer (Healthcare AI) role at Saventic HealthDirect message the job poster from Saventic...

  • Senior Devops Engineer

    1 semana atrás

    Brasil InComm Payments Tempo inteiro

    As a Senior DevOps Engineer, you will implement and support customer care and other enterprise solutions. Our mission is to build and implement tools and infrastructure improvements that enable quick, easy, safe delivery and operation of microservices, web applications and other backend processes. The team you will be joining utilizes a variety of technology...

  • Azure DevOps Engineer

    4 semanas atrás

    Brasil Lumenalta Tempo inteiro

    Join to apply for the Azure DevOps Engineer - Tech Lead role at Lumenalta2 days ago Be among the first 25 applicantsJoin to apply for the Azure DevOps Engineer - Tech Lead role at LumenaltaGet AI-powered advice on this job and more exclusive features.Experience Remote done Right. With over 20 years of remote experience, all 500+ staff are 100% remote. We...

  • Azure DevOps Engineer

    4 semanas atrás

    Brasil Lisinski Law Firm, LLC Tempo inteiro

    Join to apply for the Azure DevOps Engineer / Administrator role at Lisinski Law Firm1 week ago Be among the first 25 applicantsJoin to apply for the Azure DevOps Engineer / Administrator role at Lisinski Law FirmFirm Mission StatementAbout The Lisinski Law FirmFirm Mission StatementOur mission is to change as many lives as possible by offering immigration...

  • Senior Data Engineer

    Há 2 dias

    Brasil FoodChain ID Tempo inteiro

    Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.ResponsibilitiesUse Python and SQL to efficiently create, extract, transform, and optimize very large datasetsTroubleshoot data and data processes and develop solutions for improvementDevelop and maintain data models, schemas, and documentationContribute as a...

  • Senior Data Engineer

    Há 2 dias

    Brasil Foodchain Id Group Tempo inteiro

    Job opening for residents of BrazilJob Duties:· Use Python and SQL to efficiently create, extract, transform, and optimize very large datasets.· Troubleshoot data and data processes and develop solutions for improvement.· Develop and maintain data models, schemas, and documentation.· Contribute as a hands-on engineer while sometimes taking the lead in...

  • Senior DevOps Engineer

    4 semanas atrás

    Brasil FullStack Labs Tempo inteiro

    Join to apply for the Senior DevOps Engineer - Remote - Latin America role at FullStack Labs4 days ago Be among the first 25 applicantsJoin to apply for the Senior DevOps Engineer - Remote - Latin America role at FullStack LabsGet AI-powered advice on this job and more exclusive features.About FullStackFullStack is the most transparent IT talent network,...