Senior Data DevOps Engineer

3 semanas atrás

João Pessoa, Brasil EPAM Systems Tempo inteiro

We are seeking a Senior Data DevOps Engineer to join our remote team, working on a cutting-edge project that involves developing and maintaining large-scale big data infrastructure.

In this role, you will play a crucial role in ensuring the reliability, scalability, and performance of our big data infrastructure. You will work closely with cross-functional teams, including data scientists, data engineers, and software developers, to deploy, operate, monitor, optimize, and troubleshoot our big data infrastructure.

Responsibilities
  1. Develop and maintain infrastructure as code for big data components, using tools such as Terraform, Kubernetes, and Helm.
  2. Deploy, operate, monitor, optimize, and troubleshoot large-scale big data infrastructure, ensuring high availability, reliability, and performance.
  3. Collaborate with cross-functional teams, including data scientists, data engineers, and software developers, to design, implement, and maintain data pipelines and processing workflows.
  4. Automate data processing tasks, using shell scripts, Python, and other programming languages.
  5. Ensure compliance with security and data privacy policies and regulations.
  6. Participate in on-call rotation to provide 24/7 support for critical production systems.
  7. Continuously improve the performance, scalability, and reliability of our big data infrastructure, using monitoring and alerting tools.
  8. Provide technical guidance and mentorship to junior team members.
Requirements
  1. At least 3 years of experience in DevOps, with a focus on data infrastructure and operations.
  2. Hands-on experience with big data components.
  3. Expertise in deploying, operating, monitoring, optimizing, and troubleshooting large-scale big data infrastructure.
  4. Proficient in shell scripting, Python, and SQL, with a deep understanding of data pipeline and data processing concepts.
  5. Experience in cloud computing platforms, such as AWS, Azure, and GCP, with a focus on cloud operations and infrastructure as code development and maintenance.
  6. Proficiency in infrastructure automation tools, such as Terraform, CloudFormation, CDK, and Kubernetes.
  7. Strong knowledge of Unix-based operating systems and networking concepts.
  8. Fluent spoken and written English at an upper-intermediate level or higher.
Nice to have
  1. Experience with machine learning frameworks and tools, such as TensorFlow, PyTorch, and Scikit-learn.
  2. Familiarity with data visualization tools, such as Tableau and Power BI.
  3. Knowledge of container orchestration platforms, such as Docker Swarm and Amazon ECS.
  4. Experience with CI/CD pipelines, using tools such as Jenkins and GitLab.
We offer
  1. International projects with top brands.
  2. Work with global teams of highly skilled, diverse peers.
  3. Healthcare benefits.
  4. Employee financial programs.
  5. Paid time off and sick leave.
  6. Upskilling, reskilling, and certification courses.
  7. Unlimited access to the LinkedIn Learning library and 22,000+ courses.
  8. Global career opportunities.
  9. Volunteer and community involvement opportunities.
  10. EPAM Employee Groups.
  11. Award-winning culture recognized by Glassdoor, Newsweek, and LinkedIn.
#J-18808-Ljbffr

  • Senior Devops Engineer

    3 semanas atrás

    João Pessoa, Brasil buscojobs Brasil Tempo inteiro

    Important Information Location: Brazil Job Mode: Full-time Work Mode: Work from home Overview As a Senior DevOps Engineer, you will actively interface with software developers, product managers, test engineers, and administrators on projects to design and develop the build, release, and deploy toolchain for DevOps while providing on-call support. You should...

  • Senior Devops Engineer

    3 semanas atrás

    João Pessoa, Brasil buscojobs Brasil Tempo inteiro

    Location : Brazil Job Mode : Full-time Work Mode : Work from home Overview As a Senior DevOps Engineer, you will actively interface with software developers, product managers, test engineers, and administrators on projects to design and develop the build, release, and deploy toolchain for DevOps while providing on-call support. You should be able to...

  • Lead Data Engineer

    3 semanas atrás

    João Pessoa, Brasil Fusemachines Tempo inteiro

    3 weeks ago Be among the first 25 applicants About FusemachinesFusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican...

  • Data Engineer

    3 semanas atrás

    João Pessoa, Brasil AgileEngine Tempo inteiro

    Join to apply for the Data Engineer (Senior) ID40199 role at AgileEngine AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to...

  • Data Engineer

    3 semanas atrás

    João Pessoa, Brasil Coda Search│Staffing Tempo inteiro

    Get AI-powered advice on this job and more exclusive features. Our client is a U.S.-based company that provides technical expertise, testing, and certification services to the global food and agricultural industry. Their mission is to ensure food safety, quality, and sustainability across international supply chains. This role is critical to building,...

  • Senior Data Scientist

    3 semanas atrás

    João Pessoa, Brasil BairesDev Tempo inteiro

    Join to apply for the Senior Data Scientist - Remote Work role at BairesDev At BairesDev, we\'ve been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world\'s Top 1% of tech talent, works remotely...

  • Senior Software Engineer

    Há 4 dias

    João Pessoa, Brasil Braintrust Tempo inteiro

    Join to apply for the Senior Software Engineer - C# role at BraintrustAbout PyynePyyne is a modern technology consultancy engineering the next generation of digital products and services.At Pyyne, we believe in using technology to unlock business potential, create sustainable growth, and drive forward digital excellence.Our solutions range from advanced...

  • Data Architect

    3 semanas atrás

    João Pessoa, Brasil buscojobs Brasil Tempo inteiro

    About Us At Aravita, we're not just building a product; we're building the future of AI-enabled fresh food operations. We are a fast-paced, innovative startup on a mission to solve complex problems with data. Our culture is built on collaboration, curiosity, and a passion for technology. We're looking for a brilliant Data Engineer / Cloud Architect to join...

  • Big Data Engineer

    4 semanas atrás

    João Pessoa, Paraíba, Brasil HUNT IT - Recrutamento Especializado para TI Tempo inteiro

    Descrição: Big Data EngineerOur Client is a US technology company looking for a highly motivated Data Engineer with a passion for data, to build and implement data pipelines in cloud technologies, including SnapLogic and AWS.Responsibilities:● Develops and maintains scalable data pipelines in SnapLogic and builds out new ETL and API integrations to...

  • Senior Software Engineer, Data Product

    3 semanas atrás

    João Pessoa, Brasil TRM Labs Tempo inteiro

    TRM is on a mission to build a safer financial system for billions of people. We deliver a blockchain intelligence data platform to financial institutions, crypto companies, and governments to fight cryptocurrency fraud and financial crime. We consider our business — and our profit — as a way to move towards our mission sustainably and at scale. The...