Senior Data DevOps Engineer

Há 22 horas

João Pessoa, Brasil EPAM Systems Tempo inteiro

We are seeking a Senior Data DevOps Engineer to join our remote team, working on a cutting-edge project that involves developing and maintaining large-scale big data infrastructure.

In this role, you will play a crucial role in ensuring the reliability, scalability, and performance of our big data infrastructure. You will work closely with cross-functional teams, including data scientists, data engineers, and software developers, to deploy, operate, monitor, optimize, and troubleshoot our big data infrastructure.

Responsibilities
  1. Develop and maintain infrastructure as code for big data components, using tools such as Terraform, Kubernetes, and Helm.
  2. Deploy, operate, monitor, optimize, and troubleshoot large-scale big data infrastructure, ensuring high availability, reliability, and performance.
  3. Collaborate with cross-functional teams, including data scientists, data engineers, and software developers, to design, implement, and maintain data pipelines and processing workflows.
  4. Automate data processing tasks, using shell scripts, Python, and other programming languages.
  5. Ensure compliance with security and data privacy policies and regulations.
  6. Participate in on-call rotation to provide 24/7 support for critical production systems.
  7. Continuously improve the performance, scalability, and reliability of our big data infrastructure, using monitoring and alerting tools.
  8. Provide technical guidance and mentorship to junior team members.
Requirements
  1. At least 3 years of experience in DevOps, with a focus on data infrastructure and operations.
  2. Hands-on experience with big data components.
  3. Expertise in deploying, operating, monitoring, optimizing, and troubleshooting large-scale big data infrastructure.
  4. Proficient in shell scripting, Python, and SQL, with a deep understanding of data pipeline and data processing concepts.
  5. Experience in cloud computing platforms, such as AWS, Azure, and GCP, with a focus on cloud operations and infrastructure as code development and maintenance.
  6. Proficiency in infrastructure automation tools, such as Terraform, CloudFormation, CDK, and Kubernetes.
  7. Strong knowledge of Unix-based operating systems and networking concepts.
  8. Fluent spoken and written English at an upper-intermediate level or higher.
Nice to have
  1. Experience with machine learning frameworks and tools, such as TensorFlow, PyTorch, and Scikit-learn.
  2. Familiarity with data visualization tools, such as Tableau and Power BI.
  3. Knowledge of container orchestration platforms, such as Docker Swarm and Amazon ECS.
  4. Experience with CI/CD pipelines, using tools such as Jenkins and GitLab.
We offer
  1. International projects with top brands.
  2. Work with global teams of highly skilled, diverse peers.
  3. Healthcare benefits.
  4. Employee financial programs.
  5. Paid time off and sick leave.
  6. Upskilling, reskilling, and certification courses.
  7. Unlimited access to the LinkedIn Learning library and 22,000+ courses.
  8. Global career opportunities.
  9. Volunteer and community involvement opportunities.
  10. EPAM Employee Groups.
  11. Award-winning culture recognized by Glassdoor, Newsweek, and LinkedIn.
#J-18808-Ljbffr

  • Lead Data Engineer

    1 dia atrás

    João Pessoa, Brasil Fusemachines Tempo inteiro

    3 weeks ago Be among the first 25 applicants About FusemachinesFusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican...

  • Data Engineer

    1 dia atrás

    João Pessoa, Brasil AgileEngine Tempo inteiro

    Join to apply for the Data Engineer (Senior) ID40199 role at AgileEngine AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to...

  • Senior Data Infrastructure Engineer

    Há 22 horas

    João Pessoa, Brasil Epam Systems Tempo inteiro

    OverviewWe are seeking a Senior Data Infrastructure Engineer, responsible for supporting a data processing infrastructure cluster.The selected individual will have a pivotal role in sustaining, improving, and resolving problems from the AWS level down to specific data pipeline arrangements.Responsibilities will include deploying updates, establishing new...

  • Data Engineer

    1 dia atrás

    João Pessoa, Brasil Coda Search│Staffing Tempo inteiro

    Get AI-powered advice on this job and more exclusive features. Our client is a U.S.-based company that provides technical expertise, testing, and certification services to the global food and agricultural industry. Their mission is to ensure food safety, quality, and sustainability across international supply chains. This role is critical to building,...

  • Cloud Data Engineering Opportunity

    Há 3 dias

    João Pessoa, Paraíba, Brasil beBeeDataEngineer Tempo inteiro US$10.360 - US$10.720

    Senior Cloud Data Engineer PositionThis role is a senior-level opportunity to work as a Cloud Data Engineer, requiring expertise in Azure tool Stack, including Databricks, ADF, and Synapse Analytics.Primary Responsibilities:Design and implement advanced solutions for complex integrations and data preprocessing tasks.Sustain activities on large-scale data...

  • Senior Data Scientist

    1 dia atrás

    João Pessoa, Brasil BairesDev Tempo inteiro

    Join to apply for the Senior Data Scientist - Remote Work role at BairesDev At BairesDev, we\'ve been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world\'s Top 1% of tech talent, works remotely...

  • Big Data Engineer

    Há 3 dias

    João Pessoa, Paraíba, Brasil HUNT IT - Recrutamento Especializado para TI Tempo inteiro

    Descrição: Big Data EngineerOur Client is a US technology company looking for a highly motivated Data Engineer with a passion for data, to build and implement data pipelines in cloud technologies, including SnapLogic and AWS.Responsibilities:● Develops and maintains scalable data pipelines in SnapLogic and builds out new ETL and API integrations to...

  • Senior Machine Learning Engineer

    Há 23 horas

    João Pessoa, Brasil Loka Tempo inteiro

    Join to apply for the Senior Machine Learning Engineer role at Loka Join to apply for the Senior Machine Learning Engineer role at Loka Get AI-powered advice on this job and more exclusive features. Years from now, history will look back at this moment as a landmark for the human race—the moment when generative artificial intelligence began to change...

  • Senior Data Engineer

    1 dia atrás

    João Pessoa, Brasil Solvd, Inc. Tempo inteiro

    Overview Solvd Inc. is a rapidly growing AI-native consulting and technology services firm delivering enterprise transformation across cloud, data, software engineering, and artificial intelligence . We work with industry-leading organizations to design, build, and operationalize technology solutions that drive measurable business outcomes. Following the...

  • Senior Software Engineer, Data Product

    1 dia atrás

    João Pessoa, Brasil TRM Labs Tempo inteiro

    TRM is on a mission to build a safer financial system for billions of people. We deliver a blockchain intelligence data platform to financial institutions, crypto companies, and governments to fight cryptocurrency fraud and financial crime. We consider our business — and our profit — as a way to move towards our mission sustainably and at scale. The...