Senior Distributed Computing Specialist

Há 4 dias

São Leopoldo, Rio Grande do Sul, Brasil beBeeDataScientist Tempo inteiro R$109.419 - R$145.236
Lead Innovative Projects

Foster cutting-edge projects to optimize data product runtime architecture within SAP Business Data Cloud. Develop strategic decision-making and technological advancements.

Key Responsibilities:

  • Analyze Spark workloads to enhance performance and resource efficiency, including tuning parameters, re-engineering data processing pipelines, and ensuring optimal execution strategies.
  • Implement monitoring solutions to detect and diagnose performance bottlenecks or failures in Spark applications. Resolve complex runtime issues related to resource allocation, execution errors, or data inconsistencies.
  • Collaborate with cross-functional teams to design and build a scalable framework for distributed data environments.
  • Develop documentation on Spark optimization best practices and conduct training sessions to enhance team expertise.
  • Drive AI-automation initiatives to improve workload scalability and efficiency.
  • Provide mentorship and lead global collaborations.

Requirements:

  • Deep understanding of distributed computing principles, including concurrency, fault tolerance, and network latency.
  • Comprehensive knowledge of Apache Spark architecture and execution models.
  • Expertise in performance profiling and tuning Spark applications.
  • Proficiency in writing efficient SQL queries and transformations using SparkSQL and DataFrames.
  • Strong debugging skills for runtime issues and environment configurations.
  • Experience with monitoring tools such as Ganglia, Grafana, or Prometheus.
  • Understanding of AI and ML trends and their applications in distributed data processing.
  • Excellent leadership, mentorship, and communication skills.

About the Company

We foster a collaborative and inclusive culture focused on innovation, learning, and development.

  • Senior Data Processing Specialist

    Há 2 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeSpecialist Tempo inteiro R$125.000 - R$175.000

    Senior Data Processing SpecialistWe are seeking a seasoned Senior Data Processing Specialist to lead the optimization of our data product runtime architecture within SAP Business Data Cloud. The successful candidate will drive innovation and strategic decision-making by analyzing and refining Spark workloads to enhance performance and resource efficiency.The...

  • Optimize Data Product Runtime Architecture as a Senior Distributed Systems Engineer

    Há 2 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeDistributed Tempo inteiro R$92.646 - R$116.399

    Job TitleWe are seeking a high-caliber Senior Distributed Systems Engineer to lead cutting-edge projects focused on optimizing our data product runtime architecture within SAP Business Data Cloud. Your expertise will drive innovation and strategic decision-making.Key ResponsibilitiesAnalyze and refine Spark workloads to enhance performance and resource...

  • Business Data Cloud Specialist

    Há 4 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeCloud Tempo inteiro R$55.000 - R$65.000

    We are seeking a skilled professional to join our team as a Business Data Cloud Specialist.Job Description:In this role, you will be responsible for analyzing Spark workloads to refine performance and optimize resource usage under supervision. You will also implement and maintain monitoring solutions for Spark applications, addressing basic performance...

  • Senior Data Integration Specialist

    Há 4 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeDataIntegration Tempo inteiro

    Job Title: Senior Data Integration SpecialistWe are seeking a highly skilled and experienced Senior Data Integration Specialist to join our team. This role will be responsible for designing, building, and maintaining large-scale data integration solutions using various technologies.The ideal candidate will have a strong background in ETL development, data...

  • Quality Assurance Specialist

    Há 4 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeQuality Tempo inteiro R$10.800 - R$12.444

    Job Title: Quality Assurance SpecialistJob Description:The role of a quality assurance specialist is to ensure that software products meet the required standards of quality. This involves conducting root-cause analysis for issues, proposing improvement actions, and monitoring product and software quality key performance indicators (KPIs).Collaborate with...

  • Senior Engineer

    Há 15 horas

    São Leopoldo, Rio Grande do Sul, Brasil SAP Tempo inteiro

    OverviewSenior Engineer - Business Data Cloud - Data Product Runtime Team at SAP.Become a key contributor driving innovative projects that optimize data product runtime architecture within SAP Business Data Cloud, and support performance and scalability solutions.Posted 1 day ago.Be among the first 25 applicants.ResponsibilitiesIndependently analyze and...

  • Senior Data Architect

    Há 2 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeData Tempo inteiro R$63.420 - R$101.505

    Spearheading Data Optimization InitiativesAbout the Role:We are seeking a seasoned data expert to spearhead efforts in optimizing data product runtime architecture within our Business Data Cloud. This role will involve driving innovative projects and supporting performance and scalability solutions.Key Responsibilities:Analyze and refine Spark workloads,...

  • Senior Engineer

    Há 2 dias

    São Leopoldo, Rio Grande do Sul, Brasil SAP Tempo inteiro

    Overview Senior Engineer - Business Data Cloud - Data Product Runtime Team at SAP. Become a key contributor driving innovative projects that optimize data product runtime architecture within SAP Business Data Cloud, and support performance and scalability solutions. Posted 1 day ago. Be among the first 25 applicants. Responsibilities Independently...

  • Cloud Data Architect

    Há 4 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeDataEngineering Tempo inteiro R$120.000 - R$150.000

    Cloud Data EngineerWe are looking for a skilled Cloud Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data systems that support our business applications.Your primary focus will be on building and optimizing cloud-based data pipelines using Apache...

  • Senior Technical Leader

    Há 4 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeDataOptimizer Tempo inteiro R$134.964 - R$163.159

    Job Opportunity">We are seeking a seasoned professional to drive innovative projects that optimize data product runtime architecture within the cloud. As a key contributor, you will utilize your advanced skills to support impactful performance and scalability solutions.">Responsibilities:">">Analyze and refine Spark workloads using advanced performance...