Optimize Data Architectures

Há 3 dias

São Leopoldo, Rio Grande do Sul, Brasil beBeeDataOptimization Tempo inteiro US$80.000 - US$123.456
Unlock Career Growth as a Data Optimization Specialist

As a Data Optimization Specialist, you will spearhead projects aimed at refining data product runtime architecture within the SAP Business Data Cloud. Your expertise will inform strategic decision-making and drive technological advancements.

Key Responsibilities:

  • Analyze and refine Spark workloads to enhance performance and resource efficiency by tuning parameters, re-engineering data processing pipelines, and ensuring optimal execution strategies.
  • Implement monitoring solutions to detect and diagnose performance bottlenecks or failures in Spark applications. Resolve complex runtime issues related to resource allocation, execution errors, or data inconsistencies.
  • Collaborate with teams to design and build a framework that allows Business Data Cloud workloads to scale seamlessly across distributed data environments.
  • Create documentation on Spark optimization best practices and conduct training sessions to enhance team expertise.
  • Lead AI-automation initiatives to improve workload scalability and efficiency.
  • Mentor engineering teams and lead cross-functional global collaborations.
Qualifications
  • A deep understanding of distributed computing principles, including concurrency, fault tolerance, and network latency.
  • Comprehensive knowledge of Apache Spark architecture and execution models.
  • Expertise in performance profiling and tuning Spark applications.
  • Proficiency in writing efficient SQL queries and transformations using SparkSQL and DataFrames.
  • Strong debugging skills for runtime issues and environment configurations.
  • Experience with monitoring tools such as Spark's web UI, Ganglia, Grafana, or Prometheus.
  • A solid understanding of AI and ML trends and their applications in distributed data processing.
  • Excellent leadership, mentorship, and communication skills.

  • Data Architecture Specialist

    Há 23 horas

    São Leopoldo, Rio Grande do Sul, Brasil beBeeDistributed Tempo inteiro R$106.080 - R$141.600

    Expert Data Architect - Distributed ComputingThis challenging role involves leading teams to optimize data product runtime architecture within a cloud-based environment. As an expert in distributed computing, you will drive strategic decision-making and technological advancements.Key Responsibilities:Refine Spark workloads to enhance performance and resource...

  • Optimizing Data Product Runtime Architectures

    Há 3 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeDataCloudEngineer Tempo inteiro US$100.000 - US$150.000

    Job OpportunityWe are seeking a highly skilled Data Cloud Engineer to optimize data product runtime architecture within our cloud-based environment. As a key member of our team, you will analyze Spark workloads, implement monitoring solutions, and collaborate with teams to enhance scalable and efficient data solutions.Key Responsibilities:Analyze Spark...

  • Optimize Data Product Runtime Architecture as a Senior Distributed Systems Engineer

    Há 6 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeDistributed Tempo inteiro R$92.646 - R$116.399

    Job TitleWe are seeking a high-caliber Senior Distributed Systems Engineer to lead cutting-edge projects focused on optimizing our data product runtime architecture within SAP Business Data Cloud. Your expertise will drive innovation and strategic decision-making.Key ResponsibilitiesAnalyze and refine Spark workloads to enhance performance and resource...

  • High-Performance Data Optimizer

    Há 3 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeEngineer Tempo inteiro R$104.945 - R$143.860

    Optimize data product runtime architecture within the SAP Business Data Cloud.Key Responsibilities:Analyze and refine Spark workloads, applying advanced performance tuning techniques.Develop comprehensive monitoring strategies for detecting and diagnosing performance bottlenecks.Lead projects to build scalable frameworks for Business Data Cloud...

  • Cloud Architecture Specialist

    Há 6 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeArchitecture Tempo inteiro R$201.663 - R$246.985

    Cloud Architecture ExpertWe are seeking a highly skilled Cloud Architecture Expert to shape the future of our cloud service.Define the general and future architecture for the cloud platform & service.Collaborate with internal stakeholders and business partners to understand scenarios and needs, align concepts & ideas within the unit and across the...

  • Expert Data Solutions Developer

    Há 2 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeData Tempo inteiro R$90.000 - R$121.000

    OverviewJob Title: Cloud Data EngineerAt our organization, we are seeking an experienced Cloud Data Engineer to design, develop, and maintain scalable cloud-based data solutions.">Key Responsibilities:Cloud Architecture Design: We require a skilled engineer to design end-to-end cloud-native data architectures, encompassing ingestion, storage, processing, and...

  • Cloud Data Architect Specialist

    Há 3 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeDataEngineering Tempo inteiro US$150.000 - US$200.000

    Cloud Solutions ArchitectWe are a forward-thinking organization dedicated to innovation through collaboration and technological advancement. Our culture fosters employee growth, diversity, and adaptability, with a focus on purpose-driven work.Key Responsibilities:Design comprehensive cloud-native data architectures, encompassing ingestion, storage,...

  • Business Data Cloud Specialist

    Há 7 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeCloud Tempo inteiro R$55.000 - R$65.000

    We are seeking a skilled professional to join our team as a Business Data Cloud Specialist.Job Description:In this role, you will be responsible for analyzing Spark workloads to refine performance and optimize resource usage under supervision. You will also implement and maintain monitoring solutions for Spark applications, addressing basic performance...

  • Big Data Performance Expert

    Há 3 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeData Tempo inteiro R$80.000 - R$100.000

    High-Performance Engineer PositionBecoming a key contributor driving innovative projects that optimize data product runtime architecture within SAP Business Data Cloud is essential for optimizing the performance of big data processing.Responsibilities:Independently analyze and refine Spark workloads, applying advanced performance tuning techniques to achieve...

  • Data Engineering Expert

    Há 7 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeDataEngineering Tempo inteiro

    Job Title: Data Engineering ExpertAre you an expert in data engineering looking for a new challenge? Do you want to drive innovation and optimize data product runtime architecture within SAP Business Data Cloud?We are seeking a skilled Data Engineering Expert to join our team. As a key contributor, you will be responsible for refining Spark workloads,...