Data Architecture Specialist

1 semana atrás

São Leopoldo, Rio Grande do Sul, Brasil beBeeDistributed Tempo inteiro R$106.080 - R$141.600
Expert Data Architect - Distributed Computing

This challenging role involves leading teams to optimize data product runtime architecture within a cloud-based environment. As an expert in distributed computing, you will drive strategic decision-making and technological advancements.

Key Responsibilities:
  • Refine Spark workloads to enhance performance and resource efficiency, including tuning parameters and re-engineering data processing pipelines.
  • Implement monitoring solutions to detect and diagnose performance bottlenecks or failures in Spark applications.
  • Collaborate with teams to design and build a framework that allows seamless scalability across distributed data environments.
  • Document Spark optimization best practices and conduct training sessions to enhance team expertise.
  • Lead AI-automation initiatives to improve workload scalability and efficiency.
Requirements:
  • Deep understanding of concurrency, fault tolerance, and network latency principles.
  • Comprehensive knowledge of Apache Spark architecture and execution models.
  • Expertise in performance profiling and tuning Spark applications.
  • Proficiency in writing efficient SQL queries and transformations using SparkSQL and DataFrames.
  • Strong debugging skills for runtime issues and environment configurations.
  • Experience with monitoring tools such as Spark's web UI, Ganglia, Grafana, or Prometheus.
  • Understanding of AI and ML trends and their applications in distributed data processing.
  • Excellent leadership, mentorship, and communication skills.
About the Opportunity:

Join a collaborative and inclusive culture focused on innovation, learning, and development. This is an opportunity to bring out your best and be part of a purpose-driven organization.

Inclusion and Equal Opportunity:

We value diversity and are committed to creating an inclusive environment. We are an equal opportunity employer and provide accommodations for applicants with disabilities.

  • Optimize Data Architectures

    2 semanas atrás

    São Leopoldo, Rio Grande do Sul, Brasil beBeeDataOptimization Tempo inteiro US$80.000 - US$123.456

    Unlock Career Growth as a Data Optimization SpecialistAs a Data Optimization Specialist, you will spearhead projects aimed at refining data product runtime architecture within the SAP Business Data Cloud. Your expertise will inform strategic decision-making and drive technological advancements.Key Responsibilities:Analyze and refine Spark workloads to...

  • Senior Data Processing Specialist

    2 semanas atrás

    São Leopoldo, Rio Grande do Sul, Brasil beBeeSpecialist Tempo inteiro R$125.000 - R$175.000

    Senior Data Processing SpecialistWe are seeking a seasoned Senior Data Processing Specialist to lead the optimization of our data product runtime architecture within SAP Business Data Cloud. The successful candidate will drive innovation and strategic decision-making by analyzing and refining Spark workloads to enhance performance and resource efficiency.The...

  • Chief Data Architecture Specialist

    Há 6 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeData Tempo inteiro R$98.765 - R$123.456

    Lead Data EngineerThis role involves delivering high-impact data initiatives by leveraging Oracle expertise and modern AWS cloud capabilities.Maintain a robust infrastructure that combines design, development, and integration of data pipelines, models, and solutions.Optimize database environments for optimal performance, scalability, and availability.Develop...

  • Data Services Specialist

    Há 2 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeDataServices Tempo inteiro R$60.000 - R$113.000

    Job SummaryA Data Services Specialist is required to manage client relationships, develop reporting strategies and provide expert guidance on data management solutions.Key Responsibilities:

  • Optimizing Data Product Runtime Architectures

    2 semanas atrás

    São Leopoldo, Rio Grande do Sul, Brasil beBeeDataCloudEngineer Tempo inteiro US$100.000 - US$150.000

    Job OpportunityWe are seeking a highly skilled Data Cloud Engineer to optimize data product runtime architecture within our cloud-based environment. As a key member of our team, you will analyze Spark workloads, implement monitoring solutions, and collaborate with teams to enhance scalable and efficient data solutions.Key Responsibilities:Analyze Spark...

  • Data Optimization Specialist

    Há 4 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeEngineering Tempo inteiro US$150.000 - US$250.000

    As an Engineering Expert, you will play a key role in leading cutting-edge projects focused on optimizing data product runtime architecture within the Business Data Cloud. Your expertise will drive innovation and strategic decision-making.Key ResponsibilitiesAnalyze and refine Spark workloads to enhance performance and resource efficiency by tuning...

  • Cloud Data Architect Specialist

    2 semanas atrás

    São Leopoldo, Rio Grande do Sul, Brasil beBeeDataEngineering Tempo inteiro US$150.000 - US$200.000

    Cloud Solutions ArchitectWe are a forward-thinking organization dedicated to innovation through collaboration and technological advancement. Our culture fosters employee growth, diversity, and adaptability, with a focus on purpose-driven work.Key Responsibilities:Design comprehensive cloud-native data architectures, encompassing ingestion, storage,...

  • Chief Data Architect

    Há 7 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeData Tempo inteiro R$1.000.000 - R$1.200.000

    Our organization seeks a seasoned data engineering leader to spearhead the design, development, and maintenance of complex data pipelines and integration solutions utilizing Oracle and AWS technologies. As a key member of our team, you will leverage your expertise in data governance, security, and quality standards to ensure the highest level of performance,...

  • Chief Cloud Data Architect

    Há 4 dias

    São Leopoldo, Rio Grande do Sul, Brasil beBeeData Tempo inteiro US$125.000 - US$175.000

    Cloud Data Architect Position OverviewThis role involves driving the future of our fully managed cloud service, focusing on developing a harmonized cloud platform for trusted data insights.The successful candidate will work in a diverse and distributed team to create architecture and technology strategy that meets the needs of business stakeholders.Key...

  • Senior Data Architect

    2 semanas atrás

    São Leopoldo, Rio Grande do Sul, Brasil beBeeDataWarehouse Tempo inteiro R$55.000 - R$76.000

    Data Warehouse DeveloperThis is a fantastic opportunity to work in a global environment on the design, coding, testing and quality assurance of complex data warehouse systems.Design and develop scalable data warehouse architecturesCollaborate with cross-functional teams to integrate SAP DataSphere with BW/4HANAWork closely with customers to migrate their...