Data Warehouse Architect

4 semanas atrás

São Paulo, Estado de São Paulo, Brasil AVM Consulting Inc Tempo inteiro
Databricks Data Warehouse ArchitectAbout the role:

One of the largest companies in the world in the Gaming industry is seeking a hands-on Data Architect with DataWarehouse Engineer expertise in Databricks (DBX) and AWS-native data services to spearhead the design and implementation of a new data warehouse instance for a major product line. This role will involve building from the ground up—architecting scalable pipelines, optimizing lakehouse performance, and integrating seamlessly with diverse real-time and batch data sources across AWS.

The ideal candidate is passionate about data architecture, thrives in fast-moving environments, and has a proven track record of setting up high-performance lakehouse platforms on Databricks with a strong foundation in data warehousing principles.

Key Responsibilities:
  • Design and deploy a new Databricks Lakehouse instance tailored to the client’s product-level data needs.
  • Architect and implement robust data ingestion pipelines using Spark (PySpark/Scala) and Delta Lake.
  • Integrate AWS-native services (S3, Glue, Athena, Redshift, Lambda) with Databricks for optimized performance and scalability.
  • Define data models, optimize query performance, and establish warehouse governance best practices.
  • Collaborate cross-functionally with product teams, data scientists, and DevOps to streamline data workflows.
  • Maintain CI/CD, preferably DBX for data pipelines using GitOps and Infrastructure-as-Code.
  • Monitor data jobs and resolve performance bottlenecks or failures across environments.
Required Skills & Experience:Databricks / Lakehouse Architecture
  • End-to-end setup of Databricks workspaces and Unity Catalog
  • Expertise in Delta Lake internals, file compaction, and schema enforcement
  • Advanced PySpark/SQL skills for ETL and transformations
AWS Native Integration
  • Deep experience with AWS Glue, S3, Redshift Spectrum, Lambda, and Athena
  • IAM and VPC configuration knowledge for secure cloud integrations
Data Warehousing & Modeling
  • Strong grasp of modern dimensional modeling (star/snowflake schemas)
  • Experience setting up lakehouse design patterns for mixed workloads
Automation & DevOps
  • Familiarity with CI/CD for data engineering using tools like DBX, Terraform, GitHub Actions, or Azure DevOps
  • Proficient in monitoring tools like CloudWatch, Datadog, or New Relic for data pipelines
Bonus/Nice to Have:
  • Experience supporting gaming or real-time analytics workloads
  • Familiarity with Airflow, Kafka, or EventBridge
  • Exposure to data privacy and compliance practices (GDPR, CCPA)
Other Details:
  • Location: Latin America (LATAM) region - Remote, USA - Remote
  • Length: 1+ Year

Client: Gaming giant

  • Data Architect

    Há 5 dias

    São Paulo, Estado de São Paulo, Brasil Stellantis South America Tempo inteiro

    Do you like to solve complex and high scale data challenges? Do you like to work in a variety of business environments, through high impact projects that use the newest data analytic technologies transitioning to a modern data stack? We are seeking a highly motivated and experienced individual to join our Global Digital Platforms team at Stellantis as a Data...

  • Middle Data Warehouse Engineer

    1 semana atrás

    São Paulo, São Paulo, Brasil N-iX Tempo inteiro

    We are seeking a motivated Middle Data Warehouse Engineer to join our team. In this role, you will be responsible for developing and maintaining robust data pipelines that drive our business intelligence and analytics.Responsibilities:Design, develop, and maintain ETL (Extract, Transform, Load) processes to move data from various sources to our data...

  • Data Architect

    Há 6 dias

    São Paulo, São Paulo, Brasil Stellantis South America Tempo inteiro

    Do you like to solve complex and high scale data challenges? Do you like to work in a variety of business environments, through high impact projects that use the newest data analytic technologies transitioning to a modern data stack?We are seeking a highly motivated and experienced individual to join our Global Digital Platforms team at Stellantis as a Data...

  • Data Architect

    2 semanas atrás

    São Paulo, São Paulo, Brasil Cognizant Technology Solutions Tempo inteiro

    About the roleAs a Data Architect, you will make a significant impact by designing and implementing scalable solutions aligned with organizational goals and compliance standards. You will collaborate with cross-functional teams to integrate and optimize data platforms, ensuring efficiency and reliability.We are seeking an experienced professional with robust...

  • Data Practice Architect

    2 semanas atrás

    São Paulo, Estado de São Paulo, Brasil Rad Hires Tempo inteiro

    Data Practice Architect (Contract)Remote | LATAM, US, CanadaContract Duration: 3–6 monthsEstimated Workload: 15–30 hours/weekTime Zone: US Central (flexible, outcome-based)About the RoleOur client is building a modern Data Services Practice to complement and strengthen a fast-growing AI portfolio, while also supporting broader software development and...

  • AWS Architect – Glue, Spark

    Há 14 horas

    São Paulo, São Paulo, Brasil Time de Recrutamento Tempo inteiro

    Buscamos um(a) AWS Data Architect Sênior para liderar a arquitetura de soluções de dados em escala global, atuando na construção de pipelines modernos e ambientes analíticos robustos em cloud.Você terá papel estratégico no desenho de arquiteturas de dados orientadas a performance, governança, segurança e escalabilidade, suportando operações...

  • AI Architect

    Há 2 dias

    São Paulo, Estado de São Paulo, Brasil GeorgiaTEK Systems Inc. Tempo inteiro

    AI ArchitectAbout the RoleWe are looking for a Senior AI Architect to define and lead the technical vision of our Artificial Intelligence and Machine Learning platform.This is a hands-on, senior leadership role where you will design the end-to-end architecture that takes AI models from experimentation to reliable, scalable production systems. You will work...

  • Artificial Intelligence Architect

    Há 2 dias

    São Paulo, Estado de São Paulo, Brasil GeorgiaTEK Systems Inc. Tempo inteiro

    Title: Artificial Intelligence Architect Location: Sao Paulo, Brazil (Hybrid)Duration: Long-term ContractThe Role We are seeking a visionary and handson Senior AI Architect to lead the technical design and strategy of our Artificial Intelligence and Machine Learning initiatives In this role you will bridge the gap between Data Science Software Engineering...

  • Solutions Architect

    1 semana atrás

    São Paulo, São Paulo, Brasil ITX Corp Tempo inteiro

    Join ITX as a Solutions Architect – Salesforce FocusAbout the RoleWe are seeking a highly skilled Solution Salesforce Architect to lead the design, development, and delivery of scalable, high-quality solutions on the Salesforce platform. In this role, you will collaborate with business stakeholders, technical teams, and external partners to ensure that our...

  • Tech Lead Data Engineer

    2 semanas atrás

    São Paulo, São Paulo, Brasil Pacifica Continental Tempo inteiro

    Our client is looking for a Data Engineer Tech Lead to join their team in Brazil. The individual will focus on be part of the Data & Analytics team, helping the company to build a global data structure, creating a data platform unifying data from all the products around the world.Responsibilities:Technical leadership of the Data Engineering team;Lead data...