Data Warehouse Architect

Há 20 horas

São Paulo, Brasil AVM Consulting Inc Tempo inteiro

Databricks Data Warehouse ArchitectAbout the role:

One of the largest companies in the world in the Gaming industry is seeking a hands-on Data Architect with DataWarehouse Engineer expertise in Databricks (DBX) and AWS-native data services to spearhead the design and implementation of a new data warehouse instance for a major product line. This role will involve building from the ground up—architecting scalable pipelines, optimizing lakehouse performance, and integrating seamlessly with diverse real-time and batch data sources across AWS.

The ideal candidate is passionate about data architecture, thrives in fast-moving environments, and has a proven track record of setting up high-performance lakehouse platforms on Databricks with a strong foundation in data warehousing principles.

Key Responsibilities:

- Design and deploy a new Databricks Lakehouse instance tailored to the client's product-level data needs.
- Architect and implement robust data ingestion pipelines using Spark (PySpark/Scala) and Delta Lake.
- Integrate AWS-native services (S3, Glue, Athena, Redshift, Lambda) with Databricks for optimized performance and scalability.
- Define data models, optimize query performance, and establish warehouse governance best practices.
- Collaborate cross-functionally with product teams, data scientists, and DevOps to streamline data workflows.
- Maintain CI/CD, preferably DBX for data pipelines using GitOps and Infrastructure-as-Code.
- Monitor data jobs and resolve performance bottlenecks or failures across environments.

Required Skills & Experience:Databricks / Lakehouse Architecture

- End-to-end setup of Databricks workspaces and Unity Catalog
- Expertise in Delta Lake internals, file compaction, and schema enforcement
- Advanced PySpark/SQL skills for ETL and transformations

AWS Native Integration

- Deep experience with AWS Glue, S3, Redshift Spectrum, Lambda, and Athena
- IAM and VPC configuration knowledge for secure cloud integrations

Data Warehousing & Modeling

- Strong grasp of modern dimensional modeling (star/snowflake schemas)
- Experience setting up lakehouse design patterns for mixed workloads

Automation & DevOps

- Familiarity with CI/CD for data engineering using tools like DBX, Terraform, GitHub Actions, or Azure DevOps
- Proficient in monitoring tools like CloudWatch, Datadog, or New Relic for data pipelines

Bonus/Nice to Have:

- Experience supporting gaming or real-time analytics workloads
- Familiarity with Airflow, Kafka, or EventBridge
- Exposure to data privacy and compliance practices (GDPR, CCPA)

Other Details:

- Location: Latin America (LATAM) region - Remote, USA - Remote
- Length: 1+ Year

Client: Gaming giant

  • Data Warehouse Architect

    1 dia atrás

    São Paulo, Brasil AVM Consulting Inc Tempo inteiro

    Databricks Data Warehouse ArchitectAbout the role:One of the largest companies in the world in the Gaming industry is seeking a hands-on Data Architect with DataWarehouse Engineer expertise in Databricks (DBX) and AWS-native data services to spearhead the design and implementation of a new data warehouse instance for a major product line. This role will...

  • Data warehouse architect

    Há 9 horas

    São Paulo, Brasil AVM Consulting Inc Tempo inteiro

    Databricks Data Warehouse Architect About the role: One of the largest companies in the world in the Gaming industry is seeking a hands-on Data Architect with Data Warehouse Engineer expertise in Databricks (DBX) and AWS-native data services to spearhead the design and implementation of a new data warehouse instance for a major product line. This role will...

  • Data Warehouse Architect

    Há 21 horas

    São Paulo, Brasil AVM Consulting Inc Tempo inteiro

    Databricks Data Warehouse Architect About the role: One of the largest companies in the world in the Gaming industry is seeking a hands-on Data Architect with DataWarehouse Engineer expertise in Databricks (DBX) and AWS-native data services to spearhead the design and implementation of a new data warehouse instance for a major product line. This role will...

  • Data Warehouse Architect

    Há 10 horas

    são paulo, Brasil AVM Consulting Inc Tempo inteiro

    Databricks Data Warehouse Architect About the role: One of the largest companies in the world in the Gaming industry is seeking a hands-on Data Architect with DataWarehouse Engineer expertise in Databricks (DBX) and AWS-native data services to spearhead the design and implementation of a new data warehouse instance for a major product line. This role will...

  • Data Warehouse Architect

    1 dia atrás

    São Paulo, SP, Brasil AVM Consulting Inc Tempo inteiro

    Databricks Data Warehouse Architect About the role: One of the largest companies in the world in the Gaming industry is seeking a hands-on Data Architect with DataWarehouse Engineer expertise in Databricks (DBX) and AWS-native data services to spearhead the design and implementation of a new data warehouse instance for a major product line. This role will...

  • Data Warehouse Architect

    Há 13 horas

    São Paulo, Brasil AVM Consulting Inc Tempo inteiro

    Databricks Data Warehouse ArchitectAbout the role:One of the largest companies in the world in the Gaming industry is seeking a hands-onData Architect with DataWarehouse Engineerexpertise inDatabricks (DBX)andAWS-native data servicesto spearhead the design and implementation of a new data warehouse instance for a major product line. This role will involve...

  • Data Warehouse Architect

    Há 17 horas

    são paulo, Brasil AVM Consulting Inc Tempo inteiro

    Databricks Data Warehouse ArchitectAbout the role: One of the largest companies in the world in the Gaming industry is seeking a hands-on Data Architect with DataWarehouse Engineer expertise in Databricks (DBX) and AWS-native data services to spearhead the design and implementation of a new data warehouse instance for a major product line. This role will...

  • Data warehouse architect

    Há 9 horas

    São Paulo, Brasil AVM Consulting Inc Tempo inteiro

    Databricks Data Warehouse ArchitectAbout the role:One of the largest companies in the world in the Gaming industry is seeking a hands-onData Architect with Data Warehouse Engineerexpertise inDatabricks (DBX)andAWS-native data servicesto spearhead the design and implementation of a new data warehouse instance for a major product line. This role will involve...

  • Data Warehouse Architect

    Há 2 dias

    São Paulo, São Paulo, Brasil AVM Consulting Inc Tempo inteiro US$80.000 - US$120.000 por ano

    Databricks Data Warehouse ArchitectAbout the role:One of the largest companies in the world in the Gaming industry is seeking a hands-onData Architect with DataWarehouse Engineerexpertise inDatabricks (DBX)andAWS-native data servicesto spearhead the design and implementation of a new data warehouse instance for a major product line. This role will involve...

  • Data Warehouse Architect

    Há 2 dias

    São Paulo, Brasil AVM Consulting Inc Tempo inteiro

    Databricks Data Warehouse ArchitectAbout the role:One of the largest companies in the world in the Gaming industry is seeking a hands-on Data Architect with DataWarehouse Engineer expertise in Databricks (DBX) and AWS-native data services to spearhead the design and implementation of a new data warehouse instance for a major product line. This role will...