Data Warehouse Architect
3 semanas atrás
Databricks Data Warehouse ArchitectAbout the role: One of the largest companies in the world in the Gaming industry is seeking a hands-on Data Architect with DataWarehouse Engineer expertise in Databricks (DBX) and AWS-native data services to spearhead the design and implementation of a new data warehouse instance for a major product line. This role will involve building from the ground up—architecting scalable pipelines, optimizing lakehouse performance, and integrating seamlessly with diverse real-time and batch data sources across AWS. The ideal candidate is passionate about data architecture, thrives in fast-moving environments, and has a proven track record of setting up high-performance lakehouse platforms on Databricks with a strong foundation in data warehousing principles.
Key Responsibilities: Design and deploy a new Databricks Lakehouse instance tailored to the client's product-level data needs.
Architect and implement robust data ingestion pipelines using Spark (PySpark/Scala) and Delta Lake.
Integrate AWS-native services (S3, Glue, Athena, Redshift, Lambda) with Databricks for optimized performance and scalability.
Define data models, optimize query performance, and establish warehouse governance best practices.
Collaborate cross-functionally with product teams, data scientists, and DevOps to streamline data workflows.
Maintain CI/CD, preferably DBX for data pipelines using GitOps and Infrastructure-as-Code.
Monitor data jobs and resolve performance bottlenecks or failures across environments.
Required Skills & Experience:Databricks / Lakehouse Architecture End-to-end setup of Databricks workspaces and Unity Catalog
Expertise in Delta Lake internals, file compaction, and schema enforcement
Advanced PySpark/SQL skills for ETL and transformations
AWS Native Integration Deep experience with AWS Glue, S3, Redshift Spectrum, Lambda, and Athena
IAM and VPC configuration knowledge for secure cloud integrations
Data Warehousing & Modeling Strong grasp of modern dimensional modeling (star/snowflake schemas)
Experience setting up lakehouse design patterns for mixed workloads
Automation & DevOps Familiarity with CI/CD for data engineering using tools like DBX, Terraform, GitHub Actions, or Azure DevOps
Proficient in monitoring tools like CloudWatch, Datadog, or New Relic for data pipelines
Bonus/Nice to Have: Experience supporting gaming or real-time analytics workloads
Familiarity with Airflow, Kafka, or EventBridge
Exposure to data privacy and compliance practices (GDPR, CCPA)
Other Details: Location: Latin America (LATAM) region - Remote, USA - Remote
Length: 1+ Year
Client: Gaming giant
-
Data Engineer
Há 17 horas
Mossoró, Brasil Zunzun Solutions Tempo inteiroSummary:We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines. In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions. You will play a key role in modernizing our data platform on the...
-
Consultor Advanced Analytics Senior Bi
Há 17 horas
Mossoró, Brasil Capitani Group Tempo inteiroHabilidades TécnicasPower BI Desktop e Service (modelagem, DAX avançado, RLS).Microsoft Fabric (Lakehouse, Data Warehouse, Pipelines).Qlik Sense (desenvolvimento, administração, scripts, Set Analysis, Aggr).Linguagens: SQL, DAX, M (Power Query), script Qlik.Integrações com Azure, APIs REST, ODBC, ferramentas ETL.Noções de Python ou R para análises...
-
Senior Project Manager
Há 6 dias
Mossoró, Brasil Indigo Beam Consulting Tempo inteiroFor Brazil Only, PJ contract, Fluent EnglishJob Title: Senior Project Manager (Software Development)Type: Full-TimeAbout Indigo BeamIndigo Beam is a digital transformation consulting firm dedicated to helping organizations evolve their business through modern technology solutions. We partner with our clients to improve customer experience, reengineer...
-
Analytics Engineer Pleno
2 semanas atrás
Mossoró, Brasil Gran Tempo inteiroEstamos em busca de uma pessoa Engenheira Analítica de Dados Pleno para compor o time de Engenharia AnalíticadoGrane mudar vidas com a gente!OGrané um ecossistema que uneeducaçãoetecnologia , que acelera e customiza o aprendizado para diferentes necessidades e momentos e que já impactou mais de 2 milhões de vidas.Hoje temos 2 verticais principais:a de...
-
Service Desk Engineer
Há 19 horas
Mossoró, Brasil Sycomp Tempo inteiroService Desk Engineer (Latam) Sycomp About the Company Sycomp is a global IT services and logistics provider with extensive expertise in cloud, data center, endpoint management and security solutions. Sycomp’s diverse team of consultants and engineers deliver on the company’s mission to tackle challenging global IT projects through its...