Data Warehouse Architect
Há 2 dias
Databricks Data Warehouse Architect About the role: One of the largest companies in the world in the Gaming industry is seeking a hands-on Data Architect with DataWarehouse Engineer expertise in Databricks (DBX) and AWS-native data services to spearhead the design and implementation of a new data warehouse instance for a major product line. This role will involve building from the ground up—architecting scalable pipelines, optimizing lakehouse performance, and integrating seamlessly with diverse real-time and batch data sources across AWS. The ideal candidate is passionate about data architecture , thrives in fast-moving environments, and has a proven track record of setting up high-performance lakehouse platforms on Databricks with a strong foundation in data warehousing principles . Key Responsibilities: Design and deploy a new Databricks Lakehouse instance tailored to the client's product-level data needs. Architect and implement robust data ingestion pipelines using Spark (PySpark/Scala) and Delta Lake. Integrate AWS-native services (S3, Glue, Athena, Redshift, Lambda) with Databricks for optimized performance and scalability. Define data models, optimize query performance, and establish warehouse governance best practices. Collaborate cross-functionally with product teams, data scientists, and DevOps to streamline data workflows. Maintain CI/CD, preferably DBX for data pipelines using GitOps and Infrastructure-as-Code. Monitor data jobs and resolve performance bottlenecks or failures across environments. Required Skills & Experience: Databricks / Lakehouse Architecture End-to-end setup of Databricks workspaces and Unity Catalog Expertise in Delta Lake internals , file compaction, and schema enforcement Advanced PySpark/SQL skills for ETL and transformations AWS Native Integration Deep experience with AWS Glue , S3 , Redshift Spectrum , Lambda , and Athena IAM and VPC configuration knowledge for secure cloud integrations Data Warehousing & Modeling Strong grasp of modern dimensional modeling (star/snowflake schemas) Experience setting up lakehouse design patterns for mixed workloads Automation & DevOps Familiarity with CI/CD for data engineering using tools like DBX, Terraform, GitHub Actions, or Azure DevOps Proficient in monitoring tools like CloudWatch, Datadog, or New Relic for data pipelines Bonus/Nice to Have: Experience supporting gaming or real-time analytics workloads Familiarity with Airflow , Kafka , or EventBridge Exposure to data privacy and compliance practices (GDPR, CCPA) Other Details: Location : Latin America (LATAM) region - Remote, USA - Remote Length : 1+ Year Client : Gaming giant
-
Data Warehouse Architect
1 dia atrás
São Paulo, SP, Brasil AVM Consulting Inc Tempo inteiroDatabricks Data Warehouse Architect About the role: One of the largest companies in the world in the Gaming industry is seeking a hands-on Data Architect with DataWarehouse Engineer expertise in Databricks (DBX) and AWS-native data services to spearhead the design and implementation of a new data warehouse instance for a major product line. This role will...
-
Data Architect, Analytics Services
Há 11 horas
Mauá, Brasil GFT Technologies Brasil Tempo inteiroJá conhece a GFT? Com mais de 35 anos de mercado e localizada em 16 países, a GFT emprega mais de 12.000 pessoas ao redor do mundo sendo quase 5.000 pessoas no Brasil. Aqui, a diversidade, a igualdade e a inclusão estão no centro e garantir um ambiente de trabalho seguro para todas as pessoas faz parte de quem somos. Promovemos uma cultura de...
-
Data Engineer
2 semanas atrás
São Paulo, SP, Brasil Elios Talent Tempo inteiroData Engineer Highlights Build and maintain pipelines that power data-driven insights Hybrid or remote flexibility High-growth opportunities in cloud and big data technologies Role Summary We are seeking a Data Engineer to architect and maintain data infrastructure that supports analytics and machine learning. This role ensures that high-quality data is...
-
Data Engineer
2 semanas atrás
São Paulo, SP, Brasil Elios Talent Tempo inteiroData Engineer Highlights Build and maintain pipelines that power data-driven insights Hybrid or remote flexibility High-growth opportunities in cloud and big data technologies Role Summary We are seeking a Data Engineer to architect and maintain data infrastructure that supports analytics and machine learning. This role ensures that high-quality data is...
-
Data Architect, Data Lake
2 semanas atrás
São Paulo, SP, Brasil A100 ROW Servicos De Dados Brasil Ltda. Tempo inteiroKnowledge of the primary aws services (ec2, elb, rds, route53 & s3) - Experience implementing AWS services in a variety of distributed computing environments Are you a Data Analytics specialist? Do you have Data Lake/Hadoop experience? Do you like to solve the most complex and high scale (billions + records) data challenges in the world today? Do you like...
-
Sr. Integration Architect
1 semana atrás
São Paulo, SP, Brasil o9 Solutions Tempo inteiroBe part of something revolutionary At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact...
-
Data Architect Data Analytics
3 semanas atrás
Diadema, SP, Brasil Tata Consultancy Services Tempo inteiroCome to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...
-
Industrial Engineer
2 semanas atrás
Guarulhos, SP, Brasil SHEIN Tempo inteiroLocation: GLP Guarulhos II - R. Concretex, 800 - Cumbica, Guarulhos - SP, 07232-050 ABOUT SHEIN SHEIN is a global online fashion and lifestyle retailer, offering SHEIN branded apparel and products from global network of vendors, all at affordable prices. Headquartered in Singapore, SHEIN remains committed to making the beauty of fashion accessible to all,...
-
Mainframe Security Architect
1 semana atrás
Hortolândia, SP, Brasil Kyndryl Tempo inteiroWho We Are At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities. The Role Are...
-
Lead Data Engineer
4 semanas atrás
São Paulo, SP, Brasil Acendeo Tempo inteiroLead Data Engineer Description We are looking for a highly experienced Lead Data Engineer to lead and guide the technical evolution of our enterprise data lake. This role will combine hands-on development, tactical guidance, team leadership, and partner engagement across our technical team. English fluency is a MUST for this role! Only candidates with level...