Senior Data Engineer
1 dia atrás
Job Title: Senior Data Engineer (Snowflake & Observability Implementation)Location: LATAM (Remote)Duration: 6 MonthsNeed to work on PST hoursMandatory Skills : SnowflakeDBT, Splunk, OpsGenie, Snowflake + Streamlit, Splunk Dashboards and Version Control & IaCRole OverviewWe are seeking a proactive and hands-on Senior Data Engineer to drive the execution phase of our migration from Amazon Redshift to Snowflake.The architectural design is complete; we need a builder who can code, implement, and operationalize the solution with a heavy focus on Good Governance, Data Quality, and Observability at scale.You will pick up where a previous engagement left off, leveraging DBT for transformations and driving the roadmap for ****.You will work alongside an existing Data Engineer but are expected to lead the implementation with high initiative.Key Responsibilities1. Migration & Transformation ExecutionLead the Implementation: Execute the transition from Redshift to Snowflake based on existing designs.DBT Transformation: Utilize DBT to manage transformations for DMS (Database Migration Service) outputs and ensure seamless data integration.Code & Drive: This is not a passive role.You will be responsible for writing the code, configuring the environment, and driving the project forward to meet **** roadmap goals.Measure Output: Implement metrics to validate and measure the output of DMS processes to ensure accuracy.2. Data Observability & Alerting at ScaleEnterprise Alerting Integration: Operationalize a Proof of Concept (POC) that connects Splunk to OpsGenie.Scale Observability: Deploy observability checks (Freshness, Validity, Volume) across all tables in the ecosystem.Incident Routing: Configure automated workflows to ensure alerts reach the correct contact immediately via OpsGenie.3. Governance & QualityData Governance: Enforce "Good Governance" practices, including rigorous Data Quality (DQ) checks and comprehensive documentation.Change Management: Manage the change process for data pipelines and schema evolution.Advanced DQ Tooling: Operationalize a DQ POC using Atlan, specifically leveraging its natural language capabilities for data discovery and quality management.QualificationsTechnical SkillsSnowflake (Expert): Deep experience with Snowflake architecture and migration patterns (Redshift to Snowflake preferred).DBT (Required): Strong proficiency in DBT for data modeling and transformation.Observability Stack: Hands-on experience with Splunk and OpsGenie (specifically integrating the two for automated alerting).Data Quality Tools: Familiarity with Atlan or similar modern data governance/catalog tools.AWS DMS: Experience handling output from AWS Database Migration Service or similar migration tools.Soft Skills & AttributesHigh Initiative: You are a self-starter who identifies gaps and fixes them without needing constant direction.Execution-Focused: You prefer building and coding over pure theory/design.Communication: Ability to document technical processes clearly for future maintenance.#J-*****-Ljbffr
-
Senior Data Engineer
Há 23 horas
Porto Alegre, Brasil Applaudo Tempo inteiroAbout YouYou are a Senior Data Engineer who enjoys building reliable, scalable data platforms and enabling data-driven and AI-powered products.You feel comfortable owning data pipelines end to end, working closely with analytics and AI / Data Science teams, and translating complex data problems into robust technical solutions.You value clean architecture,...
-
Senior Data Engineer
Há 22 horas
Porto Alegre, Brasil Applaudo Tempo inteiroJob DescriptionAbout YouYou are a Senior Data Engineer who enjoys building reliable, scalable data platforms and enabling data-driven and AI-powered products.You feel comfortable owning data pipelines end to end, working closely with analytics and AI/Data Science teams, and translating complex data problems into robust technical solutions.You value clean...
-
Senior Data Engineer
Há 24 horas
Porto Alegre, Brasil CriticalRiver Inc. Tempo inteiroJob Title: Senior Data Engineer (Snowflake & Observability Implementation)Location: LATAM [Remote] Duration: 6 MonthsNeed to work on PST hoursMandatory Skills : SnowflakeDBT, Splunk, OpsGenie, Snowflake + Streamlit, Splunk Dashboards and Version Control & IaCRole OverviewWe are seeking a proactive and hands-on Senior Data Engineer to drive the execution...
-
Senior Software Engineer
1 semana atrás
Porto Alegre, Brasil WEX Brazil Technology Services Tempo inteiroOverview As WEX continues to scale its Data-as-a-Service (DaaS) platform, the Data Acquisition Team plays a critical role in enabling secure, scalable, and reliable ingestion of data from hundreds of internal systems and external sources. We are looking for a Senior Staff Software Engineer to architect and lead the next evolution of our data acquisition...
-
Sr Data Engineer
1 dia atrás
Porto Alegre, Brasil Unlimitail Tempo inteiroSobre nósA Unlimitail é uma joint venture entre o Grupo Carrefour e o Grupo Publicis, que tem como objetivo atender ao crescente mercado de retail media na Europa e América Latina, desenvolvendo soluções eficazes para as principais necessidades do mercado: vender mais, personalização, oportunidades para as marcas, medição e transparência e...
-
Data Engineer
3 semanas atrás
Porto Alegre, Brasil emagine - Portugal Tempo inteiroProfile: Data / ETL Engineer (AWS) We are looking for a Data / ETL Engineers with strong experience building and operating data pipelines in AWS. Core skills & experience: Solid understanding of relational databases, with strong SQL skills (experience with Microsoft SQL Server preferred) Strong Python development skills, particularly for data processing and...
-
Senior Data Engineer
3 semanas atrás
Porto Alegre, Brasil Jusfy Tempo inteiroA Jusfy está em busca de um Sr Data Engineer para compor o time! Somos uma startup jurídica que busca constantemente soluções para facilitar a vida dos advogados e advogadas brasileiros. Atuamos na área de tecnologia, desenvolvendo produtos e ferramentas que auxiliam na produtividade diária dos nossos clientes. Somos uma empresa jovem e muito...
-
Senior Backend Engineer
1 semana atrás
Porto Alegre, Brasil Aurum Data Solutions Inc. Tempo inteiroLong term Contract Key Responsibilities: Design, develop, and maintain scalable backend services using NestJS and Node.js Build and integrate RESTful and/or GraphQL APIs for frontend and external systems Collaborate closely with frontend engineers using React.js to deliver seamless user experiences Architect and implement cloud-native microservices on Google...
-
Data Engineer
2 semanas atrás
Porto Belo, Brasil Emagine - Portugal Tempo inteiroProfile : Data / ETL Engineer (AWS) We are looking for a Data / ETL Engineers with strong experience building and operating data pipelines in AWS. Core skills & experience : Solid understanding of relational databases, with strong SQL skills (experience with Microsoft SQL Server preferred) Strong Python development skills, particularly for data processing...
-
Data Engineer
1 dia atrás
Porto Alegre, Brasil Jusfy Tempo inteiroA Jusfy está em busca de uma pessoa Data Engineer para compor o time!Somos uma startup jurídica que busca constantemente soluções para facilitar a vida dos advogados e advogadas brasileiros.Atuamos na área de tecnologia, desenvolvendo produtos e ferramentas que auxiliam na produtividade diária dos nossos clientes.Somos uma empresa jovem e muito...