Sr. Data Architect

1 dia atrás


Alagoas, Brasil buscojobs Brasil Tempo inteiro
Overview

A senior Data Engineer to design and maintain scalable data pipelines on AWS, ensuring performance, quality, and security. You will collaborate with data scientists and analysts to integrate data from multiple sources and support AI/ML initiatives.

Key Responsibilities
  • Build and optimize ETL pipelines with AWS Glue.
  • Work with AWS S3, Glue, and SageMaker for data and AI workflows.
  • Develop solutions in Python and SQL.
  • Integrate data from Salesforce and APIs.
  • Ensure data governance, documentation, and best practices.
  • AWS (S3, Glue, SageMaker)
  • Python, SQL
Requirements
  • Proven experience in data engineering with AWS.
  • Experience with ETL, data modeling, and pipeline optimization.
  • Advanced English (international collaboration).
What You Will Do
  • Designing performant data pipelines for the ingestion and transformation of complex datasets into usable data products.
  • Building scalable infrastructure to support hourly, daily, and weekly update cycles.
  • Implementing automated QA checks and monitoring systems to catch data anomalies before they reach clients.
  • Re-architecting system components to improve performance or reduce costs.
  • Supporting team members through code reviews and collaborative development.
  • Building enterprise-grade batch and real-time data processing pipelines on AWS, with a focus on serverless architectures.
  • Designing and implementing automated ELT processes to integrate disparate datasets.
  • Collaborating across multiple teams to ingest, extract, and process data using Python, R, Zsh, SQL, REST, and GraphQL APIs.
  • Transforming clickstream and CRM data into meaningful metrics and segments for visualization.
  • Creating automated acceptance, QA, and reliability checks to ensure business logic and data integrity.
  • Designing appropriately normalized schemas and making informed decisions between SQL and NoSQL solutions.
  • Optimizing infrastructure and schema design for performance, scalability, and cost efficiency.
  • Defining and maintaining CI/CD and deployment pipelines for data infrastructure.
  • Containerizing and deploying solutions using Docker and AWS ECS.
  • Proactively identifying and resolving data discrepancies, and implementing safeguards to prevent recurrence.
  • Contributing to documentation, onboarding materials, and cross-team enablement efforts.
What You Will Bring
  • Bachelor's degree in Computer Science, Software Engineering, or a related field; additional training in statistics, mathematics, or machine learning is a strong plus.
  • 5+ years of experience building scalable and reliable data pipelines and data products in a cloud environment (AWS preferred).
  • Deep understanding of ELT processes and data modeling best practices.
  • Strong programming skills in Python or a similar scripting language.
  • Advanced SQL skills, with intermediate to advanced experience in relational database design.
  • Familiarity with joining and analyzing large behavioral datasets, such as Adobe and GA4 clickstream data.
  • Excellent problem-solving abilities and strong attention to data accuracy and detail.
  • Proven ability to manage and prioritize multiple initiatives with minimal supervision.
Nice to Have
  • Experience working with data transformation tools such as Data Build Tool or similar technologies.
  • Familiarity with Docker containerization and orchestration.
  • Experience in API design or integration for data pipelines.
  • Development experience in a Linux or Mac environment.
  • Exposure to data QA frameworks or observability tools (e.g., Great Expectations, Monte Carlo, etc.).
What We Offer
  • 100% Remote Work
  • WFH allowance: Monthly payment as financial support for remote working.
  • Career Growth: Career development program with 360º feedback.
  • Training: Time allocated for tech training, English classes, books, conferences, and events.
  • Mentoring Program: You can mentor or receive mentorship, or both.
  • Zartis Wellbeing Hub (Kara Connect): Access to sessions with health and wellness professionals.
  • Multicultural working environment: Tech events, webinars, and team-building activities.
About The Role

We are seeking experienced Data Engineers to develop and deliver robust, cost-efficient data products that power analytics, reporting and decision-making across two distinct brands.

What You'll Do

  • Build highly consumable and cost-efficient data products by synthesizing data from diverse source systems.
  • Ingest raw data using Fivetran and Python, staging and enriching it in BigQuery to provide consistent, trusted dimensions and metrics for downstream workflows.
  • Design, maintain, and improve workflows that ensure reliable and consistent data creation, proactively addressing data quality issues and optimizing for performance and cost.
  • Develop LookML Views and Models to democratize access to data products and enable self-service analytics in Looker.
  • Deliver ad hoc SQL reports and support business users with timely insights.
  • (Secondary) Implement simple machine learning features into data products using tools like BQML.
  • Build and maintain Looker dashboards and reports to surface key metrics and trends.
What We're Looking For
  • Proven experience building and managing data products in modern cloud environments (GCP preferred).
  • Strong proficiency in Python for data ingestion and workflow development.
  • Hands-on expertise with BigQuery, dbt, Airflow and Looker.
  • Solid understanding of data modeling, pipeline design and data quality best practices.
  • Excellent communication skills and a track record of effective collaboration across technical and non-technical teams.

#J-18808-Ljbffr

  • Alagoas, Brasil beBeeEngineering Tempo inteiro R$1.300.000 - R$1.600.000

    Data Engineering and Architecture ExpertReplicats is building AI-powered autonomous investment agents that bring institutional-grade portfolio management to everyone. Our architecture combines advanced quant models, real-time data processing, smart contract vaults, and conversational LLMs into a scalable platform capable of running 100k+ agents in...


  • Alagoas, Brasil beBeeDataEngineering Tempo inteiro R$100.000 - R$130.000

    Key ResponsibilitiesAs a Data Engineer, you will be responsible for designing and implementing data solutions that drive business growth and improvement.Designing and developing ETL processes: Extract, transform, and load data from various sources to ensure seamless data flow.Building and maintaining data infrastructure: Design and develop scalable data...


  • Alagoas, Brasil beBeeTechnical Tempo inteiro R$90.000 - R$120.000

    Job Title:Technical ArchitectAbout the Role:We're seeking an experienced technical architect to lead the design and implementation of our core infrastructure. The successful candidate will have a strong background in backend and data engineering, with expertise in distributed systems and real-time streaming.Responsibilities:Design and implement resilient...


  • Alagoas, Brasil buscojobs Brasil Tempo inteiro

    Position SummaryOur partner, an international digital solutions provider focused on custom software development and digital transformation, is growing fast. With that growth comes more opportunities than the current sales team can handle on their own. They are looking for a Client Solutions Engagement Analyst to lead the first phase of the client journey....

  • Analista Executivo

    Há 2 dias


    Alagoas, Brasil beBeeDesenvolvimento Tempo inteiro R$59.000 - R$86.000

    Desenvolvedor Sr De Gestão E AnalyticsO ideal candidato deve ter experiência em análise de dados avançada e habilidades em ferramentas como Excel e Power BI para fornecer insights valiosos à empresa. A posição envolve apoiar na elaboração de simulações de mercado, criar relatórios gerenciais e realizar a gestão do orçamento da Vice-Presidência...


  • Alagoas, Brasil beBeeSolution Tempo inteiro R$55.000 - R$85.000

    Job OverviewWe are seeking an experienced solutions architect to lead our client engagement process from initial conversations to proposal creation.Key ResponsibilitiesConduct client discovery and whiteboard sessions in collaboration with a technical lead.Translate ambiguous client needs into clear, actionable requirements.Build strong relationships with...


  • Alagoas, Brasil buscojobs Brasil Tempo inteiro

    Arapiraca, Alagoas INDI Staffing ServicesHojeAt INDI, we're passionate about empowering individuals and businesses worldwide. Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovation thrives. Join us in shaping the future of work.Data AnalystArapiraca, Alagoas IFIT SolutionsLooking for two Data...


  • Alagoas, Brasil buscojobs Brasil Tempo inteiro

    Arapiraca, Alagoas INDI Staffing ServicesHojeAt INDI, we're passionate about empowering individuals and businesses worldwide. Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovation thrives. Join us in shaping the future of work.Data AnalystArapiraca, Alagoas IFIT SolutionsLooking for two Data...


  • Alagoas, Brasil buscojobs Brasil Tempo inteiro

    Vis e3o geralA Bold Hospitality Company e9 a holding respons e1vel pelas marcas Outback, Abbraccio e Aussie no Brasil. Temos 27 anos de experi eancia e reconhecimento, mas a energia renovada de quem come e7ou sua jornada: no final de 2024, nos tornamos uma empresa nacional, que nasceu da uni e3o de dois S f3cios - Vinci Compass e Bloomin' Brands Inc.O...


  • Alagoas, Brasil buscojobs Brasil Tempo inteiro

    Vis e3o geral A Bold Hospitality Company e9 a holding respons e1vel pelas marcas Outback, Abbraccio e Aussie no Brasil. Temos 27 anos de experi eancia e reconhecimento, mas a energia renovada de quem come e7ou sua jornada: no final de 2024, nos tornamos uma empresa nacional, que nasceu da uni e3o de dois S f3cios - Vinci Compass e Bloomin' Brands Inc. O...