Senior Data Architect

Há 18 horas

Manaus, Amazonas, Brasil beBeeDataEngineer Tempo inteiro US$100.000 - US$150.000
Job Title: Data Engineer

Our organization is seeking a skilled and experienced Data Engineer to join our Threat Research team. The primary responsibility of this role will be to design, develop, and maintain data pipelines for threat intelligence ingestion, validation, and export automation flows.

  • Design and Develop Data Pipelines: Design, develop, and maintain data pipelines for ingesting threat intelligence data from various sources into our data ecosystem.
  • Implement Data Validation Processes: Implement data validation processes to ensure data accuracy, completeness, and consistency.
  • Collaborate with Threat Analysts: Collaborate with threat analysts to understand data requirements and design appropriate solutions.
  • Develop Automation Scripts: Develop automation scripts and workflows for data export processes to external systems or partners.
  • Optimize Data Pipelines: Optimize and enhance existing data pipelines for improved performance and scalability.
  • Monitor Data Pipelines: Monitor data pipelines and troubleshoot issues as they arise, ensuring continuous data availability and integrity.
  • Document Technical Specifications: Document technical specifications, data flows, and procedures for data pipeline maintenance and support.
  • Stay Updated on Emerging Technologies: Stay updated on emerging technologies and best practices in data engineering and incorporate them into our data ecosystem.
  • Provide Technical Guidance: Provide technical guidance and support to other team members on data engineering best practices and methodologies.

Requirements:

  • Proven Experience: Proven experience as a Data Engineer or similar role, with a focus on data ingest, validation, and export automation.
  • Strong Proficiency in Python: Strong proficiency in Python programming language.
  • Experience with Data Pipeline Orchestration Tools: Experience with data pipeline orchestration tools such as Apache Airflow, Apache NiFi, or similar technology.
  • Familiarity with Cloud Platforms: Familiarity with cloud platforms including Snowflake, AWS, Azure, or Google Cloud Platform.
  • Experience with Data Validation Techniques: Experience with data validation techniques and tools for ensuring data quality.
  • Experience Building and Deploying Images: Experience building and deploying images using containerization technologies such as Docker and Kubernetes.
  • Excellent Problem-Solving Skills: Excellent problem-solving skills and attention to detail.
  • Strong Communication Skills: Strong communication and collaboration skills, with the ability to work effectively in a team environment.

  • Cloud Data Solutions Architect

    1 dia atrás

    Manaus, Amazonas, Brasil beBeeData Tempo inteiro R$180.000 - R$220.000

    Databricks Data Architect RoleAbout the Position:We are seeking a seasoned Data Architect with expertise in Azure Databricks, Unity Catalog, PySpark, and Delta Live Tables.This role involves leading the design, architecture, and delivery of advanced data solutions, collaborating closely with cross-functional teams to ensure scalable, secure, and...

  • Visionary Data Strategist

    1 semana atrás

    Manaus, Amazonas, Brasil beBeeDataArchitect Tempo inteiro R$120.000 - R$150.000

    Senior Data ArchitectThe role of senior data architect is a high-impact position that requires expertise in designing and building modern data platforms using the Microsoft ecosystem. You will be responsible for leading data strategy and architecture, working closely with engineering teams and business stakeholders to translate needs into technical...

  • Data Architect

    2 semanas atrás

    Manaus, Amazonas, Brasil beBeeData Tempo inteiro R$90.000 - R$120.000

    Our organization is seeking a skilled professional to fill the role of Data Architect. As a key member of our team, you will be responsible for designing and implementing data pipelines and architecture using Snowflake.This position requires strong technical skills, including proficiency in SQL, Python, and orchestration tools. Additionally, experience with...

  • Cloud Data Architect Lead

    1 semana atrás

    Manaus, Amazonas, Brasil beBeeDataEngineering Tempo inteiro R$80.000 - R$120.000

    Cloud Data Architect LeadWe are seeking an experienced Cloud Data Architect to design and implement scalable cloud-based data pipelines. The ideal candidate will have a strong background in AWS and be able to collaborate with cross-functional teams to integrate data from multiple sources.The successful candidate will be responsible for:Designing and...

  • Unlock Your Potential as a Data Architect

    1 dia atrás

    Manaus, Amazonas, Brasil beBeeDataArchitect Tempo inteiro US$78.000 - US$114.000

    Job Title: Data ArchitectThis is a unique opportunity to join our organization as a Data Architect, working on various projects and tasks related to data engineering. As a Data Architect, you will be responsible for designing and implementing solutions for integrations and data preprocessing.The role involves collaborating with different teams to resolve...

  • Expert Data Strategist

    1 semana atrás

    Manaus, Amazonas, Brasil beBeeDataArchitect Tempo inteiro R$13.500

    Join us in seeking a talented Senior Data Architect to spearhead our data strategy and drive business growth.As a senior member of our team, you will be responsible for designing and implementing robust data architectures that meet the evolving needs of our organization.The ideal candidate will possess a deep understanding of relational and non-relational...

  • Chief Data Strategist

    2 semanas atrás

    Manaus, Amazonas, Brasil beBeeDataArchitect Tempo inteiro R$13.500

    Unlock new opportunities in data architecture with our Senior Data Architect role.We are seeking a highly skilled professional to lead the design and implementation of data models that meet our clients' needs.Data Modeling: Develop comprehensive relational and non-relational data models using Oracle, Postgres, and NoSQL databases.Database Expertise: Leverage...

  • Cloud-Driven Senior Data Expert

    1 semana atrás

    Manaus, Amazonas, Brasil beBeeData Tempo inteiro US$50.000 - US$60.000

    Senior Data Architect PositionThe ideal candidate will have experience in designing and evolving scalable data systems, as well as a strong understanding of cloud-based technologies. They should be skilled in building and maintaining modern ETL/ELT pipelines and real-time data flows.Key Responsibilities:Design and implement robust data architectures for...

  • Chief Data Architect

    1 semana atrás

    Manaus, Amazonas, Brasil beBeeDataEngineer Tempo inteiro US$120.000 - US$170.000

    Job Title: Senior Data Engineer Key Responsibilities:Design and implement robust data products that power analytics, reporting, and decision-making.Ingest raw data from diverse source systems using Python and Fivetran, and stage it in BigQuery for consistent and trusted dimensions and metrics.Develop LookML Views and Models to democratize access to data...

  • Strategic Data Pipeline Architect

    1 dia atrás

    Manaus, Amazonas, Brasil beBeeDataEngineer Tempo inteiro R$80.000 - R$150.000

    Senior Data Engineer OpportunityWe are seeking a highly skilled Senior Data Engineer to join our team and lead the design, development, and maintenance of scalable data pipelines on AWS. The successful candidate will be responsible for ensuring high performance, quality, and security across all data systems.Key Responsibilities:Design, develop, and optimize...