Data Engineering Specialist

Há 21 horas

Brasil beBeeDataEngineering Tempo inteiro R$80.000 - R$120.000
Job Title: Data Engineering Specialist

We are seeking a skilled and experienced data engineering specialist to join our team. The primary responsibility of this role will be to design, develop, and maintain data pipelines for threat intelligence ingestion, validation, and export automation flows.

  • Design and develop data pipelines for ingesting threat intelligence data from various sources into our data ecosystem.
  • Implement data validation processes to ensure data accuracy, completeness, and consistency.
  • Collaborate with threat analysts to understand data requirements and design appropriate solutions.
  • Develop automation scripts and workflows for data export processes to external systems or partners.
  • Optimize and enhance existing data pipelines for improved performance and scalability.
  • Monitor data pipelines and troubleshoot issues as they arise, ensuring continuous data availability and integrity.
  • Document technical specifications, data flows, and procedures for data pipeline maintenance and support.
  • Stay updated on emerging technologies and best practices in data engineering and incorporate them into our data ecosystem.
  • Provide technical guidance and support to other team members on data engineering best practices and methodologies.
Requirements:
  • Proven experience as a data engineer or similar role, with a focus on data ingest, validation, and export automation.
  • Strong proficiency in Python programming language.
  • Experience with data pipeline orchestration tools such as Apache Airflow or similar.
  • Familiarity with cloud platforms like Snowflake, AWS, Azure, or Google Cloud Platform.
  • Experience with data validation techniques and tools for ensuring data quality.
  • Experience building and deploying images using containerization technologies like Docker and Kubernetes.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills, with the ability to work effectively in a team environment.
Benefits:
  • Opportunity to work with cutting-edge technologies and contribute to the development of innovative solutions.
  • Collaborative and dynamic work environment with opportunities for growth and professional development.
  • Competitive compensation and benefits package.

  • Data Engineering Specialist

    Há 7 dias

    Brasil beBeeDataEngineering Tempo inteiro R$720.000 - R$1.080.000

    Data Engineering PositionAt WebCreek, we are seeking an experienced Data Engineer with a strong background in data pipelines and models using Azure Databricks, Spark, Python, and SQL.Key Responsibilities:Developing scaleable data pipelines and modelsDesigning high-performance data solutionsMaintaining data quality and integrityRequirements:A minimum of 3...

  • Data Transformation Specialist

    Há 7 dias

    Brasil beBeedatatransformation Tempo inteiro R$60.000 - R$95.000

    Data Transformation SpecialistWe are seeking a skilled Data Transformation Specialist to join our team. As a Data Transformation Specialist, you will be responsible for transforming raw data into actionable insights that drive business growth.Key Responsibilities:Design and implement data transformation processes using Snowflake, DBT, and SQL.Develop and...

  • Data Engineer – Platform Specialist

    Há 7 dias

    Brasil beBeeDataEngineer Tempo inteiro R$40.000 - R$80.000

    Data Engineer – Platform Specialist This is an exceptional opportunity to join a forward-thinking environment where technology and business intersect. The role of the Data Engineer - Platform Specialist involves crafting data-driven solutions using cutting-edge technologies such as PySpark and Databricks. Key ResponsibilitiesDesigning and implementing data...

  • Senior Data Engineering Specialist

    Há 7 dias

    Brasil beBeeDataEngineer Tempo inteiro €90.000 - €120.000

    Unlock a new career path as a skilled data engineer.Our VisionWe're seeking an expert in data engineering to join our team and drive innovation through cutting-edge solutions.Key ResponsibilitiesDesign, implement, and maintain large-scale data processing systems using Pyspark.Collaborate with cross-functional teams to develop and deploy data-driven...

  • Engineering Matching Specialist

    1 dia atrás

    Brasil Album Tempo inteiro

    Join to apply for the Engineering Matching Specialist role at AlbumAbout Andela: Andela Talent Cloud is the industry's only unified solution to manage the complete global talent lifecycle. We help enterprises source, qualify, hire, manage, and pay global technical talent in one integrated platform.About The RoleMatching is about finding exceptional talent...

  • Senior Data Engineering Specialist

    Há 2 dias

    Brasil beBeeDataEngineer Tempo inteiro US$120.000 - US$160.000

    Job Summary:The Data Engineer role is a critical component of our data infrastructure, focusing on building and optimizing scalable ETL/ELT pipelines using Airflow. This position involves designing, implementing, and maintaining efficient data pipelines to support analytics and reporting.Key Responsibilities:Design and implement high-performance ETL/ELT...

  • Data Engineering Lead

    4 semanas atrás

    Brasil BairesDev Tempo inteiro

    Data Engineering Lead (Databricks) - Remote Work:At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant...

  • Data Engineering Visionary

    Há 20 horas

    Brasil beBeeDataEngineeringManager Tempo inteiro R$90.000 - R$120.000

    Join us as a Data Engineering Manager to shape the future of our data landscape. In this key role, you will be responsible for developing and implementing high-performance data pipelines and platforms that meet our business needs.You will oversee development and implementation of data pipelines and platform solutions with quality, reliability, and...

  • Engineering Matching Specialist

    1 dia atrás

    Brasil Andela Tempo inteiro

    About the roleMatching is about finding exceptional talent and connecting them with the perfect client. Our team of experts can quickly identify the specific requirements of our clients, and we work closely with them to develop a customized recruitment strategy that meets their unique needs. We take the time to understand the specific skills and attributes...

  • Data Engineering Opportunities

    Há 2 dias

    Brasil beBeeDataEngineering Tempo inteiro €90.000 - €120.000

    Unlock Your Data Engineering PotentialA leading multinational organization has been operating in Portugal since 2007.We seek an experienced Data Engineer with expertise in Scala and Cloud AWS to join our team.The ideal candidate will have at least 5 years of experience in Data Engineering, fluency in Portuguese and English, and be available for relocation...