Data Engineer

3 semanas atrás


Brasil, BR Fidelis Security Tempo inteiro

We are seeking a skilled and experienced Data Engineer to join our Threat Research team. The primary responsibility of this role will be to design, develop, and maintain data pipelines for threat intelligence ingestion, validation, and export automation flows. The ideal candidate will have a strong background in data engineering, experience with data validation techniques, and proficiency in building scalable and efficient data pipelines. The candidate must have extensive experience with SQL, data orchestration tools, Python, and SEIM platforms, with a strong preference for experience in threat intelligence or other cybersecurity applications. Snowflake, AWS, Azure, or Google Bigtable experience is strongly preferred.


Responsibilities:

  • Design, develop, and maintain data pipelines for ingesting threat intelligence data from various sources into our data ecosystem.
  • Implement data validation processes to ensure data accuracy, completeness, and consistency.
  • Collaborate with threat analysts to understand data requirements and design appropriate solutions.
  • Develop automation scripts and workflows for data export processes to external systems or partners.
  • Optimize and enhance existing data pipelines for improved performance and scalability.
  • Monitor data pipelines and troubleshoot issues as they arise, ensuring continuous data availability and integrity.
  • Document technical specifications, data flows, and procedures for data pipeline maintenance and support.
  • Stay updated on emerging technologies and best practices in data engineering and incorporate them into our data ecosystem.
  • Provide technical guidance and support to other team members on data engineering best practices and methodologies.


Requirements:

  • Bachelor's degree in Computer Science, Engineering, or related field.
  • Proven experience as a Data Engineer or similar role, with a focus on data ingest, validation, and export automation.
  • Strong proficiency in Python.
  • Experience with data pipeline orchestration tools such as Apache Airflow, Apache NiFi, or similar.
  • Solid understanding of database systems (relational and NoSQL), data modeling, and SQL. Must demonstrate a strong understanding of SQL queries.
  • Familiarity with cloud platforms such as Snowflake, AWS, Azure, or Google Cloud Platform. Experience with Snowflake is preferred.
  • Experience with data validation techniques and tools for ensuring data quality.
  • Experience building and deploying images using containerization technologies such as Docker and Kubernetes.
  • Strong understanding of Apache Avro or JSON schema validation.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills, with the ability to work effectively in a team environment.

  • Sr. Data Engineer

    4 semanas atrás


    Brasil, BR Amazing Devs Tempo inteiro

    Senior Data Engineer 5+ Years of ExperienceInternational job opportunity!! Only for Brazilians R$ 19.000,00 como PJ (dólar a R$5,00) Project Duration = 3 - 6 mounth❗❗ Required 5+ Years of Experience English - Advanced ✅ SQL✅ ETL❗❗ Description:As a Data Engineer, you will play a pivotal role in ensuring a seamless transition from our existing...

  • Sr. Data Engineer

    3 semanas atrás


    Brasil, BR Amazing Devs Tempo inteiro

    Senior Data Engineer 5+ Years of ExperienceInternational job opportunity!! Only for Brazilians R$ 19.000,00 como PJ (dólar a R$5,00) Project Duration = 3 - 6 mounth FULL TIME❗❗ Required 5+ Years of Experience English - Advanced ✅ Snowflake✅ Python✅ AWS✅ SQL✅ ETL❗❗ Description:As a Data Engineer, you will play a pivotal role in ensuring a...

  • Data Engineer

    4 semanas atrás


    Brasil, BR Voyager Portal Tempo inteiro

    About VoyagerVoyager Portal is a Demurrage & Voyage Management platform that helps some of the biggest traders and manufacturers in the world reduce and optimize shipping costs.Picture the work of an Oil manufacturer managing its maritime supply chain. This involves dealing with a network of shipping companies, cargo handling facilities, ports, and customs &...

  • Data Engineering Manager

    2 meses atrás


    Brasil, BR Solvd, Inc. Tempo inteiro

    Since 2009 Solvd has shaped the quality into the business value of our customers. Originating from a QA company, we are passionate about the user experience for any project we work with. Solvd provides full Software Design, Development and Quality Assurance for your product. We work with emerging companies and leading enterprises in numerous areas: fin-tech,...

  • Senior Data Engineer

    2 semanas atrás


    Brasil, BR DP6 Tempo inteiro

    Nós somos a DP6!Otimizamos a eficiência do Marketing através de Ciência de Dados, Tecnologia e Inovação.Somos uma consultoria de Analytics para Marketing. Por meio de tecnologias de exploração de dados (negócios, marketing, analytics, big data), acompanhamos e analisamos todos os pontos de contato entre consumidor e marcas. Com mais de 14 anos de...

  • Front-end Engineer

    4 semanas atrás


    Brasil, BR K2 Solutions©️ Tempo inteiro

    Engagement type: Full-Time;Minimum of 5years of experience is required for this role;Project location: United States (US);Project timezone: UTC-5:00 America/New_York;Required proficiency in English for speaking, reading, and writing.Responsibilities:Take a leading role in defining and designing web consumer products, overseeing the entire process from...

  • Frontend Engineer

    3 semanas atrás


    Brasil, BR Raidiam Tempo inteiro

    About RaidiamRaidiam is the global organisation at the forefront of data sharing technologies that are changing the world. We believe in empowering everyone to share their data safely, securely and simply; in a trusted and consented way; creating the potential to be seamlessly connected to the products and services they need.Since our inception, Raidiam has...

  • BI Visualization Engineer

    4 semanas atrás


    Brasil, BR Stellantis South America Tempo inteiro

    Key Responsibilities: Collaborate with business stakeholders to understand their data visualization needs and requirements. Design and develop intuitive, interactive BI dashboards and reports using tools like Tableau, Power BI, or similar. Ensure the accuracy and integrity of data presented in visualizations. Optimize and maintain existing BI solutions to...


  • Brasil, BR Foretellix Tempo inteiro

    ***Please send your CV in EnglishWhat will you do:involved in changing the world: develop a validation framework and content for ensuring quality of a revolutionary system for autonomous vehicles.solutions and innovative approaches for complex problems in the SW Validation domain.advanced methods for efficient analyzing of large volumes of datahands-on on...


  • Brasil, BR SAMO Technologies Tempo inteiro

    About the Position:We are looking for a dedicated Backend Engineer to join our dynamic team and contribute to the architecture and development of large-scale projects. This role is ideal for someone who thrives in building robust web services and APIs from scratch, and has a keen interest in the latest backend technologies and tools.Key...

  • Sr Machine Learning IA

    3 semanas atrás


    Brasil, BR Invillia Tempo inteiro

    DESCRIÇÃO DA VAGAAproxime-se. A Invillia não apenas transformou a forma como as empresas mais revolucionárias do mundo criam e desenvolvem estratégias, negócios e produtos digitais.Inovou também a maneira como pessoas apaixonadas por tecnologia, de qualquer lugar do planeta, podem interagir, evoluir, mais conectados do que nunca.Para a Invillia, não...

  • Go Senior Developer

    4 semanas atrás


    Brasil, BR Macher Tecnologia Tempo inteiro

    Macher Tecnologia is recruiting two Backend Developers (Go) with C# experience, to support one of its clients developing software technologies for the transportation industry.As the work will be performed globally, English (business / fluent) is a must-have. The selected professional will join us at our Rio de Janeiro office, on a remote setting, or at Porto...

  • Senior Software Architect

    3 semanas atrás


    Brasil, BR Macher Tecnologia Tempo inteiro

    Macher Tecnologia is recruiting one hands-on Senior Solution Architect to support one of its clients developing software technologies for the transportation industry.As the work will be performed globally, English (business / fluent) is a must-have. The selected professional will join us at our Rio de Janeiro office, on a remote setting. Only candidates from...

  • Product Owner

    3 semanas atrás


    Brasil, BR Kantar IBOPE Media Tempo inteiro

    Já pensou em trabalhar em uma empresa líder global em dados, insights, consultoria e que contribui para o sucesso e crescimento das principais organizações do mundo? Então essa é a sua chance!Quem procuramos: Product Owner The Product Owner (PO) of Atria QC leads and owns the development and performance of Quality Control in data processing stream...

  • HR Junior Analyst

    3 semanas atrás


    Brasil, BR Coesia S.p.A. Tempo inteiro

    About CoesiaCoesia is a group of innovation-based industrial and packaging solutions companies operating globally, headquartered in Bologna, Italy, and fully owned by Isabella Seràgnoli.Coesia's companies are leaders in automation solutions for multiple industries, ranging from automated processing and packaging machinery, testing and vision systems, to...

  • Sr. Data Engineer

    4 semanas atrás


    brasil Amazing Devs Tempo inteiro

    Senior Data Engineer 5+ Years of Experience International job opportunity!! Only for Brazilians

  • Lead Data Engineer

    3 semanas atrás


    brasil Mindera - Brazil Tempo inteiro

    Here at Mindera , we are continuously developing a fantastic team and would love it for you to join us. We are looking for experienced engineers with an appetite for solving complex problems and building seamless user interactions to world-class standards. As a Data Engineer , you will be responsible for building, maintaining, scaling, and integrating big...

  • Lead Data Engineer

    3 semanas atrás


    Brasil Mindera - Brazil Tempo inteiro

    Here at Mindera , we are continuously developing a fantastic team and would love it for you to join us. We are looking for experienced engineers with an appetite for solving complex problems and building seamless user interactions to world-class standards. As a Data Engineer , you will be responsible for building, maintaining, scaling, and integrating...

  • Data Engineer

    3 semanas atrás


    Brasil Fidelis Security Tempo inteiro

    We are seeking a skilled and experienced Data Engineer to join our Threat Research team. The primary responsibility of this role will be to design, develop, and maintain data pipelines for threat intelligence ingestion, validation, and export automation flows. The ideal candidate will have a strong background in data engineering, experience with data...

  • Data Engineer

    3 semanas atrás


    Brasil Fidelis Security Tempo inteiro

    We are seeking a skilled and experienced Data Engineer to join our Threat Research team. The primary responsibility of this role will be to design, develop, and maintain data pipelines for threat intelligence ingestion, validation, and export automation flows. The ideal candidate will have a strong background in data engineering, experience with data...

  • Data Engineer

    3 semanas atrás


    brasil Fidelis Security Tempo inteiro

    We are seeking a skilled and experienced Data Engineer to join our Threat Research team. The primary responsibility of this role will be to design, develop, and maintain data pipelines for threat intelligence ingestion, validation, and export automation flows. The ideal candidate will have a strong background in data engineering, experience with data...

  • Sr. Data Engineer

    4 semanas atrás


    Brasil Amazing Devs Tempo inteiro

    Senior Data Engineer 5+ Years of Experience International job opportunity!! Only for Brazilians 💸 R$ 19.000,00 como PJ (dólar a R$5,00) Project Duration = 3 - 6 mounth ❗❗ Required 👉🏼 5+ Years of Experience 👉🏼 English - Advanced ✅ SQL ✅ ETL ❗❗ Description: As a Data Engineer, you will play a pivotal role in ensuring a seamless...

  • Sr. Data Engineer

    3 semanas atrás


    Brasil Amazing Devs Tempo inteiro

    Senior Data Engineer 5+ Years of Experience International job opportunity!! Only for Brazilians R$ 19.000,00 como PJ (dólar a R$5,00) Project Duration = 3 - 6 mounth FULL TIME ❗❗ Required 5+ Years of Experience English - Advanced ✅ Snowflake ✅ Python ✅ AWS ✅ SQL ✅ ETL ❗❗ Description: As a Data Engineer, you will play...

  • Sr. Data Engineer

    3 semanas atrás


    Brasil Amazing Devs Tempo inteiro

    Senior Data Engineer 5+ Years of Experience International job opportunity!! Only for Brazilians 💸 R$ 19.000,00 como PJ (dólar a R$5,00) Project Duration = 3 - 6 mounth FULL TIME ❗❗ Required 👉🏼 5+ Years of Experience 👉🏼 English - Advanced ✅ Snowflake ✅ Python ✅ AWS ✅ SQL ✅ ETL ❗❗ Description: As a Data Engineer, you will...

  • Sr. Data Engineer

    2 semanas atrás


    Brasil Amazing Devs Tempo inteiro

    Senior Data Engineer 5+ Years of Experience International job opportunity!! Only for Brazilians 💸 R$ 19.000,00 como PJ (dólar a R$5,00) Project Duration = 3 - 6 mounth FULL TIME ❗❗ Required 👉🏼 5+ Years of Experience 👉🏼 English - Advanced ✅ Snowflake ✅ Python ✅ AWS ✅ SQL ✅ ETL ❗❗ Description: As a Data Engineer, you will...

  • Sr. Data Engineer

    2 semanas atrás


    brasil Amazing Devs Tempo inteiro

    Senior Data Engineer 5+ Years of Experience International job opportunity!! Only for Brazilians R$ 19.000,00 como PJ (dólar a R$5,00) Project Duration = 3 - 6 mounth FULL TIME ❗❗ Required 5+ Years of Experience English - Advanced ✅ Snowflake ✅ Python ✅ AWS ✅ SQL ✅ ETL ❗❗ Description: As a Data Engineer, you will...

  • Data Engineer

    3 semanas atrás


    Brasil Wipro Tempo inteiro

    We are one of the largest and leading global technology services, consulting and corporate processes companies in the world. We are present in more than 69 countries and our team is composed of more than 220,000 employees working on six continents. We are technological partners of the largest companies in the world. We proudly serve more than 1500 customers...

  • Data Engineer

    2 semanas atrás


    Brasil Wipro Tempo inteiro

    We are one of the largest and leading global technology services, consulting and corporate processes companies in the world. We are present in more than 69 countries and our team is composed of more than 220,000 employees working on six continents. We are technological partners of the largest companies in the world. We proudly serve more than 1500 customers...

  • Data Engineer

    2 semanas atrás


    brasil Wipro Tempo inteiro

    We are one of the largest and leading global technology services, consulting and corporate processes companies in the world. We are present in more than 69 countries and our team is composed of more than 220,000 employees working on six continents. We are technological partners of the largest companies in the world. We proudly serve more than 1500 customers...

  • Data Engineer

    3 semanas atrás


    brasil Voyager Portal Tempo inteiro

    About Voyager Voyager Portal is a Demurrage & Voyage Management platform that helps some of the biggest traders and manufacturers in the world reduce and optimize shipping costs. Picture the work of an Oil manufacturer managing its maritime supply chain. This involves dealing with a network of shipping companies, cargo handling facilities, ports, and...

  • Data Engineer

    4 semanas atrás


    Brasil Voyager Portal Tempo inteiro

    About Voyager Voyager Portal is a Demurrage & Voyage Management platform that helps some of the biggest traders and manufacturers in the world reduce and optimize shipping costs. Picture the work of an Oil manufacturer managing its maritime supply chain. This involves dealing with a network of shipping companies, cargo handling facilities, ports, and...

  • Data Science Engineer

    4 semanas atrás


    brasil Andela Tempo inteiro

    Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive long-term career opportunities with leading organizations, access to a global community of...

  • Data Science Engineer

    4 semanas atrás


    Brasil Andela Tempo inteiro

    Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive long-term career opportunities with leading organizations, access to a global community of...

  • Data Science Engineer

    2 semanas atrás


    Brasil Andela Tempo inteiro

    Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive long-term career opportunities with leading organizations, access to a global community of...

  • Data Science Engineer

    2 semanas atrás


    brasil Andela Tempo inteiro

    Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive long-term career opportunities with leading organizations, access to a global community of...