
Data Pipeline Architect
Há 19 horas
Data Engineering SpecialistOur organization is seeking a skilled and experienced Data Engineer to join our Threat Research team.
The primary responsibility of this role will be to design, develop, and maintain data pipelines for threat intelligence ingestion, validation, and export automation flows.Responsibilities:Design, develop, and maintain data pipelines for ingesting threat intelligence data from various sources into our data ecosystem.Implement data validation processes to ensure data accuracy, completeness, and consistency.Collaborate with threat analysts to understand data requirements and design appropriate solutions.Develop automation scripts and workflows for data export processes to external systems or partners.Optimize and enhance existing data pipelines for improved performance and scalability.Monitor data pipelines and troubleshoot issues as they arise, ensuring continuous data availability and integrity.Document technical specifications, data flows, and procedures for data pipeline maintenance and support.Stay updated on emerging technologies and best practices in data engineering and incorporate them into our data ecosystem.Provide technical guidance and support to other team members on data engineering best practices and methodologies.Requirements:Proven experience as a Data Engineer or similar role, with a focus on data ingest, validation, and export automation.Strong proficiency in Python.Experience with data pipeline orchestration tools such as Apache Airflow, Apache NiFi, or similar.Familiarity with cloud platforms such as Snowflake, AWS, Azure, or Google Cloud Platform.Experience with data validation techniques and tools for ensuring data quality.Experience building and deploying images using containerization technologies such as Docker and Kubernetes.Excellent problem-solving skills and attention to detail.Strong communication and collaboration skills, with the ability to work effectively in a team environment.
-
Databricks Data Architect
Há 3 dias
Ituiutaba, Brasil Celebal Technologies Tempo inteiroJob Title: Solution Architect – Databricks Location: Remote Work 12 months About the Role Celebal Technologies is seeking an experienced Data Architect with deep expertise in Azure Databricks, Unity Catalog, PySpark, and Delta Live Tables .In this role, you will lead the design, architecture, and delivery of advanced data solutions, collaborating closely...
-
Data Pipeline Expert
Há 19 horas
Ituiutaba, Brasil Bebeedata Tempo inteiroExpert Data Pipeline ArchitectWe are seeking a seasoned expert to craft and maintain scalable data pipelines on AWS, ensuring optimal performance, quality, and security.Key Responsibilities:Develop and optimize Extract-Transform-Load (ETL) pipelines with AWS Glue.Collaborate with data scientists and analysts to integrate data from multiple sources and...
-
Senior Data Pipeline Specialist
Há 19 horas
Ituiutaba, Brasil Bebeedataengineer Tempo inteiroTransforming global data to drive business forward.A strategic Data Engineer is required to build, maintain, and modernize complex data pipelines processing large-scale regulatory information from around the world.The successful candidate will work with Python, SQL, and related tools to untangle legacy code, migrate processes to maintainable platforms like...
-
Data Architect
Há 19 horas
Ituiutaba, Brasil Bebeedata Tempo inteiroJob Title:Lead Data ArchitectKey Responsibilities:The project focuses on developing and implementing advanced data architectures to solve complex business problems.Designing scalable data systems for the ingestion, processing, and storage of large datasets in a cloud environment.Building performant data pipelines to transform raw data into actionable...
-
Chief Data Architect
Há 19 horas
Ituiutaba, Brasil Bebeedataengineer Tempo inteiroProject OverviewWe are seeking an experienced Data Engineer to join our team.The primary goal of this project is to design and implement a solution for processing big data volumes, integrating it with the current architecture.The successful candidate will be responsible for designing and implementing a robust and scalable ETL/ELT pipeline, extracting,...
-
Senior Data Architect
Há 19 horas
Ituiutaba, Brasil Bebeedataengineer Tempo inteiroExperience a career that truly lasts a lifetime with our technology consulting firm.We're dedicated to supporting our employees' professional growth and offering an exceptional work environment that fosters meaningful connections and shared success.With over 12 years of experience in the market, we've built a strong presence across 20+ countries, employing...
-
Data Analytics Consultant
Há 3 dias
Ituiutaba, Brasil 205 Data Lab Tempo inteiro205 Data Lab is a specialty data analytics services firm serving several fast-growing technology companies in the United States.We are headquartered in the United States, and our team members work remotely from multiple countries.We focus on the following aspects of the data value chain: Data Engineering Analytics Engineering (data modeling and SQL-based...
-
Cloud Solutions Architect
Há 19 horas
Ituiutaba, Brasil Bebeecloud Tempo inteiroCloud Solutions ArchitectWe are seeking a talented Cloud Solutions Architect to join our team.This role involves designing, developing and maintaining scalable cloud-native applications on Microsoft Azure platform.You will be responsible for architecting and implementing microservices using Azure services like App Service, Functions, Container Instances and...
-
Transformative Data Engineer
Há 19 horas
Ituiutaba, Brasil Bebeedataengineer Tempo inteiroJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team.As a key member of our data engineering group, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using Snowflake, DBT, and SQL.Key Responsibilities:Design and implement data pipelines that extract, transform, and load data from...
-
Data Engineer
Há 3 dias
Ituiutaba, Brasil Insight Global Tempo inteiroRequired Skills & Experience 4+ years of data engineering experience - building data warehouses and ETL pipelines 3+ years of experience with Snowflake Datawarehouse Strong Python scripting experience Well versed with data marts Strong understanding of SQL including: SSIS, SSAS, & SSRS Ability to work MST hours Nice to Have Skills & Experience Experience...