Scalable Data Pipeline Architect

Há 3 dias

Brasil beBeeDataEngineer Tempo inteiro

Data Engineer We are seeking an experienced Data Engineer with a strong background in AI and ML to design, develop, and maintain scalable data pipelines that power AI-driven insights across our organization. This role is ideal for someone who loves building data infrastructure that integrates data from various sources, including APIs, databases, cloud storage, and streaming platforms. The successful candidate will work closely with cross-functional teams to deploy, monitor, and tune machine learning models, ensuring accuracy, scalability, and reliability. Key Responsibilities: Design and implement ETL/ELT pipelines using Python and modern data engineering frameworks. Architect and manage data workflows, ensuring accuracy, scalability, and reliability. Work closely with data scientists to deploy, monitor, and tune machine learning models. Develop feature engineering pipelines, preprocessing workflows, and model-serving APIs. Integrate data from various sources (APIs, databases, cloud storage, streaming platforms). Implement MLOps best practices, including versioning, CI/CD for ML, and automated retraining workflows. Optimize data storage, compute usage, and performance within Snowflake and cloud-native tools. Create and maintain documentation, data catalogs, and operational guides. Monitor data system performance and recommend improvements. Required Skills & Experience: 3–7+ years of experience as a Data Engineer or similar backend/data role. Strong proficiency in Python, including building production-grade data pipelines. Experience with Snowflake—data modeling, Snowpipe, tasks, streams, stored procedures, and performance optimization. Experience with AI/ML workflows: feature engineering, inference pipelines, or deploying models. Proficiency in SQL and relational databases (PostgreSQL, MySQL, SQL Server). Hands-on experience with at least one cloud platform (AWS, GCP, or Azure). Experience using data orchestration tools like Airflow, Prefect, or Dagster. Familiarity with MLOps tools such as MLflow, Kubeflow, SageMaker, Vertex AI, or similar. Strong understanding of data modeling, data warehousing, and distributed systems. Preferred Qualifications: Experience with Spark, Databricks, or other big-data processing tools. Experience ingesting and transforming data at scale on Snowflake, including optimization of virtual warehouses. Familiarity with Kafka, Kinesis, or other streaming platforms. Understanding of CI/CD pipelines (GitHub Actions, GitLab CI, Jenkins, etc.). Exposure to deep learning frameworks (TensorFlow, PyTorch). Experience working with LATAM distributed engineering teams.

  • Data Architect

    Há 3 dias

    Brasil beBeeData Tempo inteiro

    Chief Data Architect We are seeking a seasoned Data Architect to spearhead the design and implementation of cutting-edge data architectures on Google Cloud Platform (GCP). The ideal candidate will have extensive experience with data engineering, architecture, and management. This role involves leading cross-functional teams in the development and...

  • Data Architect

    Há 2 dias

    Brasil beBeeData Tempo inteiro

    Chief Data Architect We are seeking a seasoned Data Architect to spearhead the design and implementation of cutting-edge data architectures on Google Cloud Platform (GCP). The ideal candidate will have extensive experience with data engineering, architecture, and management. This role involves leading cross-functional teams in the development and...

  • Data Pipeline Architect

    Há 6 dias

    Brasil beBeeDevelopment Tempo inteiro

    Full Stack Developer We are seeking a highly skilled Full Stack Developer to join our team. Design, develop, and maintain scalable data pipelines using Databricks. Integrate Databricks workflows into broader application architecture. Collaborate with cross-functional teams to deliver cloud-native solutions. Implement application features using AWS services...

  • Building Scalable Data Pipelines

    3 semanas atrás

    Brasil beBeeDataEngineer Tempo inteiro

    Cloud Engineer Job Opportunity As a skilled cloud engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines using Databricks. This involves integrating Databricks workflows into broader application architecture and collaborating with cross-functional teams to deliver cloud-native solutions. Key responsibilities...

  • Data Systems Architect

    3 semanas atrás

    Brasil beBeeArchitect Tempo inteiro

    Job Description We are seeking a highly skilled Data Systems Architect to join our Mobile Applications department. As a key member of our team, you will design and build scalable data pipelines that ingest and transform data from various sources, ensuring seamless integration with our centralized stores. Key Responsibilities: Data Infrastructure & Pipelines:...

  • Data warehouse architect

    3 semanas atrás

    Brasil AVM Consulting Inc Tempo inteiro

    Databricks Data Warehouse Architect About the role: One of the largest companies in the world in the Gaming industry is seeking a hands-on Data Architect with Data Warehouse Engineer expertise in Databricks (DBX) and AWS-native data services to spearhead the design and implementation of a new data warehouse instance for a major product line. This role will...

  • Cloud Data Architect

    Há 2 dias

    Brasil beBeeData Tempo inteiro

    Cloud Data Architect We are seeking a skilled Cloud Data Architect to design and implement end-to-end data architecture solutions on Microsoft Azure for premier enterprise customers. Develop comprehensive data strategies leveraging cloud-first environments. Design, implement, and manage ETL/ELT pipelines using Azure Data Factory. Architect and optimize Data...

  • Cloud Data Architect

    1 semana atrás

    Brasil beBeeSolution Tempo inteiro

    Exadel seeks a Snowflake Solution Architect to work as an independent contractor for a U.S.-based education services provider. English is mandatory due to international reporting requirements. Key Responsibilities Implement and maintain Medallion architecture in Snowflake for robust dimensional data modeling. Define and oversee data transformation processes...

  • Cloud Data Architect

    2 semanas atrás

    Brasil beBeeSolution Tempo inteiro

    Exadel seeks a Snowflake Solution Architect to work as an independent contractor for a U.S.-based education services provider. English is mandatory due to international reporting requirements. Key Responsibilities Implement and maintain Medallion architecture in Snowflake for robust dimensional data modeling. Define and oversee data transformation processes...

  • Big Data Solutions Architect

    Há 2 dias

    Brasil beBeeData Tempo inteiro

    Job Title Enterprise Data Architect We are seeking an experienced and skilled Enterprise Data Architect to join our team. As a key member of the data engineering team, you will be responsible for designing, implementing, and optimizing enterprise-grade data pipelines. Key Responsibilities: Design and develop scalable, governed, and performant data solutions...