Ml Data Pipeline Engineer

2 semanas atrás

Cuiabá, Brasil Prosigliere Tempo inteiro

We're seeking a Data Pipeline Engineer to own and evolve our exercise recognition training data infrastructure. You'll manage the end-to-end pipeline that collects, synchronizes, validates, and prepares IMU sensor and video data for ML model training. This role combines systems engineering, data quality automation, and hands-on problem-solving in a production environment. What You’ll Do Pipeline Operations & Improvement Maintain and enhance our multi-source data collection system: IMU sensors (via mobile app) and synchronized video streams from gym-based cameras. Improve video capture software robustness, particularly handling network interruptions and operational monitoring. Deploy and monitor services in remote Linux environments with appropriate DevOps practices. Data Quality & Validation Evolve our Python-based QC engine that validates data pre- and post-annotation. Implement checks for IMU-video time synchronization, sensor health, and measurement consistency. Apply digital signal processing techniques to identify sensor failures, connectivity issues, and measurement irregularities. Develop validation logic comparing annotations against sensor data to ensure temporal alignment. Analysis & Troubleshooting Perform ad-hoc analysis on ~1,200+ workout tasks to classify failure modes. Identify whether issues stem from pipeline bugs, sensor problems, or annotation errors. Prioritize engineering work based on data quality impact and with annotation team on fixes. Tooling and Visualization Maintain and extend our NextJS UI serving annotators, data scientists, and stakeholders. Create visualizations (Chart.Js) for QC metrics and signal analysis. Integrate with LabelStudio annotation interface. What You Bring Required Strong Python programming skills, particularly for data processing pipelines Experience with time-series data and digital signal processing Comfortable working in Linux environments and deploying / monitoring remote services Ability to debug complex multi-component systems (sensors, video, networks, sync) Data quality mindset: designing validation rules, tracking metrics, investigating anomalies SQL / database experience for managing pipeline metadata Highly Valued Video processing experience (RTSP streams, encoding, OCR) Working with sensor / IoT data and handling connectivity challenges NextJS or modern web frameworks for data tooling DevOps practices: containerization, monitoring, logging, alerting Experience with annotation pipelines and ML training data workflows Background in biomechanics, sports science, or wearable sensors Tech Stack Languages: Python (primary), JavaScript / TypeScript (NextJS UI). Data: IMU sensor streams, video (RTSP), time-series analysis, DSP. Tools: LabelStudio, Chart.Js, Linux / bash, OCR libraries. Infrastructure: Remote deployment, monitoring systems. You’ll Thrive Here If You Enjoy detective work: diagnosing why data doesn't match expectations Balance pragmatism with quality: shipping improvements while maintaining reliability Communicate well across technical and non-technical stakeholders Can work autonomously in a small, mission-driven team #J-18808-Ljbffr

  • Ml Data Pipeline Engineer

    3 semanas atrás

    Cuiabá, Brasil Prosigliere Tempo inteiro

    We're seeking a Data Pipeline Engineer to own and evolve our exercise recognition training data infrastructure. You'll manage the end-to-end pipeline that collects, synchronizes, validates, and prepares IMU sensor and video data for ML model training. This role combines systems engineering, data quality automation, and hands-on problem-solving in a...

  • Ml Data Pipeline Engineer

    2 semanas atrás

    Cuiabá, Brasil Prosigliere Tempo inteiro

    We're seeking a Data Pipeline Engineer to own and evolve our exercise recognition training data infrastructure.You'll manage the end-to-end pipeline that collects, synchronizes, validates, and prepares IMU sensor and video data for ML model training.This role combines systems engineering, data quality automation, and hands-on problem-solving in a production...

  • Data Engineer

    3 semanas atrás

    Cuiabá, Brasil HeartCentrix Solutions Tempo inteiro

    We are seeking a highly skilled Python Data Engineer with an AI / ML focus to join our client’s growing data & analytics team in Brazil. This role is ideal for someone who loves building scalable data pipelines, operationalizing machine learning workflows, and partnering closely with data scientists to bring models into production. You will design,...

  • Data Engineer

    Há 2 dias

    Cuiabá, Brasil Zunzun Solutions Tempo inteiro

    Summary: We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines. In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions. You will play a key role in modernizing our data platform on...

  • Data Engineer

    Há 5 horas

    Cuiabá, Brasil Zunzun Solutions Tempo inteiro

    Summary: We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines. In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions. You will play a key role in modernizing our data platform on...

  • Lead AI Engineer

    4 semanas atrás

    Cuiabá, Brasil GeorgiaTEK Systems Inc. Tempo inteiro

    Lead AI Engineer (3 Positions) Location : Brazil (Remote / Hybrid based on project needs) Role Overview We are seeking highly skilled Lead AI Engineers based in Brazil to design, develop, and deploy scalable AI and machine learning solutions across enterprise systems. The ideal candidates will have strong expertise in Generative AI , RAG architectures , LLMs...

  • Databricks Data Engineer

    Há 2 dias

    Cuiabá, Brasil GlobalSource IT Tempo inteiro

    Databricks Data Engineer Fully Remote Contract We're looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake. This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and...

  • Data Engineer

    Há 5 dias

    Cuiabá, Brasil Ascendion Tempo inteiro

    Overview: We are seeking a highly skilled Data Engineer to support the development of personalized search capabilities and data assimilation initiatives within the organization.This is a remote role aligned to the EST time zone.The ideal candidate will have strong experience working with Python, databricks, and Kafka, and will contribute directly to ongoing...

  • Data Engineer

    Há 6 dias

    Cuiabá, Brasil Ascendion Tempo inteiro

    Overview: We are seeking a highly skilled Data Engineer to support the development of personalized search capabilities and data assimilation initiatives within the organization. This is a remote role aligned to the EST time zone. The ideal candidate will have strong experience working with Python, databricks, and Kafka, and will contribute directly to...

  • Data Engineer

    2 semanas atrás

    Cuiabá, Brasil Design Manager Tempo inteiro

    Job Title: Data Engineer Location: Remote (Brazil) Employment Type: Full TimeCompensation: Competitive hourly rate, commensurate with experienceAbout Design ManagerDesign Manager (+DesignSpec) is a leading provider of project management and accounting software tailored specifically for interior design firms.For over 30 years, we've helped thousands of...