The Ideal Candidate for Our Data Infrastructure

Há 9 horas

Brasil beBeeDataPipelineExpert Tempo inteiro

Data Pipeline Expert Wanted Our organization seeks a skilled Data Pipeline Engineer to create, maintain and optimize the data pipeline infrastructure. The ideal candidate will design, develop, deploy, and monitor a comprehensive system that collects, synchronizes, validates, and prepares IMU sensor and video data for machine learning model training. The role combines technical expertise in systems engineering, data quality automation, and hands-on problem-solving in a production environment. You'll be responsible for managing end-to-end pipelines, ensuring seamless integration of various components, and collaborating with cross-functional teams to drive business outcomes. Key Responsibilities Design and implement a robust data collection system incorporating IMU sensors via mobile apps and synchronized video streams from gym-based cameras. Enhance video capture software reliability, particularly handling network interruptions and operational monitoring. Develop and deploy services in remote Linux environments using DevOps practices. Evolving the Python-based QC engine to validate data pre- and post-annotation. Implementing checks for IMU-video time synchronization, sensor health, and measurement consistency. Applying digital signal processing techniques to identify sensor failures, connectivity issues, and measurement irregularities. Developing validation logic comparing annotations against sensor data to ensure temporal alignment. Performing ad-hoc analysis on ~1,200+ workout tasks to classify failure modes. Identifying whether issues stem from pipeline bugs, sensor problems, or annotation errors. Prioritizing engineering work based on data quality impact and coordinating with annotation team on fixes. Maintaining and extending our NextJS UI serving annotators, data scientists, and stakeholders. Creating visualizations for QC metrics and signal analysis. Integrating with LabelStudio annotation interface. Required Skills and Qualifications Strong background in Python programming, particularly for data processing pipelines. Experience with time-series data and digital signal processing. Comfortable working in Linux environments and deploying/monitoring remote services. Ability to debug complex multi-component systems (sensors, video, networks, sync). Data quality mindset: designing validation rules, tracking metrics, investigating anomalies. SQL/database experience for managing pipeline metadata. Highly Valued Video processing experience (RTSP streams, encoding, OCR). Working with sensor/IoT data and handling connectivity challenges. NextJS or modern web frameworks for data tooling. DevOps practices: containerization, monitoring, logging, alerting. Experience with annotation pipelines and ML training data workflows. Background in biomechanics, sports science, or wearable sensors. Tech Stack Languages: Python (primary), JavaScript/TypeScript (NextJS UI). Data: IMU sensor streams, video (RTSP), time-series analysis, DSP. Tools: LabelStudio, , Linux/bash, OCR libraries. Infrastructure: Remote deployment, monitoring systems. You Bring the Following: A strong analytical mind and attention to detail. A passion for solving complex technical problems. Excellent communication and collaboration skills. Ability to work autonomously in a small team. About the Role This is a unique opportunity to join our mission-driven team as a Data Pipeline Expert. If you're passionate about building scalable data pipelines and driving business outcomes through data-driven insights, we'd love to hear from you

  • Cloud Infrastructure Specialist

    Há 5 horas

    Brasil beBeeEngineering Tempo inteiro

    About the Role We are seeking a highly skilled Site Reliability Engineer to join our team. This individual will play a critical role in ensuring the reliability, scalability, and security of our cloud-based infrastructure. The ideal candidate will have a deep understanding of cloud services, containerization, and automation tools. They will be responsible...

  • Advanced Data Infrastructure Specialist

    2 semanas atrás

    Brasil beBeeData Tempo inteiro

    Junior Python Developer We are on the lookout for proactive individuals to take part in our development team and contribute to various projects comprising multicultural teams spread across the globe. This is a fantastic opportunity for professionals seeking to grow within one of the fastest-growing companies in the industry. You will encounter numerous...

  • Cloud Infrastructure Architect

    1 semana atrás

    Brasil beBeeAzure Tempo inteiro

    Job Overview We are seeking a seasoned DevOps and Platform Specialist to contribute to the scalability of our cloud platform. This is an opportunity to drive significant impact on the infrastructure used by enterprise customers. Key Responsibilities Develop, maintain, and optimize CI/CD pipelines for .NET 4.6 applications using Azure DevOps. Design and...

  • Cloud Infrastructure Expert

    2 semanas atrás

    Brasil beBeeDevops Tempo inteiro

    Cloud Infrastructure Engineer Position A well-established organization is seeking a skilled DevOps professional to oversee and maintain their cloud infrastructure, focusing on automation and provisioning. The ideal candidate will possess expertise in Kubernetes, AWS, GCP, Postgres, and Terraform, enabling them to effectively manage containerized...

  • Infrastructure Engineer

    1 semana atrás

    Brasil Review ALL Tempo inteiro

    About the Client Our client is a global technology company specialized in large-scale cloud infrastructure, automation of distributed systems, and deep integration between hardware and software. The engineering environment is highly technical, fast-paced, and built around autonomy, ownership, and solving complex infrastructure challenges at global scale....

  • Infrastructure engineer

    Há 6 dias

    Brasil Review ALL Tempo inteiro

    About the Client Our client is a global technology company specialized in large-scale cloud infrastructure, automation of distributed systems, and deep integration between hardware and software. The engineering environment is highly technical, fast-paced, and built around autonomy, ownership, and solving complex infrastructure challenges at global scale....

  • Data Systems Solutions Professional

    Há 5 dias

    Brasil beBeeData Tempo inteiro

    Key Business Data Solutions Specialist We are seeking a highly skilled professional to lead the development of large-scale data systems, integrating technology solutions seamlessly. The ideal candidate will have extensive experience in designing and implementing data pipelines using innovative tools such as Spark, Hadoop, and BigQuery. A senior data...

  • Data Scientist

    1 semana atrás

    Brasil Ardanis Tempo inteiro R$80.000 - R$120.000 por ano

    We are looking for an experienced Data Scientist to join our international AI/ML team. The ideal candidate will have a strong technical background and a passion for developing artificial intelligence solutions that deliver real impact for our clients and must have a strong focus on hands-on development of end-to-end AI solutions and RAG (Retrieval-Augmented...

  • AWS Data Engineer

    Há 7 dias

    Brasil beBeeDeveloper Tempo inteiro

    Job Overview The role involves designing and implementing a large-scale data lake and analytics platform for a leading financial institution. Key Responsibilities: Design, develop, and maintain data pipelines and workflows within the AWS ecosystem. Build and optimize components for the data lake using Airflow, Glue, Redshift, S3, Athena, and Iceberg. Write...

  • Senior data engineer

    2 semanas atrás

    Brasil Eightpoint Tempo inteiro

    About Eightpoint Eightpoint is an internet technology company specializing in the agile development of products and content that address real-world interests, captivating users and driving significant growth for partners. With offices in the United States and Cayman Islands, Eightpoint collaborates with partners globally on the next generation of...