Data Pipeline Specialist

Databricks Data Engineer This role involves designing, developing and delivering scalable data pipelines using Spark, PySpark, SQL and Delta Lake. Develop ETL/ELT pipelines in Databricks using PySpark, Spark SQL and Delta Lake. Ingest, clean and transform data from diverse sources such as APIs, SQL databases, cloud storage and SAP/legacy systems. Create...

Cloud Data Specialist The ideal candidate will possess a strong background in data engineering with expertise in AWS services, specifically API Gateway, Lambda/Fargate, S3, Glue, and CloudWatch. In addition to this technical knowledge, the successful applicant should have proficiency in PySpark, including partitioning, joins, and optimization techniques....

Key Data Engineer Role We are looking for a seasoned expert in data engineering with a focus on artificial intelligence and machine learning to join our analytics team. This role will involve designing scalable data pipelines, operationalizing machine learning workflows, and collaborating closely with data scientists. Create end-to-end data pipelines using...

Job Overview We are seeking a data pipeline engineer to own and evolve our exercise recognition training data infrastructure. Maintain and enhance our multi-source data collection system with IMU sensors and synchronized video streams from gym-based cameras. Improve video capture software robustness, particularly handling network interruptions and...

Job Overview The Senior Data Engineer will be responsible for building, managing, and optimizing data pipelines to ensure compliance with data governance, data architecture, and data security requirements. Develop and maintain scalable data pipelines that encompass data modeling, data transformation, schemas, metadata, and workload management; Drive...

Backend Engineer OpportunityJob DescriptionThis role focuses on designing and developing backend services and data pipelines using Python.The ideal candidate will have experience with AWS data workflows, AI/LLM frameworks, and Kubernetes-hosted applications.Mandatory Skills and QualificationsStrong expertise in Python developmentProficiency in SQL and NoSQL...

Job Description We are seeking a skilled Data Engineer to design and implement scalable data pipelines using Databricks and Kafka. The successful candidate will have strong experience in designing data pipelines, building real-time streaming solutions, collaborating with cross-functional teams, and optimizing data processing workflows. Design scalable data...

Backend and Data Specialist We are seeking a skilled Backend and Data Specialist to fill this position. This role will focus on designing and developing backend and data pipelines using Python, as well as integrating AI/LLM frameworks into production systems. Key Responsibilities: Design and develop backend and data pipelines using Python programming...

Job DescriptionWe are seeking a skilled Data Engineer to design and implement scalable data pipelines using Databricks and Kafka.The successful candidate will have strong experience in designing data pipelines, building real-time streaming solutions, collaborating with cross-functional teams, and optimizing data processing workflows.Design scalable data...

Key Roles of a Data Engineer A multinational corporation is seeking an experienced data engineer to spearhead the design, development, and maintenance of large-scale data pipelines. Primary responsibilities include: Collaborating with cross-functional teams to integrate data into business applications; Developing and implementing robust data quality...