Distributed Data Pipeline Specialist

3 semanas atrás


Brasil beBeeDataEngineer Tempo inteiro

Cloud Data Engineer - Remote Contract Opportunity We are seeking a highly skilled Cloud Data Engineer to join our team in a fully remote contract position. As a Cloud Data Engineer, you will be responsible for designing and implementing scalable data pipelines using cloud-based technologies. Design and build ETL/ELT pipelines in the cloud using PySpark, Spark SQL, and Delta Lake. Ingest, clean, and transform data from diverse sources (APIs, SQL databases, cloud storage, SAP/legacy systems, streaming). Develop reusable pipeline frameworks, data validation logic, and performance-tuned transformations. Curate datasets and deliver insights through Power BI dashboards. Implement best practices for lakehouse development, orchestration, and version control. Required Skills and Qualifications Strong hands-on experience with cloud-based Databricks (Spark, PySpark, Delta Lake). Advanced SQL for large-scale data processing. Experience integrating data from multiple structured and unstructured sources. Solid understanding of distributed computing, performance tuning, and debugging Spark jobs. Power BI (reports, models, DAX preferred). Experience with CI/CD pipelines in an Azure environment. Benefits Remote work arrangement. Others Knowledge of Airflow, ADF, IoT, Kafka or other tools is a plus. Experience with SAP data is a plus.


  • Data Pipeline Specialist

    2 semanas atrás


    Brasil beBeeDataEngineer Tempo inteiro

    Job Overview At our organization, we strive to deliver cutting-edge solutions that meet diverse technological needs. We value expertise in computer science and welcome contractors who can thrive in a dynamic environment. Our team fosters autonomy, business acumen, and continuous learning. Key responsibilities include: Developing data pipelines using Python...


  • Brasil beBeeDataEngineer Tempo inteiro

    Data Engineer We are seeking an experienced Data Engineer with a strong background in AI and ML to design, develop, and maintain scalable data pipelines that power AI-driven insights across our organization. This role is ideal for someone who loves building data infrastructure that integrates data from various sources, including APIs, databases, cloud...


  • Brasil beBeeDataEngineer Tempo inteiro

    Join a cutting-edge organization and work in a highly collaborative environment to design, build, and maintain scalable data pipelines and workflows that support analytics and data-driven products. Your expertise will be utilized to develop, schedule, and monitor data pipelines using Apache Airflow. Key Responsibilities Develop and implement data pipelines...


  • Brasil beBeeDataEngineering Tempo inteiro

    Job Title: Data Engineer Develop data pipelines with strong data handling expertise using Python and Pandas. Work with PostgreSQL, loading, validating, and filtering large datasets. Experience in AWS Cloud ecosystem. Maintain continuous integration/continuous deployment (CI/CD) and code quality for data pipelines. Apply machine learning concepts to drive...


  • Brasil beBeeDataPlatform Tempo inteiro

    Job Description: We are seeking a skilled Data Platform Architect to join our team and lead the design, integration, and evolution of large-scale distributed data platforms. This individual will be responsible for architecting the platform, defining integration points, and designing scalable, secure solutions based on incoming enterprise requirements using...

  • Data Architect Specialist

    1 semana atrás


    Brasil beBeeDatabricks Tempo inteiro

    Databricks Data Engineer We are seeking a seasoned Databricks Data Engineer with expertise in designing, building, and optimizing scalable data pipelines using Spark, PySpark, SQL, and Delta Lake. This role is focused on ingesting data from various sources, transforming it for analytics, and publishing high-quality datasets and visualizations. Design and...


  • Brasil beBeeData Tempo inteiro

    Job Opportunity: Data Platform Architect We are seeking an experienced Data Platform Architect to design, implement, and evolve our large-scale distributed data platform for customer deployments and enterprise programs. Key Responsibilities: Design and architect the end-to-end data platform across on-prem, hybrid, and cloud environments based on customer...


  • Brasil beBeeSpecialist Tempo inteiro

    About the Role We are seeking a skilled professional to join our team as a Data Infrastructure Specialist. This is a hybrid role that combines data engineering with data science overlap, giving you full ownership of the data lifecycle — from ingestion to transformation, analysis, and storytelling. You will build and maintain scalable pipelines across cloud...


  • Brasil beBeeData Tempo inteiro

    GCP Data Engineer Opportunity We are seeking an experienced GCP Data Engineer to join our team. This role involves designing and implementing scalable, high-performance data architectures on GCP using services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer, among others. The ideal candidate should have knowledge of orchestration using...


  • Brasil beBeeData Tempo inteiro

    GCP Data Engineer Opportunity We are seeking an experienced GCP Data Engineer to join our team. This role involves designing and implementing scalable, high-performance data architectures on GCP using services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer, among others. The ideal candidate should have knowledge of orchestration using...