Senior Data Engineer

Há 7 dias

Região Geográfica Intermediária de Pelotas, Brasil Provectus Tempo inteiro
Join us at Provectus to be a part of a team that is dedicated to building cutting-edge technology solutions that have a positive impact on society. Our company specializes in AI and ML technologies, cloud services, and data engineering, and we take pride in our ability to innovate and push the boundaries of what's possible.
We are seeking a talented and experienced Senior Data Engineer. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers. You will encounter numerous technical challenges and have the opportunity to contribute to exciting open-source projects, build internal solutions, and engage in R&D activities, providing an excellent environment for professional growth.
Let's work together to build a better future for everyone Requirements:
  • 5+ years of hands-on experience in data engineering, with a strong emphasis on Databricks and Apache Spark.
  • Expertise in cloud platforms (AWS preferred, GCP, or Azure) preferably with relevant certifications.
  • Proficiency with cloud data warehouse technologies (Snowflake/Redshift/Clickhouse).
  • Proven experience in handling batch data workflows using Airflow or similar tools.
  • Experience in handling real-time data using Kafka and streaming processing frameworks.
  • Strong command of Python and SQL for building scalable and efficient data pipelines.
  • Strong communication skills with the ability to collaborate effectively in English.
  • Exceptional problem-solving skills and the ability to thrive in fast-paced environments.
Nice To Have:
  • Solid experience with Infrastructure as Code tools such as Terraform or AWS CloudFormation.
  • Databricks Data Engineering certification.
  • Experience designing scalable APIs using frameworks such as FastAPI or Flask.
  • Familiarity with BI tools such as Power BI, QuickSight, Looker, or Tableau.
  • Experience in implementing Data Mesh architecture or distributed data solutions.
  • In-depth knowledge of Data Governance principles, including Data Quality, Lineage, Security, and Cost Optimization.
  • Familiarity with Machine Learning frameworks (e.g., AWS SageMaker, MLflow) and classical ML tasks (e.g., OCR).
  • Experience in building Generative AI applications such as chatbots and RAG systems.
Responsibilities:
  • Collaborate with clients to understand their IT environments, applications, business requirements, and digital transformation objectives.
  • Collect, process, and manage large volumes of structured and unstructured data from diverse sources.
  • Work directly with Data Scientists and ML Engineers to design and maintain robust, resilient data pipelines that power Data Products.
  • Define and develop data models that unify disparate data across the organization.
  • Design, implement, and optimize ETL/ELT pipelines, ensuring scalability, performance, and maintainability.
  • Leverage Databricks and Apache Spark to perform complex data transformations and processing.
  • Build, test, and deploy scalable data-driven solutions in collaboration with cross-functional teams.
#J-18808-Ljbffr

  • Data Engineer

    Há 7 dias

    Região Geográfica Intermediária de Pelotas, Brasil Paycor Tempo inteiro

    Data Engineer - SB Belgrade Paycor's HR software is purpose-built for leaders and modernizes people management. We help our customers build winning teams and great places to work. Paycor’s culture is the key driver of our success. Every day, our associates find new ways to add value and progress toward audacious goals. We celebrate wins and share the...

  • Senior AQA Automation Engineer

    1 dia atrás

    Região Geográfica Intermediária de Pelotas, Brasil Social Discovery Group Tempo inteiro

    About Social Discovery GroupSocial Discovery Group is a global technology company that builds innovative apps at the intersection of dating, social, and entertainment. Our portfolio includes 70 social discovery platforms that leverage AI, game mechanics, and video streaming. We invest in and support social discovery startups worldwide through our CVC...

  • Senior Data Solutions Architect

    1 semana atrás

    Região Geográfica Intermediária de Pelotas, Brasil Provectus Tempo inteiro

    Provectus, a leading AI consultancy and solutions provider specializing in Data Engineering and Machine Learning . With a focus on helping businesses unlock the power of their data, we leverage the latest technologies to build innovative data platforms that drive results. Our Data Engineering team consists of top-tier professionals who design, implement,...

  • Software Engineer for AI Data Annotation

    Há 7 dias

    Região Geográfica Intermediária de Pelotas, Brasil G2i Inc. Tempo inteiro

    Job OverviewWe are seeking a skilled software engineer to join our expert annotation team and contribute to the creation of high-quality training data for cutting-edge AI models. As a software engineer, you will work on evaluating the quality of AI-generated code, solving coding problems, and writing robust test cases.Key ResponsibilitiesEvaluate the quality...

  • Software Engineer for AI Data Annotation

    1 semana atrás

    Região Geográfica Intermediária de Pelotas, Brasil G2i Inc. Tempo inteiro

    Job OverviewWe are seeking a skilled software engineer to join our expert annotation team and contribute to the creation of high-quality training data for advanced AI models. As a software engineer, you will work on discrete, highly variable problems that involve engaging with AI models as they learn to code.Key ResponsibilitiesEvaluate the quality of...

  • Senior Data Solutions Architect

    1 semana atrás

    Região Geográfica Intermediária de Pelotas, Brasil Provectus Tempo inteiro

    Unlock the Power of Data with ProvectusAt Provectus, we're on a mission to help businesses harness the full potential of their data. As a leading AI consultancy and solutions provider, we specialize in Data Engineering and Machine Learning. Our team of experts designs, implements, and optimizes scalable, data-driven architectures for clients across various...

  • Senior Data Solutions Architect

    Há 10 horas

    Região Geográfica Intermediária de Pelotas, Brasil Provectus Tempo inteiro

    Unlock the Power of Data with ProvectusAt Provectus, we're on a mission to help businesses harness the full potential of their data. As a leading AI consultancy and solutions provider, we specialize in Data Engineering and Machine Learning. Our team of experts designs, implements, and optimizes scalable, data-driven architectures for clients across various...

  • Software Engineer for Training AI Data

    Há 7 dias

    Região Geográfica Intermediária de Pelotas, Brasil G2i Inc. Tempo inteiro

    Job OverviewWe are seeking a skilled Software Engineer to join our expert annotation team and contribute to the creation of training data for the world's most advanced AI models. As a Software Engineer for AI Data, you will work on discrete, highly variable problems that involve engaging with AI models as they learn to code.ResponsibilitiesEvaluate the...

  • Senior Data Solutions Architect

    1 semana atrás

    Região Geográfica Intermediária de Pelotas, Brasil Provectus Tempo inteiro

    Provectus, a leading AI consultancy and solutions provider specializing in Data Engineering and Machine Learning . With a focus on helping businesses unlock the power of their data, we leverage the latest technologies to build innovative data platforms that drive results. Our Data Engineering team consists of top-tier professionals who design, implement,...

  • Senior QA Automation Engineer

    8 minutos atrás

    Região Geográfica Intermediária de Pelotas, Brasil IDT Tempo inteiro

    Product: We are looking for a QA Engineer to join the Net2Phone unite Platform team, which develops Core part (calls platform) of the product and User Experience parts of applications for corporate call centers/enterprise calling plans. As a part of the Platform team, you will work in the international team, testing all API’s services, calling parts and...

  • Senior Data Engineer

    4 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil Gazeus Games Tempo inteiro

    Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to lead our data engineering efforts. The ideal candidate will have a strong background in data engineering, excellent analytical skills, and proficiency in English.Key Responsibilities:Design, develop, and maintain scalable data pipelines using MySQL, Amazon Athena,...

  • Software Engineer for Training AI Data

    Há 6 dias

    Região Geográfica Intermediária de Pelotas, Brasil G2i Inc. Tempo inteiro

    Job OverviewWe are seeking a skilled Software Engineer to join our expert annotation team and create training data for the world's most advanced AI models. As a Software Engineer for AI Training, you will work on a variety of projects, including discrete, highly variable problems that involve engaging with AI models as they learn to...

  • Software Engineer for AI Training Data

    Há 7 dias

    Região Geográfica Intermediária de Pelotas, Brasil G2i Inc. Tempo inteiro

    Job OverviewWe are seeking a skilled Software Engineer to join our expert annotation team and create training data for the world's most advanced AI models. This is a long-term opportunity with no end date expected for the next 2 years.Key ResponsibilitiesEvaluate the quality of AI-generated code and provide human-readable summaries of your rationale.Solve...

  • Software Engineer for Training AI Data

    Há 7 dias

    Região Geográfica Intermediária de Pelotas, Brasil G2i Inc. Tempo inteiro

    Accepted Locations We accept applicants from the US, Canada, and most countries in LATAM and Europe. We are accepting candidates from some countries in Africa and Asia. This work is 100% remote. Overview You’ll join an expert annotation team to create training data for the world's most advanced AI models. No previous AI experience is necessary....

  • Senior Data Solutions Architect

    Há 7 dias

    Região Geográfica Intermediária de Pelotas, Brasil Provectus Tempo inteiro

    Unlock the Power of Data with ProvectusAt Provectus, we're on a mission to help businesses harness the full potential of their data. As a leading AI consultancy and solutions provider, we specialize in Data Engineering and Machine Learning. Our team of experts designs, implements, and optimizes scalable, data-driven architectures for clients across various...

  • Senior Frontend Engineer

    2 semanas atrás

    Região Geográfica Intermediária de Pelotas, Brasil Provectus Tempo inteiro

    We are seeking a highly skilled Senior Frontend Engineer with production experience in Flutter and React to join our dynamic and growing team. As a key member, you’ll be responsible for building and maintaining robust, scalable client applications, collaborating with cross-functional teams, and driving key frontend development initiatives. What You’ll...

  • Senior Frontend Developer

    2 semanas atrás

    Região Geográfica Intermediária de Pelotas, Brasil Provectus Tempo inteiro

    Job Title: Senior Frontend EngineerWe are seeking a highly skilled Senior Frontend Engineer with production experience in Flutter and React to join our dynamic and growing team. As a key member, you'll be responsible for building and maintaining robust, scalable client applications, collaborating with cross-functional teams, and driving key frontend...

  • Software Engineer for Training AI Data

    Há 4 dias

    Região Geográfica Intermediária de Pelotas, Brasil G2i Inc. Tempo inteiro

    About the RoleWe are seeking a skilled Software Engineer to join our team and contribute to the development of advanced AI models. As a key member of our expert annotation team, you will play a crucial role in creating high-quality training data for these models.Key ResponsibilitiesEvaluate the quality of AI-generated code and provide human-readable...

  • Data Science Specialist

    4 semanas atrás

    Região Geográfica Intermediária de Picos, Brasil Motion Recruitment Partners LLC Tempo inteiro

    Job OverviewWe are seeking a highly skilled Machine Learning Engineer to join our team at Motion Recruitment Partners LLC.Responsibilities:* Design, build, and implement machine learning models and algorithms to drive business growth* Develop and deploy deep learning and neural network models for various applications* Optimize existing machine learning...

  • Senior Golang Software Engineer

    2 semanas atrás

    Região Geográfica Intermediária de Pelotas, Brasil IDT Tempo inteiro

    We are looking for an experienced Senior Golang Software Engineer to join the DTC Core Team within our flagship product BOSS Revolution . You have a chance to work with a team of outstanding professionals on a really challenging product: a fast-growing International Calling business with millions of real users. You will never be bored—our team is dynamic,...