Data Engineer Specialist

Há 4 dias


Brasil MG Info | Data Driven Culture Tempo inteiro

Job Title: Data Engineer Specialist

We are seeking a highly qualified Senior Data Engineer to join our team at MG Info | Data Driven Culture. This professional will be involved in the development and management of critical components of a data platform.

The ideal candidate will have strong proficiency in Python, Apache Airflow, REST APIs, KEDA, Azure DevOps, and Azure cloud services.

Main Responsibilities:

  • Develop and manage critical components of a data platform, including Data APIs (REST APIs), Apache Airflow, and data engineering artifacts such as ingestion and curation pipelines.
  • Participate in a global project with interactions with people from different countries.

Requirements and Skills:

  • Solid experience in the Python programming language.
  • Strong experience with Airflow with KEDA (Kubernetes Event Driven Autoscaling).
  • Extensive experience with Apache Airflow and its deployments on Azure Kubernetes Service.
  • Broad experience in developing with Apache Airflow, such as Dynamic DAGs and Airflow REST APIs.
  • Hands-on experience with Python frameworks like FastAPI or Flask and deploying REST APIs on Azure App Service.
  • Solid understanding of software engineering development practices, including version control, testing, and continuous integration/deployment (CI/CD) with proven experience using Azure DevOps.
  • Proven experience with essential data engineering concepts and principles.
  • Proficiency in designing and implementing reusable and scalable data engineering pipelines and codebases.
  • Solid experience in designing batch and streaming data architectures using Azure cloud platform services.
  • Effective problem-solving skills and the ability to resolve complex data engineering issues.
  • Commitment to continuous learning and staying updated on industry trends and best practices in data engineering.
  • Strong communication and collaboration skills with proficiency in English. Ability to work effectively in a team, providing training and documenting processes.

Advantages of Working with Us:

  • Anywhere office culture: We enjoy the freedom to work with autonomy, flexibility, and trust.
  • Psychological support: For the care of our mental health.
  • Certification Assistance

  • Senior Data Engineer

    3 semanas atrás


    Brasil ECF Data, LLC Tempo inteiro

    Unlock Your Data PotentialAt ECF Data, LLC, we're on the lookout for a skilled Senior Data Engineer to join our team. As a key player in our data-driven organization, you'll be responsible for designing, building, and managing complex data pipelines that drive business growth.We're a Portuguese consulting company with a strong focus on Technology and...

  • Senior Data Engineer

    3 semanas atrás


    Brasil Data Privacy Tempo inteiro

    About the RoleWe are seeking a highly skilled Data Platform Engineer to join our team at TRM Labs. As a key member of our Data Platform team, you will be responsible for designing, building, and maintaining scalable and highly available data infrastructure for our products and services.Key ResponsibilitiesDesign and implement complex data pipelines to...

  • Data Engineer

    Há 10 horas


    Brasil Salt Tempo inteiro

    Job Title: Data Engineer - Consumer Goods SpecialistWe are seeking a skilled Data Engineer to design, implement, and maintain a robust data infrastructure for our consumer goods marketing analytics project. The ideal candidate will have strong skills in data integration, warehousing, and processing, with the ability to work on a standalone system that will...

  • Data Engineer

    3 semanas atrás


    Brasil Planahead Tempo inteiro

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Plan Ahead. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using cutting-edge tools and technologies.Develop and maintain high-performance data...


  • Brasil Data Privacy Tempo inteiro

    About TRM LabsTRM Labs is a mission-driven company that aims to build a safer financial system for billions of people. We deliver a blockchain intelligence data platform to financial institutions, crypto companies, and governments to fight cryptocurrency fraud and financial crime.Job DescriptionWe are seeking a highly skilled Software Engineer to join our...

  • Data Engineer

    3 semanas atrás


    Brasil Planahead Tempo inteiro

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Planahead. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using cutting-edge tools and technologiesDevelop and maintain large-scale data systems,...

  • Data Engineer

    2 semanas atrás


    Brasil Planahead Tempo inteiro

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Planahead. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using cutting-edge tools and technologies.Collaborate with cross-functional teams to ensure...

  • Senior Data Engineer

    Há 11 horas


    Brasil Rocket Lawyer Tempo inteiro

    About Rocket LawyerWe are a leading online legal service platform that believes everyone deserves access to affordable and simple legal services. With a global presence and a team of passionate professionals, we are expanding our platform to capture audiences worldwide.About the RoleWe are seeking an experienced Data Engineer to join our data engineering...


  • Brasil Data Privacy Tempo inteiro

    About the RoleWe're seeking a highly skilled Senior/Staff Software Engineer to join our Data Platform team. As a key member of our team, you will be responsible for designing, developing, and deploying scalable and reliable data infrastructure for our products and services.Key ResponsibilitiesDesign and develop highly available and scalable data services to...

  • Data Modeler Specialist

    2 semanas atrás


    Brasil Recargapay Tempo inteiro

    About RecargaPayRecargaPay is a leading fintech company that simplifies everyday payments for consumers and SMEs in Brazil. Our mission is to democratize mobile payments and financial services in Brazil, making it easier for people to access and manage their finances.Job DescriptionWe are seeking a highly skilled Data Modeler Specialist to join our analytics...

  • Data Engineer

    3 semanas atrás


    brasil Premier Group Recruitment Tempo inteiro

    Data EngineerContract$32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...

  • Data Engineer

    3 semanas atrás


    brasil Premier Group Recruitment Tempo inteiro

    Data Engineer Contract $32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...

  • Data Engineer

    3 semanas atrás


    Brasil Premier Group Recruitment Tempo inteiro

    Data Engineer Contract $32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...

  • Data Engineer

    3 semanas atrás


    Brasil Aitopics Tempo inteiro

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Blue Orange Digital. As a Data Engineer, you will play a key role in designing, building, and deploying data platforms in the cloud, automating their operation, and providing leadership in applying software development principles and best...


  • Brasil Wahojobs Tempo inteiro

    Data Collection ServicesWe are seeking a skilled Linguistic Data Specialist to join our team at Wahojobs. As a Linguistic Data Specialist, you will be responsible for collecting and evaluating multilingual data to support the development of machine translation engines.Key Responsibilities:Translation: Translate general web strings from the web.Rating:...


  • Brasil Ferrum Management Services AG Tempo inteiro

    Join Our Team as a Process Engineer Development SpecialistFerrum Management Services AG is a leading provider of mechanical engineering solutions, with a strong presence in the chemical and pharmaceutical industries. We are seeking a highly skilled Process Engineer Development Specialist to join our team.Main Responsibilities:Identify and develop process...

  • Linguistic Data Specialist

    3 semanas atrás


    Brasil Wahojobs Tempo inteiro

    Data Collection ServicesWe are seeking a skilled Linguistic Data Specialist to join our team at Wahojobs. As a Linguistic Data Specialist, you will play a crucial role in collecting and evaluating data for our machine learning projects.Key Responsibilities:Translation only: Translate general web strings from the web.Rating: Evaluate the quality of...

  • Linguistic Data Specialist

    3 semanas atrás


    Brasil Wahojobs Tempo inteiro

    Data Collection ServicesWe are seeking a skilled Linguistic Data Specialist to join our team at Wahojobs. As a Linguistic Data Specialist, you will play a crucial role in collecting and evaluating data for our machine learning models.Key Responsibilities:Translation only: Translate general web strings from the web.Rating: Evaluate the quality of translations...

  • Data Engineer

    1 semana atrás


    Brasil Blue Orange Digital Tempo inteiro

    Company OverviewBlue Orange Digital is a cloud-based data transformation and predictive analytics development firm with offices in the United States. We help companies make sense of their business challenges by applying modern data analytics techniques, visualizations, and AI/ML. Our team is passionate about working with technologists and data analysts to...

  • Data Engineer

    3 semanas atrás


    Brasil Aitopics Tempo inteiro

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Blue Orange Digital. As a Data Engineer, you will play a key role in designing, building, and deploying data platforms in the cloud, automating their operation, and providing leadership in applying software development principles and best...