Data Engineer Specialist
Há 4 dias
Job Title: Data Engineer Specialist
We are seeking a highly qualified Senior Data Engineer to join our team at MG Info | Data Driven Culture. This professional will be involved in the development and management of critical components of a data platform.
The ideal candidate will have strong proficiency in Python, Apache Airflow, REST APIs, KEDA, Azure DevOps, and Azure cloud services.
Main Responsibilities:
- Develop and manage critical components of a data platform, including Data APIs (REST APIs), Apache Airflow, and data engineering artifacts such as ingestion and curation pipelines.
- Participate in a global project with interactions with people from different countries.
Requirements and Skills:
- Solid experience in the Python programming language.
- Strong experience with Airflow with KEDA (Kubernetes Event Driven Autoscaling).
- Extensive experience with Apache Airflow and its deployments on Azure Kubernetes Service.
- Broad experience in developing with Apache Airflow, such as Dynamic DAGs and Airflow REST APIs.
- Hands-on experience with Python frameworks like FastAPI or Flask and deploying REST APIs on Azure App Service.
- Solid understanding of software engineering development practices, including version control, testing, and continuous integration/deployment (CI/CD) with proven experience using Azure DevOps.
- Proven experience with essential data engineering concepts and principles.
- Proficiency in designing and implementing reusable and scalable data engineering pipelines and codebases.
- Solid experience in designing batch and streaming data architectures using Azure cloud platform services.
- Effective problem-solving skills and the ability to resolve complex data engineering issues.
- Commitment to continuous learning and staying updated on industry trends and best practices in data engineering.
- Strong communication and collaboration skills with proficiency in English. Ability to work effectively in a team, providing training and documenting processes.
Advantages of Working with Us:
- Anywhere office culture: We enjoy the freedom to work with autonomy, flexibility, and trust.
- Psychological support: For the care of our mental health.
- Certification Assistance
-
Senior Data Engineer
3 semanas atrás
Brasil ECF Data, LLC Tempo inteiroUnlock Your Data PotentialAt ECF Data, LLC, we're on the lookout for a skilled Senior Data Engineer to join our team. As a key player in our data-driven organization, you'll be responsible for designing, building, and managing complex data pipelines that drive business growth.We're a Portuguese consulting company with a strong focus on Technology and...
-
Senior Data Engineer
3 semanas atrás
Brasil Data Privacy Tempo inteiroAbout the RoleWe are seeking a highly skilled Data Platform Engineer to join our team at TRM Labs. As a key member of our Data Platform team, you will be responsible for designing, building, and maintaining scalable and highly available data infrastructure for our products and services.Key ResponsibilitiesDesign and implement complex data pipelines to...
-
Data Engineer
Há 10 horas
Brasil Salt Tempo inteiroJob Title: Data Engineer - Consumer Goods SpecialistWe are seeking a skilled Data Engineer to design, implement, and maintain a robust data infrastructure for our consumer goods marketing analytics project. The ideal candidate will have strong skills in data integration, warehousing, and processing, with the ability to work on a standalone system that will...
-
Data Engineer
3 semanas atrás
Brasil Planahead Tempo inteiroJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Plan Ahead. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using cutting-edge tools and technologies.Develop and maintain high-performance data...
-
Senior/Staff Software Engineer, Data Platform
1 semana atrás
Brasil Data Privacy Tempo inteiroAbout TRM LabsTRM Labs is a mission-driven company that aims to build a safer financial system for billions of people. We deliver a blockchain intelligence data platform to financial institutions, crypto companies, and governments to fight cryptocurrency fraud and financial crime.Job DescriptionWe are seeking a highly skilled Software Engineer to join our...
-
Data Engineer
3 semanas atrás
Brasil Planahead Tempo inteiroJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Planahead. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using cutting-edge tools and technologiesDevelop and maintain large-scale data systems,...
-
Data Engineer
2 semanas atrás
Brasil Planahead Tempo inteiroJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Planahead. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using cutting-edge tools and technologies.Collaborate with cross-functional teams to ensure...
-
Senior Data Engineer
Há 11 horas
Brasil Rocket Lawyer Tempo inteiroAbout Rocket LawyerWe are a leading online legal service platform that believes everyone deserves access to affordable and simple legal services. With a global presence and a team of passionate professionals, we are expanding our platform to capture audiences worldwide.About the RoleWe are seeking an experienced Data Engineer to join our data engineering...
-
Senior/Staff Software Engineer, Data Platform
2 semanas atrás
Brasil Data Privacy Tempo inteiroAbout the RoleWe're seeking a highly skilled Senior/Staff Software Engineer to join our Data Platform team. As a key member of our team, you will be responsible for designing, developing, and deploying scalable and reliable data infrastructure for our products and services.Key ResponsibilitiesDesign and develop highly available and scalable data services to...
-
Data Modeler Specialist
2 semanas atrás
Brasil Recargapay Tempo inteiroAbout RecargaPayRecargaPay is a leading fintech company that simplifies everyday payments for consumers and SMEs in Brazil. Our mission is to democratize mobile payments and financial services in Brazil, making it easier for people to access and manage their finances.Job DescriptionWe are seeking a highly skilled Data Modeler Specialist to join our analytics...
-
Data Engineer
3 semanas atrás
brasil Premier Group Recruitment Tempo inteiroData EngineerContract$32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...
-
Data Engineer
3 semanas atrás
brasil Premier Group Recruitment Tempo inteiroData Engineer Contract $32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...
-
Data Engineer
3 semanas atrás
Brasil Premier Group Recruitment Tempo inteiroData Engineer Contract $32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...
-
Data Engineer
3 semanas atrás
Brasil Aitopics Tempo inteiroJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Blue Orange Digital. As a Data Engineer, you will play a key role in designing, building, and deploying data platforms in the cloud, automating their operation, and providing leadership in applying software development principles and best...
-
Linguistic Data Specialist
Há 13 horas
Brasil Wahojobs Tempo inteiroData Collection ServicesWe are seeking a skilled Linguistic Data Specialist to join our team at Wahojobs. As a Linguistic Data Specialist, you will be responsible for collecting and evaluating multilingual data to support the development of machine translation engines.Key Responsibilities:Translation: Translate general web strings from the web.Rating:...
-
Process Engineer Development Specialist
3 semanas atrás
Brasil Ferrum Management Services AG Tempo inteiroJoin Our Team as a Process Engineer Development SpecialistFerrum Management Services AG is a leading provider of mechanical engineering solutions, with a strong presence in the chemical and pharmaceutical industries. We are seeking a highly skilled Process Engineer Development Specialist to join our team.Main Responsibilities:Identify and develop process...
-
Linguistic Data Specialist
3 semanas atrás
Brasil Wahojobs Tempo inteiroData Collection ServicesWe are seeking a skilled Linguistic Data Specialist to join our team at Wahojobs. As a Linguistic Data Specialist, you will play a crucial role in collecting and evaluating data for our machine learning projects.Key Responsibilities:Translation only: Translate general web strings from the web.Rating: Evaluate the quality of...
-
Linguistic Data Specialist
3 semanas atrás
Brasil Wahojobs Tempo inteiroData Collection ServicesWe are seeking a skilled Linguistic Data Specialist to join our team at Wahojobs. As a Linguistic Data Specialist, you will play a crucial role in collecting and evaluating data for our machine learning models.Key Responsibilities:Translation only: Translate general web strings from the web.Rating: Evaluate the quality of translations...
-
Data Engineer
1 semana atrás
Brasil Blue Orange Digital Tempo inteiroCompany OverviewBlue Orange Digital is a cloud-based data transformation and predictive analytics development firm with offices in the United States. We help companies make sense of their business challenges by applying modern data analytics techniques, visualizations, and AI/ML. Our team is passionate about working with technologists and data analysts to...
-
Data Engineer
3 semanas atrás
Brasil Aitopics Tempo inteiroJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Blue Orange Digital. As a Data Engineer, you will play a key role in designing, building, and deploying data platforms in the cloud, automating their operation, and providing leadership in applying software development principles and best...