Data Engineer
4 semanas atrás
Job Summary:
- We are seeking a Data Engineer to enhance the resilience and operational stability of our data pipelines, from factory floor to cloud repositories. This critical role will focus on building robust monitoring and support systems, and on accelerating our ability to understand and resolve system and pipeline breakdowns
Responsibilities:
- Design, develop, and integrate production support technologies and systems to improve data pipeline reliability.
- Proactively identify vulnerabilities and implement systemic process oriented solutions to enhance pipeline resilience.
- Develop and apply advanced analytics for proactive pipeline monitoring, anomaly detection, and performance optimization.
- Conduct in-depth statistical analysis of pipeline performance, incident data, and root causes to drive continuous improvement.
- Prepare and maintain comprehensive reports and dashboards with key performance indicators (KPIs) for measuring system and pipeline resiliency.
- Collaborate with global team of data analysts, engineers, and leaders to rapidly troubleshoot and resolve data pipeline issues.
- Interface with corporate areas, preparing technical documentation, reports, and presentations on pipeline health and improvements.
- Maintain accurate and up-to-date documentation for systems, processes, and troubleshooting guides.
- Assist in meeting data environment governance requirements, specifically related to pipeline data quality and integrity.
Knowledge and Technical Competencies:
- Soft skills: Organized, proactive, curious, sense of urgency and prioritization, and a strong feeling of ownership.
Technical expertise:
- Proven experience in systems support, data pipelines, database reliability engineering, and IT production support.
- Strong background in designing and implementing monitoring, alerting, and logging solutions.
- Proficiency with cloud platforms, specifically Google Cloud Platform (GCP).
- Experience with industrial data historians (e.g., OSI Soft PI) and API data extraction.
Experience:
- Background: Degree in Engineering or Computer Science.
Technical Skills:
- Proficiency in SQL (queries) and a scripting language (e.g., Python) for data analysis and automation.
- Hands-on experience with GCP data technologies (e.g., BigQuery, Dataflow) and monitoring tools (e.g., Grafana, Cloud Monitoring).
- Familiarity with business intelligence tools (e.g., Looker, Power BI, Tableau) for dashboarding.
- Desirable: Knowledge of process industry KPIs. Familiarity with data governance platforms (e.g., Collibra) and data transformation tools (e.g., Dataform).
- Multilingual English/Spanish/Portuguese would be a plus
- Experience with Production Support would be a plus
-
Data Engineer
4 semanas atrás
Brazil, BR emagine - Portugal Tempo inteiroProfile: Data / ETL Engineer (AWS)We are looking for a Data / ETL Engineers with strong experience building and operating data pipelines in AWS.Core skills & experience:• Solid understanding of relational databases, with strong SQL skills (experience with Microsoft SQL Server preferred)• Strong Python development skills, particularly for data processing...
-
Data Engineer
2 semanas atrás
Brazil, BR Exactius Tempo inteiroAbout ExactiusExactius works with companies to solve complex digital marketing challenges and achieve ambitious growth goals. We bring executive leadership and cross-functional execution teams that can not only form the strategy but can execute and deliver the result. These teams always include a proven performance marketing CMO, along with campaign and CRM...
-
Data Engineer
3 semanas atrás
Brazil, BR Avenue Code Tempo inteiroAvenue Code is the leading software consultancy focused on delivering end-to-end development solutions for digital transformation across every vertical. We’re privately held, profitable, and have been on a solid growth trajectory since day one. We care deeply about our clients, our partners, and our people. We prefer the word ‘partner’ over...
-
Data Engineer
4 semanas atrás
Brazil, BR Insight Global Tempo inteiroRequired Skills & Experience- 5+ years of experience with Power BI development and engineering (DAX and semantic model development and deployment)- Strong hands on coding ability in PySpark and Python- Professional working experience with Databricks, Fabirc, or similar Spark platforms- Fair knowledge on the use of Azure Dev Ops (ADO) to manage repository and...
-
Senior Data Engineer
4 semanas atrás
Brazil, BR Luxoft Tempo inteiroProject Description:The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration,...
-
Senior Data Engineer
3 semanas atrás
Brazil, BR Jusfy Tempo inteiroA Jusfy está em busca de um Sr Data Engineer para compor o time! Somos uma startup jurídica que busca constantemente soluções para facilitar a vida dos advogados e advogadas brasileiros. Atuamos na área de tecnologia, desenvolvendo produtos e ferramentas que auxiliam na produtividade diária dos nossos clientes.Somos uma empresa jovem e muito...
-
Data Engineer
4 semanas atrás
Brazil, BR RapidView Technologies Tempo inteiroWe are looking for a skilled Data Engineer with strong experience in Power BI and frontend development using React, along with backend experience in Ruby on Rails. This role involves building data-driven applications, dashboards, and scalable data pipelines while working closely with product, engineering, and analytics teams.ResponsibilitiesDesign, build,...
-
Data Analyst
3 semanas atrás
Brazil, BR Insight Global Tempo inteiroDuration: 12 month extending contractOn this team, you will blend analytics and quality assurance skills to develop automated ETL pipelines and trusted reporting for a variety of corporate function teams. This unique position will give you the opportunity to work closely with finance, insights, HR, and product stakeholders around the company using...
-
Machine Learning Engineer
3 semanas atrás
Brazil, BR Onebridge Tempo inteiroOnebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...
-
Lead Software Engineer
3 semanas atrás
Brazil, BR Onebridge Tempo inteiroOnebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...