Senior Data Engineer
3 semanas atrás
We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and optimizing data pipelines and architectures. You will leverage your Azure, Databricks, Data Warehousing, SQL, and Python / PySpark expertise to drive data-driven decisions and innovations. Experience with CI / CD processes, automation, performance tuning, and data pipeline monitoring is highly valued.
Must Have Skills :
- Experience : Minimum of 5 years in data engineering with strong experience in Azure, Databricks, Data Warehousing, SQL, and Python / PySpark.
- Performance Tuning : Proven experience in performance tuning of data pipelines and queries.
- Monitoring and Alerts : Experience with monitoring and alerting systems for data pipelines.
- Automation : Demonstrated experience in developing and maintaining automation scripts for data processes.
- SQL Expertise : Advanced proficiency in SQL for complex queries and data manipulation.
- Python / PySpark Proficiency : Solid experience in using Python and PySpark for data processing and analysis.
- Problem-Solving : Strong analytical and problem-solving skills.
- Communication : Excellent verbal and written communication skills.
Desirable Skills :
CI / CD Experience : Experience with CI / CD pipelines for data engineering workflows.Big Data Technologies : Familiarity with additional big data technologies (e.g., Hadoop, Spark).Data Governance : Knowledge of Data Governance and Data Quality best practices.Project Management : Experience with agile methodologies and project management tools.Certifications : Relevant certifications (e.g., Microsoft Certified : Azure Data Engineer Associate) are a plus.Key Responsibilities :
Design and Development : Architect and develop robust data pipelines, ETL processes, and data models using Azure Data Factory, Databricks, and other relevant tools.Data Warehousing : Implement and manage Data Warehousing solutions for efficient data storage and retrieval.Data Lake / Delta Lake : Expertise in designing and implementing medallion architecture (bronze, silver, and gold layers) and data lake house solutions to ensure efficient data storage, processing, and analytics, while maintaining data quality, consistency, and accessibility.SQL and Python / PySpark : Write and optimize SQL queries and develop data processing scripts using Python and PySpark.Automation : Develop and maintain automation scripts for data processes to ensure efficiency.Performance Tuning : Monitor and optimize the performance of data pipelines and queries to ensure high efficiency and responsiveness.Monitoring and Alerts : Set up and manage monitoring and alert systems for data pipelines to proactively address issues.Collaboration : Work with data scientists, analysts, BI Engineers and other stakeholders to address their data needs with technical solutions.Documentation : Maintain comprehensive documentation of data processes, architectures, and workflows.#J-18808-Ljbffr-
Senior Data Engineer
2 semanas atrás
Rio de Janeiro, Brasil buscojobs Brasil Tempo inteiroPlease apply with a resume in English We are Software Mind, an awesome team of engineers who are ready to ramp up any top-notch company’s projects! Our aim? To always be one step ahead. Become part of a multicultural company that is constantly growing and has an excellent work environment certified by Great Place To Work! Project - the aim you'll have...
-
Senior Data Engineer
4 semanas atrás
Rio de Janeiro, Rio de Janeiro, Brasil Fullstack Labs Tempo inteiroAt FullStack Labs, we strive to deliver transformational digital solutions to top organizations. We're looking for a skilled Data Engineer to join our team and help build highly-skilled software development teams.We're most proud of offering life-changing career opportunities to talented software professionals and having delivered hundreds of successful...
-
Data Engineer
Há 1 mês
Rio de Janeiro, Brasil Formula Tempo inteiroFormula.Monks, part of Media.Monks and S4 Capital, is a global consulting firm mastering AI-powered transformations for the Fortune 100. We combine long-term strategic thinking, deep enterprise experience, and a human-centered approach to help clients transform business processes and dominate their industries. About the Role As a Data Engineer , you’ll...
-
Senior Data Engineer
3 meses atrás
Região Geográfica Intermediária de Pelotas, Brasil Provectus Tempo inteiroJoin us at Provectus to be a part of a team that is dedicated to building cutting-edge technology solutions that have a positive impact on society. Our company specializes in AI and ML technologies, cloud services, and data engineering, and we take pride in our ability to innovate and push the boundaries of what's possible. We are seeking a talented...
-
Rio De Janeiro, Brasil MentorMate Tempo inteiroSenior Quality Engineer Embedded SoftwareMentorMate creates durable technical solutions that deliver digital transformation at scale by blending strategic insights and thoughtful design with brilliant engineering. With mature and established practices in enterprise web and mobile development, quality engineering, technical architecture, human-centered...
-
Senior Java Software Engineer
1 dia atrás
Rio De Janeiro, Brasil buscojobs Brasil Tempo inteiroSenior Software Engineer (Java) - Candidates Must Be Based Out of BrazilRocket Financial is an early-stage start-up in the Financial Technology space. Our mission is to change the way how money moves around the planet. Primarily, we are building a Banking-as-a-Service (BaaS) platform for those wanting to integrate into the world financial infrastructure.We...
-
Senior Full Stack Engineer
Há 4 dias
Rio De Janeiro, Brasil LatamCent Tempo inteiroSenior Full Stack Engineer - Rails & ReactAbout the ProjectGetro is on a mission to unlock the hidden potential within professional networks, transforming how people discover and leverage warm introductions for hiring and sales. As a Senior Full Stack Engineer on our team, you'll be crucial in crafting features that both accelerate and enrich every...
-
Data Engineer
3 semanas atrás
Rio de Janeiro, Brasil - Tempo inteiroWe are looking for the right people - people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world's largest providers of products and services to the...
-
Data Engineer With Gcp
3 semanas atrás
Rio Grande do Sul, Brasil buscojobs Brasil Tempo inteiroThis position is a Remote position to work from LATAM with US clients. You will be working as a consultant directly with US Clients. Must work in US PST Zone. We offer: 100% Remote Position Paid National Holidays off 30 to $35 USD per hour Title: Data Engineer with GCP We are seeking a highly motivated and experienced Data Engineer to join our Data...
-
Data Engineer
Há 1 mês
Rio de Janeiro, Brasil Halliburton Tempo inteiroWe are looking for the right people — people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world’s largest providers of products and services to the...
-
Data Engineer
Há 1 mês
Rio de Janeiro, Brasil oilandgas.org.uk Tempo inteiroWe are looking for the right people - people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world's largest providers of products and services to the...
-
Data Engineer
Há 1 mês
Rio de Janeiro, Brasil Halliburton Energy Services Tempo inteiroWe are looking for the right people — people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world’s largest providers of products and services to the...
-
Senior Software Engineer
2 meses atrás
Rio De Janeiro, Brasil Rail (Formerly Layer2 Financial) Tempo inteiroSenior Backend EngineerAs innovators at the forefront of global cross-border payments, we champion the belief that secure and efficient financial transactions are a fundamental human right. This conviction guides us in fostering robust communities and, by extension, empowering global economies. Our mission is bold: to design the next generation of banking...
-
Senior Data Engineer
3 semanas atrás
Região Geográfica Intermediária de Sorocaba, Brasil buscojobs Brasil Tempo inteiroWe are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and optimizing data pipelines and architectures. You will leverage your Azure, Databricks, Data Warehousing, SQL, and Python / PySpark expertise to drive data-driven decisions and innovations. Experience with CI /...
-
Senior GCP Data Engineer
Há 1 mês
Região Geográfica Intermediária de Juiz de Fora, Brasil Vigil Tempo inteiroSUMMARY: As a Senior Data Engineer, you will be responsible for designing, building, and maintaining efficient and reliable data pipelines on the Google Cloud Platform (GCP). This role requires a strong background in GCP services and a proven track record of creating effective data solutions that align with business requirements. We are looking for...
-
Senior Data Engineer
2 semanas atrás
Rio de Janeiro, Brasil buscojobs Brasil Tempo inteiroSomos um centro de inovação que há mais de duas décadas forma pessoas e impulsiona organizações, potencializando suas estratégias digitais. Resolvemos problemas complexos e desafiadores em um ambiente de trabalho descontraído, descentralizado e repleto de benefícios para nossos colaboradores - que atuam como protagonistas, interagindo diretamente...
-
Senior Wordpress Engineer | Full Stack
3 meses atrás
Rio De Janeiro, Brasil TOP Agency Tempo inteiroAbout the job Senior Wordpress Engineer | Full StackWordPress Engineer, TechnicalCan you work comfortably in a wide range of programming languages and have a passion for creating outstanding user experiences?If you have full stack development experience in WordPress and can demonstrate the ability to work in HTML, CSS, Javascript, and PHP, then we might have...
-
Lead Software Engineer
1 dia atrás
Rio De Janeiro, Brasil buscojobs Brasil Tempo inteiroJob Title : Senior Software Engineer – .NET and Mobile ApplicationsPosition Description :Join our team to work for our client, a leading provider of comprehensive and user-friendly security guard management software. As a Senior Software Engineer, you will lead a global development team, driving technical innovation and implementing best practices.This...
-
Senior Devops Cloud Engineer
3 meses atrás
Rio Grande, Brasil thyssenkrupp Elevator Tempo inteiroPeople are at the heart of everything we do at TK Elevator: we work as a team, we care about the safety of others and we share a common vision to keep the world moving. This is your opportunity to go further and impact the future of urban mobility.We are seeking an experienced Senior Cloud DevOps Engineer specializing in Azure in IoT and data solutions. This...
-
Senior Engineer
5 meses atrás
Rio de Janeiro, Brasil Keoghs Tempo inteiroAdvert 2H Offshore is a global engineering contractor specializing in the design, engineering and integrity management of offshore structures, topsides facilities, subsea components and riser and conductor systems for the offshore oil and gas and renewables sectors. Both market sectors require similar engineering skill sets, and our breadth of experience in...