Senior Data Engineer

4 semanas atrás

Rio de Janeiro, Rio de Janeiro, Brasil Halliburton Tempo inteiro

We are looking for the right people — people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world's largest providers of products and services to the global energy industry.

Job Duties

Job Summary:
We are seeking a Senior Data Engineer to design, implement, and optimize data pipelines and web applications. The ideal candidate brings strong expertise in Azure Databricks, Pyspark, Python, and SQL , with experience leading projects and improving architectures.

Key Responsibilities:

  • Design, debug, and optimize pipelines using Azure Databricks with Pyspark and Python for SQL Server, Delta Lakes, and Azure Synapse (serverless/dedicated).

  • Apply strong knowledge of SQL, Python, and core Data Engineering principles, with familiarity in Data Science.

  • Develop web apps and dashboards using Power BI, Flask, Dash, and Plotly.

  • Collaborate with data scientists to improve pipelines and resolve issues in Azure Databricks.

  • Propose and implement architectural enhancements to data pipelines.

  • Monitor cluster resources and optimize performance in Azure Databricks.

  • Utilize Git and Azure DevOps for versioning and deployment.

  • Use Matplotlib, Pandas, and NumPy for data analysis and visualization.

  • Contribute to a globally distributed team in dynamic and sometimes ambiguous environments.

  • Experience with Azure services like Power Apps and Azure Functions is a plus.

Qualifications

Required Qualifications:

  • Bachelor's or Master's degree in Computer Science, IT, or related field.

  • Proven experience with data pipelines and handling large datasets.

  • Advanced proficiency with Azure Databricks, Pyspark, Python, and SQL.

  • Experience building web apps using Flask, Dash, and Plotly.

  • Strong skills in Pandas, NumPy, and Matplotlib.

  • Familiarity with Delta Lakes and Azure Synapse.

  • Proficiency with Git and Azure DevOps (or similar).

  • Strong analytical and troubleshooting abilities.

  • Fluent English, both written and verbal.

  • Comfortable working across time zones and diverse environments.

Preferred Qualifications:

  • Experience improving data architectures and workflows.

  • Familiarity with data science tools and frameworks.

  • Exposure to cloud platforms beyond Azure.

Halliburton is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation .

Location

Rua Paulo Emidio Barbosa 485 Q,Rio de Janeiro,Rio de Janeiro, , Brazil

Job Details

Requisition Number:
Experience Level: Experienced Hire
Job Family: Engineering/Science/Technology
Product Service Line: Production Enhancement
Full Time / Part Time: Full-time

Additional Locations for this position:

Compensation Information
Compensation is competitive and commensurate with experience.

#J-18808-Ljbffr

  • Data Engineer

    3 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil AgileEngine Tempo inteiro

    OverviewJoin to apply for the Data Engineer (Senior) ID40199 role at AgileEngine.AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best...

  • Data Engineer

    3 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil AgileEngine Tempo inteiro

    Overview Join to apply for the Data Engineer (Senior) ID40199 role at AgileEngine . AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best...

  • Data Engineer

    3 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil buscojobs Brasil Tempo inteiro

    OverviewRole DescriptionThis is a full-time remote role for a Data Engineer at International Institute of Training Islamabad. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics.QualificationsData Engineering, Data Modeling, and ETL skillsData Warehousing and Data...

  • Senior Data Scientist

    3 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil BairesDev Tempo inteiro

    Join to apply for the Senior Data Scientist - Remote Work role at BairesDevAt BairesDev, we\'ve been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.Our diverse 4,000+ team, composed of the world\'s Top 1% of tech talent, works remotely on...

  • Senior Data Scientist

    3 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil BairesDev Tempo inteiro

    Join to apply for the Senior Data Scientist - Remote Work role at BairesDev At BairesDev, we\'ve been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world\'s Top 1% of tech talent, works remotely...

  • Senior Data Engineer

    3 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil PX Data Tempo inteiro

    OverviewPX Data AI é uma startup que entrega a máxima experiência aos clientes com inteligência artificial e soluções de dados que simplificam e potencializam a tomada de decisão nas empresas. A plataforma Luria conecta dados complexos a insights acionáveis, com papel central para você na jornada.Sobre a oportunidadeEstamos em busca de um(a)...

  • Senior Data Engineer

    3 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil PX Data Tempo inteiro

    Overview PX Data AI é uma startup que entrega a máxima experiência aos clientes com inteligência artificial e soluções de dados que simplificam e potencializam a tomada de decisão nas empresas. A plataforma Luria conecta dados complexos a insights acionáveis, com papel central para você na jornada. Sobre a oportunidade Estamos em busca de um(a)...

  • Senior Data Engineer

    4 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil Halliburton Tempo inteiro

    We are looking for the right people — people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world's largest providers of products and services to the...

  • Senior Software Engineer

    4 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil Canonical Tempo inteiro

    Join or sign in to find your next job Join to apply for the Senior Software Engineer - MAAS role at Canonical 3 months ago Be among the first 25 applicants Join to apply for the Senior Software Engineer - MAAS role at Canonical Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets....

  • Senior Software Engineer

    Há 7 dias

    Rio de Janeiro, Rio de Janeiro, Brasil Fielo Tempo inteiro R$90.000 - R$120.000 por ano

    Senior Software Engineer – Pega Systems ProjectAbout usAt Fielo, we build innovative Loyalty & Incentives solutions that transform the way companies engage with customers, partners, and employees. We are starting a strategic development project with Pega Systems and looking for a Senior Software Engineer to design and deliver scalable, secure, and...