Data Engineer

1 semana atrás

Porto Alegre, Rio Grande do Sul, Brasil Hewlett Packard Enterprise Tempo inteiro

Enterprise Digital Services is looking for a Data Engineer to keep evolving our Data Platform, which uses Dagster, Meltano, and other very modern ELT software.

You will create data pipelines using Python, maintain the platform, and overall evolve our entire architecture to be lean, fast, and on budget.

You will also understand our main data domains and eventually work on data analytics and/or ML pipelines on a per-need basis.

This role implements data quality checks, validation, and data governance processes to ensure the accuracy, completeness, and reliability of data.

Responsibilities

  • Designs limited enhancements, updates, and programming changes for portions and subsystems of data pipelines, repositories or models for structured/unstructured data.
  • Analyzes design and determines coding, programming, and integration activities required based on specific objectives and established project guidelines.
  • Executes and writes portions of testing plans, protocols, and documentation for assigned portion of application; identifies and debugs issues with code and suggests changes or improvements.
  • Participates as a member of a project team of other data science professionals to develop reliable, cost effective and high-quality solutions for assigned data system, model, or component.
  • Collaborates and communicates with project team regarding project progress and issue resolution.
  • Works with business stakeholders to identify business problems, opportunities and/or initiatives for which analytics models may provide insights that can contribute to or drive the development of an approach.
  • Collaborates with subject matter experts to select relevant sources of information, translates business requirements into semantic access, conceptual, logical and/or physical data models.
  • Translates data into information and insights with clear scenario analysis and business impact and execution plan to drive impact.
  • Models and frames business scenarios that are meaningful and impact critical business processes and/or decisions.
  • Performs quantification and impact analysis of existing or proposed operational policies, procedures, and governance frameworks.
Education & Experience Recommended

  • Four-year or Graduate Degree in Computer Science, Information Technology, Software Engineering, Statistics/ Mathematics, or any other related discipline or commensurate work experience or demonstrated competence.
  • Typically has 3-5 years of work experience, preferably in data analytics, data engineering, data modeling, or a related field or an advanced degree with little or no work experience.
Knowledge & Skills

  • Deep Python and SQL expertise
  • Deep understanding of Spark, Pandas, Polars, or other modern Data libraries and frameworks
  • Experience with AWS
  • Experience with CI/CD, and modern development practices, such as pull request code reviews
  • Experience with Linux development toolset, such as Bash scripts, Makefiles, WSL
  • Desired, but not required, experience in Dagster, Airflow, or Meltano
Disclaimer

  • This job description describes the general nature and level of work performed in this role. It is not intended to be an exhaustive list of all duties, skills, responsibilities, knowledge, etc. These may be subject to change and additional functions may be assigned as needed by management.
Job -Software Data EngineerDescription - Job Summary

Enterprise Digital Services is looking for a Data Engineer to keep evolving our Data Platform, which uses Dagster, Meltano, and other very modern ELT software.

You will create data pipelines using Python, maintain the platform, and overall evolve our entire architecture to be lean, fast, and on budget.

You will also understand our main data domains and eventually work on data analytics and/or ML pipelines on a per-need basis.

This role implements data quality checks, validation, and data governance processes to ensure the accuracy, completeness, and reliability of data.

Responsibilities

  • Designs limited enhancements, updates, and programming changes for portions and subsystems of data pipelines, repositories or models for structured/unstructured data.
  • Analyzes design and determines coding, programming, and integration activities required based on specific objectives and established project guidelines.
  • Executes and writes portions of testing plans, protocols, and documentation for assigned portion of application; identifies and debugs issues with code and suggests changes or improvements.
  • Participates as a member of a project team of other data science professionals to develop reliable, cost effective and high-quality solutions for assigned data system, model, or component.
  • Collaborates and communicates with project team regarding project progress and issue resolution.
  • Works with business stakeholders to identify business problems, opportunities and/or initiatives for which analytics models may provide insights that can contribute to or drive the development of an approach.
  • Collaborates with subject matter experts to select relevant sources of information, translates business requirements into semantic access, conceptual, logical and/or physical data models.
  • Translates data into information and insights with clear scenario analysis and business impact and execution plan to drive impact.
  • Models and frames business scenarios that are meaningful and impact critical business processes and/or decisions.
  • Performs quantification and impact analysis of existing or proposed operational policies, procedures, and governance frameworks.
Education & Experience Recommended

  • Four-year or Graduate Degree in Computer Science, Information Technology, Software Engineering, Statistics/ Mathematics, or any other related discipline or commensurate work experience or demonstrated competence.
  • Typically has 3-5 years of work experience, preferably in data analytics, data engineering, data modeling, or a related field or an advanced degree with little or no work experience.
Knowledge & Skills

  • Deep Python and SQL expertise
  • Deep understanding of Spark, Pandas, Polars, or other modern Data libraries and frameworks
  • Experience with AWS
  • Experience with CI/CD, and modern development practices, such as pull request code reviews
  • Experience with Linux development toolset, such as Bash scripts, Makefiles, WSL
  • Desired, but not required, experience in Dagster, Airflow, or Meltano
Disclaimer

  • This job description describes the general nature and level of work performed in this role. It is not intended to be an exhaustive list of all duties, skills, responsibilities, knowledge, etc. These may be subject to change and additional functions may be assigned as needed by management.
Job -SoftwareSchedule -Full timeShift -No shift premium (Brazil)Travel -Not SpecifiedRelocation -No Equal Opportunity Employer (EEO) - HP, Inc.

provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s).

Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested.

This information is provided voluntarily. The information obtained will be kept in strict confidence.
If you'd like more information about HP'sEEO Policy or your EEO rights as an applicant under the law, please click here:Equal Employment Opportunity is the Law Equal Employment Opportunity is the Law – Supplement

You're driven to make positive changes. We're driven to find people like you. We have a lot in common.
At HP, diversity and inclusion are business imperatives.
We are driven to be the career destination for all top talent.
Join us in reinventing the standard for diversity and inclusion where talent is our criteria.
Having trouble with this page or with applying to a role?
Click here to submit a request for support.
#J-18808-Ljbffr

  • Data Engineer

    Há 7 dias

    Porto Alegre, Rio Grande do Sul, Brasil Poatek Tempo inteiro

    The Opportunity As a Data Engineer part of our growing Data Science team, you will be responsible for designing, implementing, and maintaining robust and scalable data pipelines, enabling efficient data integration, storage, and processing across our various data sources. You will collaborate with cross-functional teams, including Data Scientists,...

  • Senior Engineer

    1 semana atrás

    Porto Alegre, Rio Grande do Sul, Brasil Automatic Data Processing, Inc. Tempo inteiro

    ADP is hiring a Senior Engineer - CelergoSite reliability engineer is responsible for availability, performance, efficiency, change management, monitoring, emergency response, and capacity planning. He or She will be responsible to deliver automations which makes the MNC systems and platforms more reliable and efficient resulting in the Improved Client...

  • Lead Machine Learning Engineer

    1 semana atrás

    Porto Alegre, Rio Grande do Sul, Brasil Automatic Data Processing, Inc. Tempo inteiro

    ADP DataCloud is hiring an Lead Machine Learning / AI EngineerDoes having access to one of the world's most comprehensive data sets excite you? Are you empathetic to client needs and inspired by transformation and impacting the lives of millions of people every day? Are you looking to join a dynamic, inclusive team environment with a culture of collaboration...

  • Data Scientist

    1 semana atrás

    Porto Alegre, Rio Grande do Sul, Brasil Hewlett Packard Tempo inteiro

    _ Responsibilities_ Mines data using modern tools and programming languages. Defines and implements models to uncover patterns and predictions creating business value and innovation. Works with project team to understand problem statements, initiates and direction. Tells stories with the data using visualization tools/methods to demonstrate insight impact....

  • Senior Frontend Engineer

    Há 7 dias

    Porto Alegre, Rio Grande do Sul, Brasil Singular Tempo inteiro

    Who we are?We are a software development company that creates unique high-quality software solutions tailored to the specific needs of each client. Our approach to software development is akin to a boutique experience, where our dedicated team offers unparalleled agility and flexibility, all while comprehending the unique needs and objectives of our...

  • Senior Frontend Engineer

    1 semana atrás

    Porto Alegre, Rio Grande do Sul, Brasil Singular Tempo inteiro

    Who we are?We are a software development company that creates unique high-quality software solutions tailored to the specific needs of each client. Our approach to software development is akin to a boutique experience, where our dedicated team offers unparalleled agility and flexibility, all while comprehending the unique needs and objectives of our...

  • Data Scientist

    Há 7 dias

    Porto Alegre, Rio Grande do Sul, Brasil Poatek Tempo inteiro

    The Opportunity As a Machine Learning Engineer on our team, you'll design, develop, and deliver machine learning solutions, decipher loosely defined problems using complex datasets, and determine appropriate analytical and modeling techniques. You'll analyze structured and unstructured data, establish automated processes for large-scale modeling, perform...

  • Data Scientist

    1 semana atrás

    Porto Alegre, Rio Grande do Sul, Brasil WillowTree Tempo inteiro

    Machine Learning EngineerWho We AreIn 2021, Poatek was acquired by WillowTree, an award-winning digital product consultancy recognized as one of the fastest growing and best places to work in the United States. Now a , with offices across the globe, we continue to partner with the world's leading brands, such as the FOX, Capital One, HBO, PepsiCo, Domino's...

  • Staff Analog Engineer

    1 semana atrás

    Porto Alegre, Rio Grande do Sul, Brasil Impinj Tempo inteiro

    Team Overview: We are looking for a Staff Analog Engineer to join the Impinj silicon engineering team to work on the next generation of tag and reader chips. We are a fun, hardworking team of top-tier silicon designers that value and celebrate partnership and teamworkWhat you will do: Work with team to specify and architect advance RFID Reader IC'sImplement...

  • Machine Learning Engineer

    1 semana atrás

    Porto Alegre, Rio Grande do Sul, Brasil Adp Tempo inteiro

    Position DescriptionADP is hiring a Machine Learning Engineer Focus in NLP/Generative AI: Does the thought of working with one of the most comprehensive employment data sets excite you?Are you inspired by transformation and making an impact on the lives of millions of people every day?Well, this may be the role for you.Ready to design what's next?In this...

  • Data Engineer

    Há 1 mês

    Porto Alegre, Rio Grande do Sul, Rio Grande do Sul, Brasil Nelogica Tempo inteiro

    Aqui na Nelogica, desenvolvemos tecnologias e pessoas de alta performance com o propósito de transformar o futuro do mercado financeiro! Você tem sede de desafios e está a fim de fazer parte de um time que busca a excelência, impactando diretamente milhares de usuários?Esta posição é para o nosso time de Banco de Dados, com o objetivo de desenvolver...

  • Data Engineer

    3 semanas atrás

    Porto Alegre, Rio Grande do Sul, Rio Grande do Sul, Brasil Nelogica Tempo inteiro

    Aqui na Nelogica, desenvolvemos tecnologias e pessoas de alta performance com o propósito de transformar o futuro do mercado financeiro! Você tem sede de desafios e está a fim de fazer parte de um time que busca a excelência, impactando diretamente milhares de usuários?Esta posição é para o nosso time de Banco de Dados, com o objetivo de desenvolver...

  • Data Engineer

    Há 4 dias

    Porto Alegre, Rio Grande do Sul, Rio Grande do Sul, Brasil Nelogica Tempo inteiro

    Aqui na Nelogica, desenvolvemos tecnologias e pessoas de alta performance com o propósito de transformar o futuro do mercado financeiro! Você tem sede de desafios e está a fim de fazer parte de um time que busca a excelência, impactando diretamente milhares de usuários?Esta posição é para o nosso time de Banco de Dados, com o objetivo de desenvolver...

  • Staff Analog Engineer

    1 semana atrás

    Porto Alegre, Rio Grande do Sul, Brasil Impinj Tempo inteiro

    Team Overview:We are looking for a Staff Analog Engineer to join the Impinj silicon engineering team to work on the next generation of tag and reader chips. We are a fun, hardworking team of top-tier silicon designers that value and celebrate partnership and teamworkWhat you will do: Work with team to specify and architect advance RFID Reader IC's Implement...

  • Database Engineer

    1 semana atrás

    Porto Alegre, Rio Grande do Sul, Brasil Nearsure Tempo inteiro

    What is it like to work at Nearsure?A remote team never felt so close Join our LATAM team and stay connected while working remotely. We value our team members and candidates interested in our vacancies. Enjoy fun activities like coffee breaks, tech talks, and games with our developers and management teams during your stay with us.Who needs micromanagement? ...

  • Data Leader

    1 semana atrás

    Porto Alegre, Rio Grande do Sul, Brasil Sicredi Tempo inteiro

    Responsabilidades e atribuições Liderar o time técnico de dados no contexto da tribo (vertical). Executar atividades de gestão de pessoas: 1:1, desenvolvimento de carreira, rotinas administrativas com os liderados. Criar um ambiente propício para desenvolvimento profissional; Estimular que o time traga soluções de melhoria contínua para resolver os...

  • Cas Data Leader

    1 semana atrás

    Porto Alegre, Rio Grande do Sul, Brasil Sicredi Tempo inteiro

    Liderar o time de Dados da Superintendência de Aceitação, Consórcios e Arrecadação e viabilizar a cultura data-driven no dia a dia.Foco em aprimorar todo o pipeline de dados, desde a sua estruturação até a tomada de decisão.Responsabilidades e atribuições Liderar o time técnico de dados da Superintendência. Fortalecer a cultura de dados na...

  • Lead Devops Engineer

    1 semana atrás

    Porto Alegre, Rio Grande do Sul, Brasil Adp, Inc. Tempo inteiro

    ADP is hiring a Lead DevOps Engineer. Are you empathetic to client needs and inspired by transformation and impacting the lives of millions of people every day? Are you passionate about automation with a background in full-stack development? Are you looking tojoin a dynamic, inclusiveteam environmentwith a culture of collaboration and belonging? Well, this...

  • Senior Engineer

    1 semana atrás

    Porto Alegre, Rio Grande do Sul, Brasil ADP Tempo inteiro

    Position Description ADP is hiring a Senior Engineer - Celergo Site reliability engineer is responsible for availability, performance, efficiency, change management, monitoring, emergency response, and capacity planning. He or She will be responsible to deliver automations which makes the MNC systems and platforms more reliable and efficient...

  • Devops Engineer

    1 semana atrás

    Porto Alegre, Rio Grande do Sul, Brasil Db Services Portugal Tempo inteiro

    DBServices helps to design, develop and support digital platforms for large and mid-sized companies in ITC, Banking, Retail, Government, Health, and other industries in Europe and Americas.TasksLead the migration process from SVN to Git/GitHub, ensuring smooth transition and minimal disruption to ongoing projects.Collaborate with development teams to...