Senior Data Engineer

Há 3 dias


Minas Gerais, Brasil Hcltech Tempo inteiro

We are HCLTech, one of the world’s largest and fastest growing technology and DSA companies with over 227,000 professionals across 60 countries, driving progress through industry-leading capabilities focused on Digital, Engineering and Cloud.

The driving force behind this work, our people, is a diverse, creative and passionate audience that enables us to continually raise the bar for excellence in our services. We strive to empower each of our professionals to achieve their best, while also striving to help them find their daily inspiration and become the best version of themselves.

We are looking for a highly talented and self-motivated Software Engineer to join us on our journey to advance the world of technology through innovation and creativity.

Job description:

The Data Engineer I supports our business goals by designing, implementing, and maintaining data pipelines using cloud-native tools in a modern data stack.

JOB RESPONSIBILITIES:

  1. Expertly perform tasks under supervision.
  2. Develop and maintain end-to-end data pipelines using cloud-native solutions to extract, load, and transform data from disparate data sources to a cloud data warehouse.
  3. Capable of formatting and distributing custom data extracts through various means (e.g., custom SFTPs, APIs (e.g., RESTful), and other bulk data transfer mediums) and optimizing data storage options based on business requirements.
  4. Competent in helping to develop/design database structure and function, schema design, and database testing protocols.
  5. Contribute to the process of defining company data assets (data models) and custom client workflows, as well as standardized data quality protocols.
  6. Capable of independently and collaboratively troubleshooting database issues and queries for improving data retrieval times across various systems (e.g., via SQL).
  7. Collaborate with both technical and non-technical stakeholders including IT, Data Science, and various team members across a diverse array of business units.
  8. Work closely with IT team whenever necessary to help facilitate, troubleshoot, or develop database connectivity between internal/external resources (e.g., on-premises Azure Data Lakes, Data Warehouses, and Data Hubs).
  9. Help implement and enforce enterprise reference architecture and ensure that data infrastructure design reflects enterprise business rules as well as data governance and security guidelines.

QUALIFICATION REQUIREMENTS:

  1. Bachelor’s degree (BS/BA) in Information Systems, Software Engineering, Computer Science, Data Engineering, or related field required. Master’s degree (MS/MA) preferred.
  2. Experience with Azure Stack (Data Lake/Blob Storage, PowerBI Services, Azure Data Factory (or equivalent), Databrick) and production level experience with on-premises Microsoft SQL Server required.
  3. Experience with ETL/ELT, taking data from various data sources and formats and ingesting into a cloud-native data warehouse, required.
  4. Experience with one of the following: Python, Pyspark , as well as standard analytic libraries/packages (e.g., pandas, Numpy, dplyr, data table, stringr, Slick, and/or Kafka) and related distribution frameworks required.
  5. Strong verbal and written communication skills required.
  6. Experience with DataRobot, Domino Data Labs, Salesforce MC, Veeva CRM preferred.
  7. Familiarity with Snowflake Warehouse preferred.
  8. Familiarity with statistical concepts and analytic modeling (e.g., regression analyses, hypothesis testing, and ML based modeling) preferred.
  9. Experience with healthcare marketing analytics, healthcare data claims, and common medical coding.

Why choose us?

  1. We are one of the largest and fastest growing technology companies in the world, with offices in over 60 countries and 224,000 employees.
  2. Our company is extremely diverse with 165 nationalities represented.
  3. We offer the opportunity to work with colleagues from all over the world.
  4. We offer a virtual-first work environment, promoting a good integration between your work and personal life, with real flexibility.
  5. We are committed to your growth, offering learning and career development opportunities at all levels to help you find your unique brilliance. We offer comprehensive benefits to all employees.
  6. We are certified as a "Great Place to Work" and "Top Employer" in 17 countries, and recognized as a “Top Employer” in Brazil specifically, offering a positive work environment that values employee recognition and respect.

Equality & Opportunity for All

Representing 165 nationalities worldwide, we are proud to be an equal opportunity employer committed to providing equal employment opportunities to all applicants and employees without regard to race, religion, sex, color, age, national origin, pregnancy, sexual orientation, disability or genetic information, or any other protected classification, in accordance with federal, state and/or local laws.

#J-18808-Ljbffr

  • Minas Gerais, Brasil AMT Services Inc Tempo inteiro

    Job Summary:The Senior Controls Software Engineer is responsible for providing engineering leadership, direction, and project management to a team of engineers assigned to the overall software design, programming, troubleshooting, and debugging side of industrial automation systems.Requirements:Minimum of 5 years of controls software experience in the...


  • Minas Gerais, Brasil Vigil Tempo inteiro

    As a Senior NodeJS engineer, you will collaborate with key stakeholders to tackle complex business challenges. You'll design and implement cutting-edge features, scale applications for high-traffic environments, and enhance user experiences across diverse brands. This role offers the opportunity to mentor team members, refine system requirements, and...


  • Minas Gerais, Brasil Rocket Financial Inc Tempo inteiro

    Senior Software Engineer (Java)- Candidates Must Be Based Out of Brazil Rocket Financial is an early-stage start-up in the Financial Technology space. Our mission is to change the way how money moves around the planet. Primarily, we are building a Banking-as-a-Service (BaaS) platform for those wanting to integrate into the world financial infrastructure....


  • Minas Gerais, Brasil Teachable, Inc. Tempo inteiro

    Teachable is trusted by creator-educators around the world to grow their impact and income. From online courses and communities to memberships and downloads, Teachable's digital learning products help creator-educators drive meaningful connection and sustainable revenue. With industry-best ecommerce tools, easily toggled on directly within the platform,...

  • Devops Engineer

    Há 3 dias


    Minas Gerais, Brasil Rocket Financial Inc Tempo inteiro

    Rocket Financial is an early-stage start-up in the Financial Technology space (Division of Salt Money). Our mission is to change the way money moves around the planet. Primarily, we are building a business technology platform for those wanting to integrate and embed financial services into their customer applications. We are looking for a Senior DevOps...

  • Data Architect

    Há 3 dias


    Minas Gerais, Brasil Andela Tempo inteiro

    Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive long-term career opportunities with leading organizations, access to a global community of...

  • Product Owner Senior

    4 semanas atrás


    Minas Gerais, Brasil Grupo Byx Tempo inteiro

    Home Empregos para Product Owner Senior em São Paulo Empregos para Product Owner Senior em São PauloSão Paulo Product Owner SeniorLocal: São Paulo Empresa: Grupo BYX Data: Hoje Sobre a BYX: A BYX possui a solução completa para viabilizar a expansão estruturada de originadores com acesso a grandes investidores / mercado de capitais interessados em...

  • Comprador Sênior

    2 semanas atrás


    Minas Gerais, Brasil Claro Brasil Tempo inteiro

    Comprador(a) Senior Local: Osasco, São Paulo Empresa: Beyond HR Data: 15/10/2024 Job description: Você gosta de Doritos, RUFFLES, LAYS, CHEETOS e outros snacks da ELMA CHIPS - PEPSICO? Sua família consome carnes da BRF, JBS, SEARA ou do Frigorífico AURORA? Na hora da emergência... Comprador Senior - Viagens Local: São Paulo Empresa: Lenovo ...

  • Data Engineer

    Há 5 horas


    Minas Gerais, Brasil Luxoft Tempo inteiro

    PLEASE APPLY WITH YOUR CV IN ENGLISH & WITH THE REQUESTED SKILLS Project Description : Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions : Ops, Risk, Trading, and Compliance....


  • Minas Gerais, Brasil Sigma Software Group Tempo inteiro

    We are looking for passionate Machine Learning Specialists to help design, build, and support our high-quality, innovative video advertising platform. Excited to innovate with us? We look forward to having you on our team! Project Our client helps the television industry to monetize their premium content through a robust technology platform, which enables...


  • Minas Gerais, Brasil FOURSYS Tempo inteiro

    5 Empregos para Desenvolvedor Backend Senior Java Springboot em São PauloSão Paulo Desenvolvedor Backend Senior - Java/SpringbootLocal: São Paulo Empresa: Foursys Data: Hoje A Foursys é um time apaixonado por inovação, design e transformação digital. Somos globais, somos GPTW. Na Foursys, celebramos a diversidade e acreditamos que são as diferentes...


  • Minas Gerais, Brasil Atra Tempo inteiro

    Vaga: Machine Learning Engineer - MLOps Descrição da Vaga: Estamos à procura de um(a) Machine Learning Engineer especializado(a) em Google Cloud para integrar nosso time. O profissional terá a principal função de operacionalizar modelos criados pelas áreas usuárias, utilizando práticas de MLOps para garantir a eficiência e...


  • Pará de Minas, Minas Gerais, Brasil Hotel Suntory Tempo inteiro

    About the RoleAs a Senior Software Engineer (Backend) at {company}, you will be responsible for designing, developing, and maintaining the backend of our software applications.ResponsibilitiesDesign and develop scalable, efficient, and reliable backend systemsMaintain and improve existing backend codebasesCollaborate with cross-functional teams to deliver...

  • Senior Product Engineer

    4 meses atrás


    Uberaba, Minas Gerais, Minas Gerais, Brasil Valmont Industries, Inc. Tempo inteiro

    Why ValmontWe’re Here to Move the World Forward.Valmont impacts millions of people around the world every day, yet they might not realize the many ways. Our technology is helping feed the growing population, supplying the world with more reliable energy and access to renewables, enhancing connectivity in remote and urban locations to create a sustainable...


  • Minas Gerais, Brasil Palladium Group, Inc. Tempo inteiro

    **Epidemiology Senior Technical Advisor** We are searching for an experienced Epidemiology Senior Technical Advisor in Antananarivo, Madagascar. **Project Overview** ***Promoting Results and Outcomes through Policy and Economic Levers (PROPEL) Health is a USAID- funded five-year project awarded to Palladium on September 23, 2022. PROPEL Health aims to...


  • Patos de Minas, Minas Gerais, Brasil We Can Br Tempo inteiro

    Job SummaryWe are seeking a skilled Senior Software Engineer to join our team and contribute to the development of our cloud infrastructure. The ideal candidate will have experience with cloud-based systems and be able to design, implement, and maintain scalable and secure infrastructure solutions.Key ResponsibilitiesDesign and implement cloud-based systems...


  • Minas Gerais, Brasil Samo Technologies Tempo inteiro

    Location : Remote Employment Type : Full-time About the Role: We are looking for a talented Node.js Backend Engineer to join our team. You will be responsible for building and maintaining backend services, ensuring seamless integrations with third-party APIs, and working with Google Cloud infrastructure. This is a fantastic opportunity for someone with a...


  • Minas Gerais, Brasil SUSE Tempo inteiro

    About UsAlways open. Our code, our culture, our opportunities. Leading open innovation without limits. We are SUSE.SUSE is a global leader in innovative, reliable and secure enterprise open source solutions, including SUSE Linux Enterprise (SLE), Rancher and NeuVector. More than 60% of the Fortune 500 rely on SUSE to power their mission-critical workloads,...

  • Consultor Sap Bw

    Há 3 dias


    Minas Gerais, Brasil Sgf Global Tempo inteiro

    Purpose of the job Designing data models, gathering stakeholder needs & wants (requirements), writing code, maintaining data documentation, communicating results and collaborating with team members. Standardizing projects in line with global Information to support company business requirements to create company value. Our value lies in bringing an...


  • Minas Gerais, Brasil Empresa De Serviços De Tecnologia Da Informação Tempo inteiro

    Gerente de Projetos SAPLocal: Híbrida, Fortaleza, Ceará Empresa: Empresa de Serviços de Tecnologia da Informação Data de publicação: 01/10/2024 Descrição: Empresa de Serviços de Tecnologia da Informação admite Gerente de Projetos SAP em Fortaleza. Tarefas pertinentes a rotinas de Gerente de Projetos SAP. Gerente de Projetos SAPLocal: Efetivo,...