Data Engineer

Há 4 horas

São Paulo Brazil, BR Pride Global Tempo inteiro

As a Data Engineer, you will be a key member of our data team, focusing on designing, developing, and maintaining data solutions for our data warehouse, data lake, and Dataverse environments. with specific focus on sourcing data and developing data solutions. In this role you will be primarily responsible for the development of data workflows, views, and stored procedures, in addition to performing data analysis, and monitoring and tuning queries and data loads. You will be working closely with data providers, and data analytics teams to facilitate the implementation of Pride Global business requirements and requests.


YOUR KEY RESPONSIBILITIES:

  • To develop ETLs, stored procedures, triggers, and views on our DB2-based Data Warehouse
  • To perform data profiling and analysis on source system data to ensure that source system data can be integrated and represented properly in our models
  • To monitor the performance of queries and data loads and perform tuning as necessary
  • To provide assistance and guidance during the QA & UAT phases to quickly confirm the validity of potential issues and to determine the root cause and best resolution of verified issues

SKILLS:

  • Develop and maintain ETL (Extract, Transform, Load) processes to ingest data from various sources into our data warehouse, data lake, and Dataverse environments
  • Design and implement data models, schemas, and structures to support efficient querying and reporting
  • Optimize data storage and retrieval processes to ensure high performance and scalability
  • Collaborate with data scientists and analysts to understand their data requirements and provide the necessary data infrastructure
  • Monitor and troubleshoot data pipelines to ensure data quality and integrity
  • Implement data security and compliance measures to protect sensitive data and ensure regulatory compliance
  • Document data workflows, processes, and best practices to facilitate knowledge sharing and collaboration


QUALIFICATIONS:

  • Bachelor's degree in Computer Science, Information Technology, or a related field
  • Proven experience as a Data Engineer, with a focus on data warehouses, data lakes, and Dataverse
  • Strong proficiency in SQL and experience with database management systems such Azure SQL Data Warehouse
  • Familiarity with data integration tools such as Apache Kafka, AWS Glue, or Azure Data Factory
  • Knowledge of data modeling techniques and best practices
  • Strong problem-solving skills and attention to detail
  • Excellent communication and collaboration skills
  • At least 5+ years of experience in data development and solutions in highly complex data environments with large data volumes
  • At least 5+ years of experience developing complex ETLs with Informatica PowerCenter
  • At least 5+ years of SQL / PLSQL experience with the ability to write ad-hoc and complex queries to perform data analysis
  • At least 5+ years of experience developing complex stored procedures, triggers, MQTs and views on IBM DB2 (experience with v10.5 a plus)
  • Experience with performance tuning DB2 tables, queries, and stored procedures
  • Experience with scripting languages like Perl and Python
  • An understanding of E-R data models (conceptual, logical and physical)
  • Strong understanding of advanced data warehouse concepts (Factless Fact Tables, Temporal \ BI-Temporal models, etc.)
  • Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions
  • Experience with both Waterfall and Agile development methodologies
  • Strong communication skills both verbal and written. Capable of collaborating effectively across a variety of IT and Business groups, across regions, roles and able to interact effectively with all levels.
  • Self starter. Proven ability to manage multiple, concurrent projects with minimal supervision. Can manage a complex ever changing priority list and resolve conflicts to competing priorities.
  • Strong problem solving skills. Ability to identify where focus is needed and bring clarity to business objectives, requirements and priorities.


Preferred Qualifications:

  • Experience with Azure cloud platform.
  • Knowledge of data governance and data quality management practices
  • Familiarity with BI tools such as Power BI, Tableau, or Looker

Salary

R220,000-R240,000 Yearly

  • Data Engineer

    2 semanas atrás

    Brazil, BR Blueclip Tempo inteiro

    As Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works.About Our SearchWe are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by machine...

  • Data Engineer

    2 semanas atrás

    Brazil, BR Remobi Tempo inteiro

    Data Engineer - (REMOTE) BrazilAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world.Our...

  • Data Engineer

    2 semanas atrás

    São Paulo, Brazil, BR TerraMagna Tempo inteiro

    Quem SomosCom 7 anos de história, a TerraMagna vive a missão de tornar a agricultura tudo aquilo que o mundo precisa que ela seja. Hoje atua como financiadora da cadeia de insumos do agronegócio. Possui mais de 1 bilhão de reais sob gestão e atua com clientes em todo o Brasil.Requisitos:Data Engineer pra trabalhar com Visão Computacional, ML, AI, dados...

  • Data Engineer

    4 meses atrás

    São Paulo, Brazil, BR CriticalRiver Inc. Tempo inteiro

    Title: Data EngineerLocation: Sao Paulo BrazilRemote: Need to Support in USA PST time zoneDuration: Fulltime Interview process:Live Hacker rank test on Advanced SQL questions.Technical screeningClient live Hacker rank interview. Summary:Need a minimum of 6 years experience in SQL, with hands-on experience in writing complex queries and optimizing database...

  • Data Engineer

    2 semanas atrás

    Brazil, BR Infosys Tempo inteiro

    Infosys Brasil está em busca de profissionais com o perfil de Data Engineer Pl e ou Sr (Databricks) Descrição da vaga:Este profissional terá um papel chave no envolvimento com a equipe de negócios e funcional no fornecimento de soluções técnicas mais adequadas, em conformidade com os padrões de desenvolvimento do cliente e da Infosys. Também...

  • Data Engineer LATAM

    2 semanas atrás

    Brazil, BR Mark & Bridges Technology Inc. Tempo inteiro

    Data Engineer LATAMEstamos em busca de engenheiro de dados experiente para atuar em projetos estratégicos utilizando Azure Data Factory, Databricks, Synapse Analytics e PySpark. A posição é voltada para profissionais localizados na América Latina/Nearshore, com contratação em regime PJ.Responsabilidades:Atuação direta no time do cliente nos EUA,...

  • Data Engineer

    2 semanas atrás

    São Paulo, Brazil, BR Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools,...

  • Senior Data Engineer

    Há 5 horas

    Brazil, BR Luxoft Tempo inteiro

    ResponsibilitiesDesign, build, and maintain scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.Work with Azure and GCP platforms, specifically managing services like Azure Databricks, Azure SQL Server, BigQuery, DataProc, and Azure Machine Learning.Develop and maintain CI/CD pipelines using GitHub Actions to...

  • Pleno Data Engineer

    2 semanas atrás

    São Paulo, Brazil, BR Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools,...

  • Data Engineer Support

    2 semanas atrás

    São Paulo, Brazil, BR Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools,...

  • Senior Data Engineer

    2 semanas atrás

    Brazil, BR Aptonet Inc Tempo inteiro

    As a Senior Data Engineer (Python/Spark) , you will play a crucial role in building and maintaining robust data ingestion pipelines, applications, and data processing systems. You will work on cutting-edge technologies and be responsible for designing, implementing, and optimizing solutions that support our Data Product Hub.Key Responsibilities:Develop and...

  • Data Engineer Sr

    2 semanas atrás

    São Paulo, Brazil, BR Infosys Tempo inteiro

    Infosys Brasil está em busca de profissionais com o perfil de Data Engineer Sr Descrição da vaga:Este profissional terá um papel chave no envolvimento com a equipe de negócios e funcional no fornecimento de soluções técnicas mais adequadas, em conformidade com os padrões de desenvolvimento do cliente e da Infosys. Também apoiará a transferência...

  • Data Engineer Senior

    2 semanas atrás

    São Paulo, Brazil, BR Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools,...

  • Lead Data Engineer

    2 semanas atrás

    Rio de Janeiro, Brazil, BR Smart Energy Water Tempo inteiro

    Company OverviewChoice Technologies, an SEW company, is a business focused in providing revenue assurance solutions for energy utilities, with more than 24 years of experience. Our products (Smart iNTL, Smart iCash, Smart iGEOs and Smart iField) provide a complete solution to mitigate non-technical losses (energy fraud), calculate Energy Balance and increase...

  • Senior Data Engineer

    2 semanas atrás

    Brazil, BR Sandbox Group Tempo inteiro

    About the roleThis is a 100% remote positionAs a Senior Data Engineer, is responsible for the development, construction, maintenance, and testing of architectures, such as databases and large-scale processing systems. Is responsible play a pivotal role in optimizing data systems and building them from the ground up, working closely with data analysts to help...

  • Azure Data Engineer

    Há 5 horas

    Brazil, BR Luxoft Tempo inteiro

    We are seeking a highly skilled Azure Data Engineer with DevSecOps experience to join our team. The ideal candidate will have strong expertise in Azure cloud services, data engineering, and DevSecOps practices, with a focus on automation, security, and the full software development lifecycle. You will be responsible for developing, maintaining, and...

  • Data Engineer Databricks

    Há 4 horas

    Brazil, BR Birlasoft Tempo inteiro

    Data Engineer Databricks [AI Solutions]Job Overview: The Data Engineer will be instrumental in designing and implementing advanced data pipelines within the Databricks environment and will play a crucial role in pre-sales activities, gathering information to develop comprehensive solutions and proposals for clients.Responsibilities and Duties:Develop and...

  • Data Engineer

    1 semana atrás

    Greater São Paulo Area, BR Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools,...

  • Senior Data Engineer

    2 semanas atrás

    Brazil, BR Sigma Software Group Tempo inteiro

    Our growing data teams are seeking a savvy Senior Data Engineer to join them and help build and evolve the next generation of Audience & Identity data platforms that handle data at scale and use state-of-the-art technologies to unlock the data’s business value.If you’re excited about working with cutting-edge technology in a fast-paced environment,...

  • Data Engineer

    2 semanas atrás

    Brazil, BR Pyramid Consulting, Inc Tempo inteiro

    Advanced proficiency in complex (ANSI-compliant) SQL queries (required)In-depth knowledge of data warehousing and data modeling techniques (required)Expertise in analytics and reporting (required)Background in Python programming & Airflow orchestrationExperience with Spark/EC2/S3 (desirable)Familiarity with Snowflake/Databricks (advantageous)