Lead Data Engineer

1 semana atrás

Rio de Janeiro Brazil, BR Smart Energy Water Tempo inteiro

Company Overview

Choice Technologies, an SEW company, is a business focused in providing revenue assurance solutions for energy utilities, with more than 24 years of experience. Our products (Smart iNTL, Smart iCash, Smart iGEOs and Smart iField) provide a complete solution to mitigate non-technical losses (energy fraud), calculate Energy Balance and increase Cash Collection using machine learning techniques, geospatial technologies and intense process analysis. Our current customers are Utilities companies (Energy, Gas and Water distribution) in Latin America.

We help our customers to achieve their goals to reduce energy losses and increase revenue, by providing our technology, consulting services and R&D projects.


About the role

As a Lead Data Engineer at Choice Tech you will be responsible for designing and implementing the data integration architecture between our customers’ data source systems and Choice solutions. You will be responsible for the full lifecycle of an ETL project, including solution design, development, testing, automation, production delivery, and post-implementation support.


You will work closely with cross-functional teams to ensure the availability, reliability and scalability of our solutions. This role offers the opportunity to lead data matters while contributing to the strategic vision of our data initiatives in conjunction with our other product and delivery team members.


Main responsibilities

  • Data Architecture: Develop and maintain a robust and scalable data architecture that supports the needs of the business.
  • Data Integration: Lead efforts to collect, process, and integrate data from various sources into our solutions.
  • Data Transformation: Design and implement ETL (Extract, Transform, Load) processes to clean, transform, and prepare data for analysis.
  • Data Quality: Ensure data accuracy, consistency, and integrity by implementing data quality checks and monitoring procedures.
  • Team Leadership: Supervise and mentor a team of data engineers and team of delivery, providing guidance and fostering their professional development.
  • Performance Optimization: Continuously optimize data pipelines and processes for improved efficiency and speed.
  • Data Security: Implement and maintain data security and compliance measures to protect sensitive information.
  • Collaboration: Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver actionable insights.
  • Documentation: Create and maintain comprehensive documentation of data engineering processes and systems.
  • Development: Develop, test and implement T-SQL/PL-SQL codes, creating tables, modeling relational and non-relational diagrams. Develops no-SQL routines for unstructured and non-normalized databases.



Requirements

  • Background in Computer Science, Data Engineering or a related field.
  • Previous experience in data engineering and data integration process, with a strong track record of designing and implementing complex data solutions.
  • Proficiency in data warehousing concepts and technologies (e.g., SQL, NoSQL, Snowflake).
  • Strong programming skills in languages such as T-SQL
  • Experience with data pipeline orchestration tools (e.g., Pentaho, Apache NiFi, Jenkins and AWS Glue).
  • Knowledge of data modeling and database design principles.
  • Excellent problem-solving and troubleshooting skills.
  • Strong leadership and team management capabilities.
  • Effective communication skills and the ability to work collaboratively across departments.
  • Experience with product deployment
  • Knowledge of SAP Basis integration
  • Speak English full professional
  • Spanish is a plus
  • Familiarity with big data technologies (e.g., Hadoop, Spark) is a plus.



"Choice Tech, an SEW company, is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, disability status, genetic information, protected veteran status, or any other characteristic protected by law."

  • Data Engineer

    1 semana atrás

    Brazil, BR Blueclip Tempo inteiro

    As Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works.About Our SearchWe are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by machine...

  • Data Engineer

    1 semana atrás

    Brazil, BR Remobi Tempo inteiro

    Data Engineer - (REMOTE) BrazilAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world.Our...

  • Data Engineer

    4 meses atrás

    São Paulo, Brazil, BR CriticalRiver Inc. Tempo inteiro

    Title: Data EngineerLocation: Sao Paulo BrazilRemote: Need to Support in USA PST time zoneDuration: Fulltime Interview process:Live Hacker rank test on Advanced SQL questions.Technical screeningClient live Hacker rank interview. Summary:Need a minimum of 6 years experience in SQL, with hands-on experience in writing complex queries and optimizing database...

  • Data Engineer

    1 semana atrás

    Brazil, BR Infosys Tempo inteiro

    Infosys Brasil está em busca de profissionais com o perfil de Data Engineer Pl e ou Sr (Databricks) Descrição da vaga:Este profissional terá um papel chave no envolvimento com a equipe de negócios e funcional no fornecimento de soluções técnicas mais adequadas, em conformidade com os padrões de desenvolvimento do cliente e da Infosys. Também...

  • Data Engineer LATAM

    1 semana atrás

    Brazil, BR Mark & Bridges Technology Inc. Tempo inteiro

    Data Engineer LATAMEstamos em busca de engenheiro de dados experiente para atuar em projetos estratégicos utilizando Azure Data Factory, Databricks, Synapse Analytics e PySpark. A posição é voltada para profissionais localizados na América Latina/Nearshore, com contratação em regime PJ.Responsabilidades:Atuação direta no time do cliente nos EUA,...

  • Data Engineer

    1 semana atrás

    São Paulo, Brazil, BR TerraMagna Tempo inteiro

    Quem SomosCom 7 anos de história, a TerraMagna vive a missão de tornar a agricultura tudo aquilo que o mundo precisa que ela seja. Hoje atua como financiadora da cadeia de insumos do agronegócio. Possui mais de 1 bilhão de reais sob gestão e atua com clientes em todo o Brasil.Requisitos:Data Engineer pra trabalhar com Visão Computacional, ML, AI, dados...

  • Senior Data Engineer

    1 semana atrás

    Brazil, BR Aptonet Inc Tempo inteiro

    As a Senior Data Engineer (Python/Spark) , you will play a crucial role in building and maintaining robust data ingestion pipelines, applications, and data processing systems. You will work on cutting-edge technologies and be responsible for designing, implementing, and optimizing solutions that support our Data Product Hub.Key Responsibilities:Develop and...

  • Senior Data Engineer

    1 semana atrás

    Brazil, BR Sandbox Group Tempo inteiro

    About the roleThis is a 100% remote positionAs a Senior Data Engineer, is responsible for the development, construction, maintenance, and testing of architectures, such as databases and large-scale processing systems. Is responsible play a pivotal role in optimizing data systems and building them from the ground up, working closely with data analysts to help...

  • Data Engineer

    1 semana atrás

    São Paulo, Brazil, BR Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools,...

  • Senior Data Engineer

    1 semana atrás

    Brazil, BR Sigma Software Group Tempo inteiro

    Our growing data teams are seeking a savvy Senior Data Engineer to join them and help build and evolve the next generation of Audience & Identity data platforms that handle data at scale and use state-of-the-art technologies to unlock the data’s business value.If you’re excited about working with cutting-edge technology in a fast-paced environment,...

  • Data Engineer

    1 semana atrás

    Brazil, BR Pyramid Consulting, Inc Tempo inteiro

    Advanced proficiency in complex (ANSI-compliant) SQL queries (required)In-depth knowledge of data warehousing and data modeling techniques (required)Expertise in analytics and reporting (required)Background in Python programming & Airflow orchestrationExperience with Spark/EC2/S3 (desirable)Familiarity with Snowflake/Databricks (advantageous)

  • Pleno Data Engineer

    1 semana atrás

    São Paulo, Brazil, BR Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools,...

  • Data Engineer Support

    1 semana atrás

    São Paulo, Brazil, BR Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools,...

  • Data Engineer Sr

    1 semana atrás

    São Paulo, Brazil, BR Infosys Tempo inteiro

    Infosys Brasil está em busca de profissionais com o perfil de Data Engineer Sr Descrição da vaga:Este profissional terá um papel chave no envolvimento com a equipe de negócios e funcional no fornecimento de soluções técnicas mais adequadas, em conformidade com os padrões de desenvolvimento do cliente e da Infosys. Também apoiará a transferência...

  • Data Engineer Senior

    1 semana atrás

    São Paulo, Brazil, BR Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools,...

  • Business Intelligence Engineer

    Há 7 dias

    Brazil, BR Insight Global Tempo inteiro

    We are seeking a highly skilled BI Engineer with expertise in Tableau and Snowflake to join our dynamic data team. The BI Engineer will play a critical role in designing, developing, and optimizing data visualization solutions, supporting data warehousing efforts, and ensuring seamless data flow between our systems. You will be responsible for transforming...

  • Network Engineer

    1 semana atrás

    Rio de Janeiro, Brazil, BR ZTE do Brasil Tempo inteiro

    Datacomms Engineer PositionJob Description, Duties & ResponsibilitiesDWDM Network engineer to work in engineering team for deployment of DWDM products, as well to provide technical support for customers' network.- Responsible for technical and engineering delivery of DWDM products in implementation phase, including site survey, installation,...

  • Azure Data Factory Engineers

    1 semana atrás

    Brazil, BR Everest Technologies, Inc Tempo inteiro

    Requirements:Hands on experience with Azure data platform stack: Azure Databricks, Azure Data Factory, Azure Data Lake storage, Azure DevOps, Azure FunctionsExperience with designing and building end-to-end pipelinesExperience in Azure DevOps CI/CD Stories, Bugs, and Issue managementStrong experience in shell scripting is required.Strong ETL...

  • Machine Learning Engineer

    Há 23 horas

    Brazil, BR Genesis Consulting Partners, LLC Tempo inteiro

    AI / ML Engineer Python - atuação internacionalJob DescriptionWe are seeking a skilled ML Engineer with a strong understanding of Machine Learning Ops and its application in AI and machine learning environments. The professional will be working on various AI/ML projects in many industries to server customer needs and requirements. Our team will work with...

  • Adobe Platform Engineer

    Há 23 horas

    Brazil, BR System Soft Technologies Tempo inteiro

    Job Summary:One of our Client is looking for Adobe Platform EngineerResponsibilities:Work on Journey configuration, offer configuration and segment creationBuild AEP data model and data flows and jobsDevelop reports in Customer Journey AnalyticsCollaborate with other developers to for solution development.Develop good working relationship with client and...