Senior Data Engineer

3 semanas atrás


Brasil inspired! Tempo inteiro

** PLEASE CONSIDER THE REQUIRED QUALIFICATIONS AND ENGLISH PROFICIENCY FOR THIS POSITION **

We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and optimizing data pipelines and architectures. You will leverage your Azure, Databricks, Data Warehousing, SQL, and Python/PySpark expertise  to drive data-driven decisions and innovations. Experience with CI/CD processes, automation, performance tuning, and data pipeline monitoring is highly valued.

Must Have Skills :

  • Experience : Minimum of 5 years in data engineering with strong experience in Azure, Databricks, Data Warehousing, SQL, and Python/PySpark.
  • Performance Tuning : Proven experience in performance tuning of data pipelines and queries.
  • Monitoring and Alerts : Experience with monitoring and alerting systems for data pipelines.
  • Automation : Demonstrated experience in developing and maintaining automation scripts for data processes.
  • SQL Expertise : Advanced proficiency in SQL for complex queries and data manipulation.
  • Python/PySpark Proficiency : Solid experience in using Python and PySpark for data processing and analysis.
  • Problem-Solving : Strong analytical and problem-solving skills.
  • Communication : Excellent verbal and written communication skills.

Desirable Skills :

  • CI/CD Experience : Experience with CI/CD pipelines for data engineering workflows.
  • Big Data Technologies : Familiarity with additional big data technologies (e.g., Hadoop, Spark).
  • Data Governance : Knowledge of Data Governance and Data Quality best practices.
  • Project Management : Experience with agile methodologies and project management tools.
  • Certifications : Relevant certifications (e.g., Microsoft Certified: Azure Data Engineer Associate) are a plus.

Key Responsibilities:

  • Design and Development : Architect and develop robust data pipelines, ETL processes, and data models using Azure Data Factory, Databricks, and other relevant tools.
  • Data Warehousing : Implement and manage Data Warehousing solutions for efficient data storage and retrieval.
  • Data Lake/Delta Lake : Expertise in designing and implementing medallion architecture (bronze, silver, and gold layers) and data lake house solutions to ensure efficient data storage, processing, and analytics, while maintaining data quality, consistency, and accessibility.
  • SQL and Python/PySpark : Write and optimize SQL queries and develop data processing scripts using Python and PySpark.
  • Automation : Develop and maintain automation scripts for data processes to ensure efficiency.
  • Performance Tuning : Monitor and optimize the performance of data pipelines and queries to ensure high efficiency and responsiveness.
  • Monitoring and Alerts : Set up and manage monitoring and alert systems for data pipelines to proactively address issues.
  • Collaboration : Work with data scientists, analysts, BI Engineers and other stakeholders to address their data needs with technical solutions.
  • Documentation : Maintain comprehensive documentation of data processes, architectures, and workflows.

  • Senior Data Engineer

    2 meses atrás


    Brasil Remobi Tempo inteiro

    Senior Data Engineer About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. Because it doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world. ...

  • Senior Data Engineer

    1 semana atrás


    Brasil Aptonet Inc Tempo inteiro

    As a Senior Data Engineer (Python/Spark) , you will play a crucial role in building and maintaining robust data ingestion pipelines, applications, and data processing systems. You will work on cutting-edge technologies and be responsible for designing, implementing, and optimizing solutions that support our Data Product Hub. Key Responsibilities: Develop...

  • Data Engineer Pl/Sr

    4 semanas atrás


    Brasil Neo BI Solution Tempo inteiro

    Estamos contratando: Data Engineer Pleno/Sênior para estruturação de Data Lake na plataforma Azure Sobre a posição: Estamos expandindo nossa equipe e buscamos um profissional Data Engineer para apoiar um de nossos clientes na estruturação de um Data Lake na plataforma Azure. Responsabilidades: Desenvolver e manter pipelines de dados utilizando...

  • Senior Data Engineer

    4 semanas atrás


    Brasil Sandbox Group Tempo inteiro

    About the role This is a 100% remote position As a Senior Data Engineer, is responsible for the development, construction, maintenance, and testing of architectures, such as databases and large-scale processing systems. Is responsible play a pivotal role in optimizing data systems and building them from the ground up, working closely with data analysts to...


  • Brasil Sigma Software Group Tempo inteiro

    Sigma Software is looking for an experienced Senior Data Engineer to join our growing engineering team. This opportunity is for you if you want to work with a tightly knit team of data engineers solving challenging problems using cutting-edge data collection, transformation, analysis, and monitoring tools in the cloud. Sounds like you? We are waiting for...


  • Brasil Andela Tempo inteiro

    Senior Data Engineer Andela Location Requirement: Brazil, Canada, Egypt. About Andela Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive...

  • Data Engineer

    2 semanas atrás


    Brasil Blueclip Tempo inteiro

    As Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works. About Our Search We are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by...

  • Data Engineer

    1 semana atrás


    Brasil Remobi Tempo inteiro

    Data Engineer - (REMOTE) Brazil About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world....

  • Data Engineer

    4 semanas atrás


    Brasil Birlasoft Tempo inteiro

    Data Engineer - Cognite Qualifications Experience with Cognite Solutions Experience in data governance and modern platforms like Data Fabric and Data Mesh. Ability to work in complex environments with large data volumes, including cloud and hybrid implementations. Hands-on experience in Data Science and AI/ML projects, with proficiency in advanced...

  • Senior Data Engineer

    1 semana atrás


    Brasil Sigma Software Group Tempo inteiro

    Our growing data teams are seeking a savvy Senior Data Engineer to join them and help build and evolve the next generation of Audience & Identity data platforms that handle data at scale and use state-of-the-art technologies to unlock the data’s business value. If you’re excited about working with cutting-edge technology in a fast-paced environment,...

  • Data Engineer

    3 semanas atrás


    Brasil Zazmic Inc Tempo inteiro

    Job Title: Senior Data Engineer (Apache Spark, GCP) Join our dynamic data team, where you’ll have the opportunity to shape the future of our data infrastructure and drive innovation across the organization. We’re looking for a highly skilled Data Engineer who thrives in a fast-paced environment and is passionate about leveraging cutting-edge...

  • Lead Data Engineer

    2 meses atrás


    Brasil Remobi Tempo inteiro

    Lead Data Engineer About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. Because it doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world. Our...

  • Senior iOS Engineer

    Há 5 dias


    Brasil Flex AI Tempo inteiro

    Job Title: Senior iOS Engineer at FlexAI – Craft the Future of Mobile AI! Flex is a free A.I. personal trainer in your pocket. We're creating a healthier world by making fitness fun, free, and effective for everybody, wherever they are.

  • Data Engineer LATAM

    Há 1 mês


    Brasil Mark & Bridges Technology Inc. Tempo inteiro

    Data Engineer LATAM Estamos em busca de engenheiro de dados experiente para atuar em projetos estratégicos utilizando Azure Data Factory, Databricks, Synapse Analytics e PySpark. A posição é voltada para profissionais localizados na América Latina/Nearshore, com contratação em regime PJ. Responsabilidades: Atuação direta no time do cliente nos...

  • Data Architect

    3 semanas atrás


    Brasil UST España & Latam Tempo inteiro

    Born digital, UST transforms lives through the power of technology. We walk alongside our clients and partners, embedding innovation and agility into everything they do. We help them create transformative experiences and human-centered solutions for a better world. UST is a mission-driven group of over 39,000+ practical problem solvers and creative...

  • Data Platform Engineer

    3 semanas atrás


    Brasil Schub Tempo inteiro

    Disclaimer: Please note that this job post appears to be in Brazil , but it is a remote position. We welcome applicants from any location in America. If you are an experienced Data Engineer looking to grow personally and professionally, apply now!   Who are we?  We are devoted to building and delivering secure, compliant, cloud-native data...

  • Lead Data Engineer

    2 meses atrás


    Brasil Sigma Software Group Tempo inteiro

    We are seeking an experienced and visionary Lead Data Engineer to join our Stellar team! As the Lead Data Engineer, you will be a key player in designing and implementing the robust data infrastructure to power our data-heavy company. You will collaborate with cross-functional teams to build core data pipelines, store data in optimal engines and formats,...


  • Brasil Fraud Deflect Tempo inteiro

    We are seeking an experienced Senior Software Engineer to mentor junior developers and lead key technical projects. The ideal candidate will have a strong background in Python development, big data, web technologies, and DevOps practices.   Responsibilities Mentor and support Python Software Engineers and Web Developers. Design, develop, and maintain...


  • Brasil Fraud Deflect Tempo inteiro

    We are seeking an experienced Senior Software Engineer to mentor junior developers and lead key technical projects. The ideal candidate will have a strong background in Python development, big data, web technologies, and DevOps practices.   Responsibilities Mentor and support Python Software Engineers and Web Developers. Design, develop, and maintain...

  • Data Engineer Analyst

    2 meses atrás


    Brasil HCLTech Tempo inteiro

    Sobre a vaga Data Engineer Analyst - BI, HCLTech São Paulo, São Paulo (Hybrid) / Tempo integral We are looking for a highly talented and self-motivated Data Engineer Analyst to join us on our journey to advance the technology world through innovation and creativity. Key Skills SQL & Data Warehousing / Business Intelligence skills ETL/ data...