Senior Data Engineer

Há 4 dias


Brazil, BR inspired! Tempo inteiro

** PLEASE CONSIDER THE REQUIRED QUALIFICATIONS AND ENGLISH PROFICIENCY FOR THIS POSITION **


We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and optimizing data pipelines and architectures. You will leverage your Azure, Databricks, Data Warehousing, SQL, and Python/PySpark expertise to drive data-driven decisions and innovations. Experience with CI/CD processes, automation, performance tuning, and data pipeline monitoring is highly valued.


Must Have Skills:

  • Experience: Minimum of 5 years in data engineering with strong experience in Azure, Databricks, Data Warehousing, SQL, and Python/PySpark.
  • Performance Tuning: Proven experience in performance tuning of data pipelines and queries.
  • Monitoring and Alerts: Experience with monitoring and alerting systems for data pipelines.
  • Automation: Demonstrated experience in developing and maintaining automation scripts for data processes.
  • SQL Expertise: Advanced proficiency in SQL for complex queries and data manipulation.
  • Python/PySpark Proficiency: Solid experience in using Python and PySpark for data processing and analysis.
  • Problem-Solving: Strong analytical and problem-solving skills.
  • Communication: Excellent verbal and written communication skills.


Desirable Skills:

  • CI/CD Experience: Experience with CI/CD pipelines for data engineering workflows.
  • Big Data Technologies: Familiarity with additional big data technologies (e.g., Hadoop, Spark).
  • Data Governance: Knowledge of Data Governance and Data Quality best practices.
  • Project Management: Experience with agile methodologies and project management tools.
  • Certifications: Relevant certifications (e.g., Microsoft Certified: Azure Data Engineer Associate) are a plus.


Key Responsibilities:

  • Design and Development: Architect and develop robust data pipelines, ETL processes, and data models using Azure Data Factory, Databricks, and other relevant tools.
  • Data Warehousing: Implement and manage Data Warehousing solutions for efficient data storage and retrieval.
  • Data Lake/Delta Lake: Expertise in designing and implementing medallion architecture (bronze, silver, and gold layers) and data lake house solutions to ensure efficient data storage, processing, and analytics, while maintaining data quality, consistency, and accessibility.
  • SQL and Python/PySpark: Write and optimize SQL queries and develop data processing scripts using Python and PySpark.
  • Automation: Develop and maintain automation scripts for data processes to ensure efficiency.
  • Performance Tuning: Monitor and optimize the performance of data pipelines and queries to ensure high efficiency and responsiveness.
  • Monitoring and Alerts: Set up and manage monitoring and alert systems for data pipelines to proactively address issues.
  • Collaboration: Work with data scientists, analysts, BI Engineers and other stakeholders to address their data needs with technical solutions.
  • Documentation: Maintain comprehensive documentation of data processes, architectures, and workflows.

  • Senior Data Engineer

    4 semanas atrás


    São Paulo, Brazil, BR BL Consultants Tempo inteiro

    Senior Data Engineer - São Paulo, Brazil - RemoteAbout the Role: Our client is looking for a Senior Data Engineer to be a technical powerhouse to help us scale our data infrastructure, automation and tools to meet growing business needs.You’re excited about this opportunity because you will…Work with business partners and stakeholders to understand data...

  • Data Engineer

    3 semanas atrás


    Brazil, BR Insight Global Tempo inteiro

    Must-haves:5+ years of data engineer experience Experience working with AWS architecture (RDS, Glue, EMR, EC2, S3, Postgres, EMR, etc..)Snowflake data warehousingPython & SQL codingDay to Day:Insight Global is looking for 3 remote data engineers to join the analytics organization at a global medical device client. We are establishing a new data analytics...


  • Brazil, BR AllianceIT Inc Tempo inteiro

    This position is a Remote position to work from on in LATAM working with US clients. You will be working as a consultant directly with clients US Clients. Must work in US PST Zone.We offer:100% Remote PositionPaid National Holidays off$30 to $35 USD per hourTitle: Data Engineer with GCPWe are seeking a highly motivated and experienced Data Engineer to join...

  • Data Engineer

    Há 7 dias


    Brazil, BR Remobi Tempo inteiro

    We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. Because it doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world.Our clients access our community to build...

  • Data Engineer

    4 semanas atrás


    Brazil, BR Remobi Tempo inteiro

    Data Engineer - (REMOTE) BrazilAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world.Our...

  • Data Engineer

    3 meses atrás


    Brazil, BR Remobi Tempo inteiro

    Data Engineer - (REMOTE) BrazilAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world.Our...

  • Senior Data Engineer

    3 semanas atrás


    Brazil, BR Blankfactor Tempo inteiro

    This is a remote position as a contractor paying in USD. Please apply with your English CV and only if you hold a minimum B1 English comprehension level.About BlankfactorAt Blankfactor, we are dedicated to engineering impact. Our passion lies in delivering best-in-class tech solutions that enable companies to transform, innovate, and scale. We specialize in...

  • Data Engineer

    Há 1 mês


    São Paulo, Brazil, BR BL Consultants Tempo inteiro

    Data Engineering Manager - Job DescriptionA data-driven organization seeks a Data Engineering Manager to lead and mentor a team of data engineers in building enterprise-scale data solutions. This role is essential for driving data-driven decisions by implementing data structures and scalable data warehouse architecture. Your mission will be to foster a...

  • Senior Software Engineer

    4 semanas atrás


    Brazil, BR Orange Quarter Tempo inteiro

    Orange Quarter have partnered with the fastest growing scale-up in the world and I’m helping them hire Senior Software Engineers for their teams in LATAM as they accelerate towards IPO.They have a market leading HR and Payroll platform that is used by over 35,000 businesses across 150+ countries.This role entails being part of a truly cross-functional...

  • Senior DevOps Engineer

    4 semanas atrás


    Brazil, BR TLR Ventures Tempo inteiro

    This is a freelance contractor position.TLR Ventures is biotech startup backed by Jackson Laboratories, a leading global biomedical lab. We are developing a transformational technology platform for biomedical research that’s going to make a big difference in how drugs are discovered and how diseases are cured. The platform is a scientific data collection...


  • Brazil, BR TLR Ventures Tempo inteiro

    This is a freelance contractor position.TLR Ventures is biotech startup backed by Jackson Laboratories, a leading global biomedical lab. We are developing a transformational technology platform for biomedical research that’s going to make a big difference in how drugs are discovered and how diseases are cured. The platform is a scientific data collection...

  • Data Engineer

    Há 1 mês


    Brazil, BR Luxoft Tempo inteiro

    Project Description:Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics.Responsibilities:Web scraping...

  • Senior Software Engineer

    3 semanas atrás


    Brazil, BR Remobi Tempo inteiro

    Senior Software Engineer / Golang DeveloperAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. Because it doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds...

  • Senior Data Analyst

    4 semanas atrás


    Brazil, BR NoPing Tempo inteiro

    About NoPingNoPing is a leading platform in connection optimization for gamers, with over 2,000 servers worldwide. We improve latency and FPS in thousands of games, ensuring that players enjoy a smooth and competitive gaming experience without lag. Our mission is to provide gamers with the best possible online performance.What We Are Looking ForWe are...

  • Data Engineer

    4 semanas atrás


    São Paulo, Brazil, BR Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools,...


  • Brazil, BR Fraud Deflect Tempo inteiro

    Company DescriptionFraud Deflect aims to revolutionize Friendly Fraud and Chargeback Management by bringing Trust, Integrity, and Transparency to an industry often clouded in secrecy. We strive to eliminate unethical practices and provide a clear pathway for our clients.Role DescriptionWe are seeking a highly skilled Senior Python Software Engineer to join...

  • Data Engineer Sr

    Há 1 mês


    São Paulo, Brazil, BR Infosys Tempo inteiro

    Infosys Brasil está em busca de profissionais com o perfil de Data Engineer Sr Descrição da vaga:Este profissional terá um papel chave no envolvimento com a equipe de negócios e funcional no fornecimento de soluções técnicas mais adequadas, em conformidade com os padrões de desenvolvimento do cliente e da Infosys. Também apoiará a transferência...

  • Data & Analytics (SAP BW)

    4 semanas atrás


    Brazil, BR SGF Global Tempo inteiro

    Job Title: Data & Analytics (SAP BW) SrPurpose of the Job:Design data models, gather stakeholder requirements, write code, maintain data documentation, communicate results, and collaborate with team members. Standardize projects to support business requirements and create value by enhancing communication between data and business.The Functional Engineer in...

  • Senior Backend Engineer

    3 semanas atrás


    Brazil, BR Station70 Tempo inteiro

    Job Type: Full-time, Remote (US CST, EST, MST time zones)About Station70Station70 is redefining digital asset security through our wallet-agnostic platform for scalable and secure digital asset key backup and recovery. Named after the protective bunkers used in the CASTLE nuclear tests, we offer trusted infrastructure for safeguarding assets against wallet...


  • Brazil, BR DeepRec.ai Tempo inteiro

    MLOps Engineer3 month contract - multiple extensions possibleWe are hiring for an MLOps Engineer to join a high-growth AI startup backed by recent funding, building cutting-edge AI platforms for the Fintech industry. As they expand operations quarter over quarter, they are looking for an experienced MLOps Engineer to help scale their infrastructure and...