Senior Data Engineer

2 meses atrás


Brasil Sigma Software Group Tempo inteiro

Sigma Software is looking for an experienced Senior Data Engineer to join our growing engineering team. This opportunity is for you if you want to work with a tightly knit team of data engineers solving challenging problems using cutting-edge data collection, transformation, analysis, and monitoring tools in the cloud.

Sounds like you?

We are waiting for you on our team

CUSTOMER

Our client has superior end-to-end technology, a premium marketplace, and best-in-market advisory services that power the world’s advertising businesses of the largest media and entertainment companies. For example, Fox, NBC Universal, Viacom in the USA, Sky, Channel 4, RTE, and Mediaset in Europe.

PROJECT

We invite you to work with the provider of comprehensive ad platforms for publishers, advertisers, and media buyers. We build and support high-quality data solutions to process terabytes of data on AWS’s cloud-native data platform.

RESPONSIBILITIES

  • Build and maintain ETL pipelines
  • Modify existing application code or interfaces or build new application components
  • Analyze requirements, support design, code, test, debug, deploy, and maintain programs and interfaces. Documentation of the work is essential
  • Develop and implement databases, data collection systems, data analytics, and other strategies that optimize statistical efficiency and quality
  • Conduct code and design reviews to ensure the high quality of the product
  • Mentor and guide colleagues and new team members
  • Collaborate with Data engineers and Product Managers to prioritize business needs and translate complex product requirements into working high-quality cloud-native data solutions
  • Share knowledge with wider engineering teams by doing technical demos

REQUIREMENTS

  • 5+ years of hands-on experience in the Software Development field and/or Big Data
  • Excellent knowledge of Python
  • Proficient in PySpark and a strong understanding of Spark
  • Understanding of ETL frameworks such as DBT
  • Experience with orchestration tools such as Airflow
  • Knowledge of Lakehouse architecture on top of AWS such as Apache Iceberg, Hudi, or Delta Lake
  • Strong understanding of AWS (IAM, S3, Security groups)
  • Proficient in Infra as code (Terraform or similar)
  • Great communication skills: Able to articulate clearly about status, blockers, and design
  • Ability to work independently and collaboratively
  • At least an Upper-Intermediate level of English

WOULD BE A PLUS

  • Experience dealing with modern aspects of Lakehouse such as Databricks Unity Catalog and Snowflake Iceberg integration

  • Senior Data Engineer

    2 meses atrás


    Brasil Remobi Tempo inteiro

    Senior Data Engineer About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. Because it doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world. ...

  • Senior Data Engineer

    2 semanas atrás


    Brasil Aptonet Inc Tempo inteiro

    As a Senior Data Engineer (Python/Spark) , you will play a crucial role in building and maintaining robust data ingestion pipelines, applications, and data processing systems. You will work on cutting-edge technologies and be responsible for designing, implementing, and optimizing solutions that support our Data Product Hub. Key Responsibilities: Develop...

  • Data Engineer Pl/Sr

    4 semanas atrás


    Brasil Neo BI Solution Tempo inteiro

    Estamos contratando: Data Engineer Pleno/Sênior para estruturação de Data Lake na plataforma Azure Sobre a posição: Estamos expandindo nossa equipe e buscamos um profissional Data Engineer para apoiar um de nossos clientes na estruturação de um Data Lake na plataforma Azure. Responsabilidades: Desenvolver e manter pipelines de dados utilizando...

  • Senior Data Engineer

    3 semanas atrás


    Brasil inspired! Tempo inteiro

    ** PLEASE CONSIDER THE REQUIRED QUALIFICATIONS AND ENGLISH PROFICIENCY FOR THIS POSITION ** We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and optimizing data pipelines and architectures. You will leverage your Azure, Databricks, Data Warehousing, SQL, and...

  • Senior Data Engineer

    4 semanas atrás


    Brasil Sandbox Group Tempo inteiro

    About the role This is a 100% remote position As a Senior Data Engineer, is responsible for the development, construction, maintenance, and testing of architectures, such as databases and large-scale processing systems. Is responsible play a pivotal role in optimizing data systems and building them from the ground up, working closely with data analysts to...


  • Brasil Andela Tempo inteiro

    Senior Data Engineer Andela Location Requirement: Brazil, Canada, Egypt. About Andela Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive...

  • Data Engineer

    2 semanas atrás


    Brasil Blueclip Tempo inteiro

    As Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works. About Our Search We are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by...

  • Data Engineer

    2 semanas atrás


    Brasil Remobi Tempo inteiro

    Data Engineer - (REMOTE) Brazil About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world....

  • Data Engineer

    4 semanas atrás


    Brasil Birlasoft Tempo inteiro

    Data Engineer - Cognite Qualifications Experience with Cognite Solutions Experience in data governance and modern platforms like Data Fabric and Data Mesh. Ability to work in complex environments with large data volumes, including cloud and hybrid implementations. Hands-on experience in Data Science and AI/ML projects, with proficiency in advanced...

  • Senior Data Engineer

    1 semana atrás


    Brasil Sigma Software Group Tempo inteiro

    Our growing data teams are seeking a savvy Senior Data Engineer to join them and help build and evolve the next generation of Audience & Identity data platforms that handle data at scale and use state-of-the-art technologies to unlock the data’s business value. If you’re excited about working with cutting-edge technology in a fast-paced environment,...

  • Data Engineer

    3 semanas atrás


    Brasil Zazmic Inc Tempo inteiro

    Job Title: Senior Data Engineer (Apache Spark, GCP) Join our dynamic data team, where you’ll have the opportunity to shape the future of our data infrastructure and drive innovation across the organization. We’re looking for a highly skilled Data Engineer who thrives in a fast-paced environment and is passionate about leveraging cutting-edge...

  • Senior iOS Engineer

    Há 6 dias


    Brasil Flex AI Tempo inteiro

    Job Title: Senior iOS Engineer at FlexAI – Craft the Future of Mobile AI! Flex is a free A.I. personal trainer in your pocket. We're creating a healthier world by making fitness fun, free, and effective for everybody, wherever they are.

  • Lead Data Engineer

    2 meses atrás


    Brasil Remobi Tempo inteiro

    Lead Data Engineer About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. Because it doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world. Our...

  • Data Engineer LATAM

    Há 1 mês


    Brasil Mark & Bridges Technology Inc. Tempo inteiro

    Data Engineer LATAM Estamos em busca de engenheiro de dados experiente para atuar em projetos estratégicos utilizando Azure Data Factory, Databricks, Synapse Analytics e PySpark. A posição é voltada para profissionais localizados na América Latina/Nearshore, com contratação em regime PJ. Responsabilidades: Atuação direta no time do cliente nos...

  • Data Architect

    3 semanas atrás


    Brasil UST España & Latam Tempo inteiro

    Born digital, UST transforms lives through the power of technology. We walk alongside our clients and partners, embedding innovation and agility into everything they do. We help them create transformative experiences and human-centered solutions for a better world. UST is a mission-driven group of over 39,000+ practical problem solvers and creative...

  • Data Platform Engineer

    3 semanas atrás


    Brasil Schub Tempo inteiro

    Disclaimer: Please note that this job post appears to be in Brazil , but it is a remote position. We welcome applicants from any location in America. If you are an experienced Data Engineer looking to grow personally and professionally, apply now!   Who are we?  We are devoted to building and delivering secure, compliant, cloud-native data...

  • Lead Data Engineer

    2 meses atrás


    Brasil Sigma Software Group Tempo inteiro

    We are seeking an experienced and visionary Lead Data Engineer to join our Stellar team! As the Lead Data Engineer, you will be a key player in designing and implementing the robust data infrastructure to power our data-heavy company. You will collaborate with cross-functional teams to build core data pipelines, store data in optimal engines and formats,...


  • Brasil Fraud Deflect Tempo inteiro

    We are seeking an experienced Senior Software Engineer to mentor junior developers and lead key technical projects. The ideal candidate will have a strong background in Python development, big data, web technologies, and DevOps practices.   Responsibilities Mentor and support Python Software Engineers and Web Developers. Design, develop, and maintain...


  • Brasil Fraud Deflect Tempo inteiro

    We are seeking an experienced Senior Software Engineer to mentor junior developers and lead key technical projects. The ideal candidate will have a strong background in Python development, big data, web technologies, and DevOps practices.   Responsibilities Mentor and support Python Software Engineers and Web Developers. Design, develop, and maintain...

  • Data Engineer Analyst

    2 meses atrás


    Brasil HCLTech Tempo inteiro

    Sobre a vaga Data Engineer Analyst - BI, HCLTech São Paulo, São Paulo (Hybrid) / Tempo integral We are looking for a highly talented and self-motivated Data Engineer Analyst to join us on our journey to advance the technology world through innovation and creativity. Key Skills SQL & Data Warehousing / Business Intelligence skills ETL/ data...