Unlock Your Potential as a Senior Data Scientist

Há 3 dias

São Paulo, São Paulo, Brasil beBeeDataEngineer Tempo inteiro R$600.000 - R$1.000.000

Data Engineer Position

This is a highly challenging role that requires a deep understanding of data engineering principles and practices. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.

You will work with a team of experienced professionals to design and implement data pipelines, data warehouses, and data lakes using various technologies such as AWS API Gateway, Lambda, Fargate, PySpark, Glue Data Catalog, and S3.

Key responsibilities include:

  • Data Ingestion: Design and develop APIs using AWS API Gateway to ingest data from various sources.
  • Data Processing: Implement data processing pipelines in PySpark (AWS Glue or EMR) to process large datasets.
  • Data Storage: Manage data storage in S3 and Glue Data Catalog.
  • Data Quality: Ensure data quality and integrity through data quality checks.
  • Pipeline Optimization: Optimize pipeline costs and performance.
  • Documentation: Create and maintain technical documentation and development standards.

Required Skills and Qualifications

  • AWS Experience: Proven experience with AWS (API Gateway, Lambda/Fargate, S3, Glue, CloudWatch).
  • PySpark Knowledge: Strong knowledge of PySpark (partitioning, joins, optimization).
  • Glue Data Catalog Experience: Experience with Glue Data Catalog and queries via Athena.
  • Data Integration and Manipulation: Experience with data integration and manipulation in REST APIs.
  • Infrastructure as Code: Knowledge of infrastructure as code (Terraform or CloudFormation).
  • Best Practices: Best practices in versioning (Git) and CI/CD.
  • Language Proficiency: Advanced proficiency in English.

Benefits of Working with Us

  • Culture of Unlimited Learning: We foster a culture of unlimited learning and mutual development.
  • Collaborative Environment: Our collaborative environment empowers you to share ideas, learn from each other, and drive success together.

What We're Looking For

  • Proactive Problem-Solving: Ability to handle agile environments and rapid changes.
  • Good Communication and Teamwork: Good communication and teamwork skills.

  • Unlock Your Potential as a Data Expert

    Há 24 horas

    São Paulo, São Paulo, Brasil beBeeDataExpert Tempo inteiro R$80.000 - R$120.000

    Unlock Your Potential as a Data ExpertA career in data science offers an exciting opportunity to apply your analytical skills and knowledge of mathematical models to drive business success. At our organization, we strive for innovation and excellence in all aspects of our work.About the RoleThis position requires collaboration with cross-functional teams to...

  • Data Scientist

    4 semanas atrás

    São Paulo, São Paulo, Brasil BairesDev Tempo inteiro

    Join to apply for the Data Scientist - Remote Work role at BairesDev1 day ago Be among the first 25 applicantsJoin to apply for the Data Scientist - Remote Work role at BairesDevAt BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon...

  • Data Scientist

    Há 4 dias

    São Paulo, São Paulo, Brasil Future Secure AI Tempo inteiro

    Join to apply for the Data Scientist (JR, SR, STAFF) role at Future Secure AI 5 months ago Be among the first 25 applicants Join to apply for the Data Scientist (JR, SR, STAFF) role at Future Secure AI Get AI-powered advice on this job and more exclusive features. This range is provided by Future Secure AI. Your actual pay will be based on your skills...

  • Senior Data Scientist

    Há 3 dias

    São Paulo, São Paulo, Brasil Uber Tempo inteiro

    Join to apply for the Senior Data Scientist - Experimentation role at Uber.About The TeamWe are looking for a Data Scientist to join the Sao Paulo team, specifically in Core Services Analytics.You will work with product managers, engineers, and fellow data scientists to shape the direction of one or more products within Core Services.You will work on...

  • Senior Data Scientist

    Há 4 dias

    São Paulo, São Paulo, Brasil Uber Tempo inteiro

    Join to apply for the Senior Data Scientist - Experimentation role at Uber . Get AI-powered advice on this job and more exclusive features. About The Team We are looking for a Data Scientist to join the Sao Paulo team, specifically in Core Services Analytics. You will work with product managers, engineers, and fellow data scientists to shape the direction...

  • Data Scientist

    3 semanas atrás

    São Paulo, São Paulo, Brasil Future Secure AI Tempo inteiro

    Join to apply for the Data Scientist (JR, SR, STAFF) role at Future Secure AI5 months ago Be among the first 25 applicantsJoin to apply for the Data Scientist (JR, SR, STAFF) role at Future Secure AIGet AI-powered advice on this job and more exclusive features.This range is provided by Future Secure AI. Your actual pay will be based on your skills and...

  • Senior Data Scientist

    4 semanas atrás

    São Paulo, São Paulo, Brasil Artefact Tempo inteiro

    **Wie we zijn**Artefact is a new generation of a data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we're enjoying skyrocketing growth.Our broad range of data-driven solutions in data consulting and...

  • Data Scientist

    4 semanas atrás

    São Paulo, São Paulo, Brasil CloudWalk, Inc. Tempo inteiro

    Join to apply for the Data Scientist role at CloudWalk, Inc.Get AI-powered advice on this job and more exclusive features.About CloudWalk: We are not just another fintech unicorn. We are a pack of dreamers, makers, and tech enthusiasts building the future of payments. With millions of happy customers and a hunger for innovation, we're now expanding our...

  • Data Scientist

    4 semanas atrás

    São Paulo, São Paulo, Brasil Wildlife Studios Tempo inteiro

    Join to apply for the Data Scientist role at Wildlife StudiosJoin to apply for the Data Scientist role at Wildlife StudiosWe're looking for a talented and passionate Data Scientist, to join Wildlife's Insights team.As a Data Scientist, you will expand game potential by providing non-trivial solutions to business questions, such as how to analyze game...

  • Data Scientist

    Há 2 dias

    São Paulo, São Paulo, Brasil Cloudwalk, Inc. Tempo inteiro

    Join to apply for the Data Scientist (AI Optimization Team) role at CloudWalk, Inc.2 days ago Be among the first 25 applicantsJoin to apply for the Data Scientist (AI Optimization Team) role at CloudWalk, Inc.As a Data Scientist on our AI Optimization team, your mission is to design and optimize intelligent systems that power core product experiences.You'll...