Senior Cloud Data Engineering Specialist

Há 6 dias

São Luís, Maranhão, Brasil beBeeEngineer Tempo inteiro

As a seasoned Data Engineer, you will play a pivotal role in designing and implementing scalable data pipelines using AWS Glue, EMR, and Spark.

You will work closely with cross-functional teams to develop and maintain batch and real-time data pipelines, integrating multiple sources and destinations such as S3, RedShift, Aurora, and DynamoDB.

The ideal candidate will have a strong understanding of data governance, security, and compliance, and will be able to ensure the quality, reliability, and performance of our data assets.

  • Design, develop, and maintain scalable ETL pipelines
  • Build and operate batch and real-time data pipelines
  • Implement and optimize workflows and dataframes for high performance and reliability
  • Migrate data using AWS DMS and manage data catalogs with Glue Catalog
  • Develop dashboards and visualizations with AWS Quicksight
  • Apply Data Mesh principles for distributed data architecture and governance
  • Use open source tools such as Apache Airflow, dbt, and Spark/Scala
  • Collaborate with multidisciplinary teams to deliver solutions that support advanced analytics and business intelligence

Required Skills and Qualifications:

  • Proven experience with AWS Glue, Spark, PySpark, and Python
  • Knowledge of Data Mesh and distributed data architecture
  • Experience with AWS Quicksight, S3, RedShift, Aurora, DynamoDB, Glue Catalog, and Lambda Functions
  • Experience with batch and streaming data pipelines (Kinesis, Kafka)
  • Mastery of SQL and dataframe manipulation
  • Experience with tools such as Apache Airflow and dbt
  • Ability to work in an agile, collaborative, and multicultural environment
  • Analytical, detail-oriented, and problem-solving profile

Seniority Level: Mid-Senior
Employment Type: Full-time
Job Function: Information Technology
Industry: IT Services and IT Consulting

  • Data Scientist

    4 semanas atrás

    São Luís, Maranhão, Brasil Microsoft Tempo inteiro

    Data Scientist / Applied Scientist (Mid and Senior Levels) Join to apply for the Data Scientist / Applied Scientist (Mid and Senior Levels) role at Microsoft Data Scientist / Applied Scientist (Mid and Senior Levels) 1 week ago Be among the first 25 applicants Join to apply for the Data Scientist / Applied Scientist (Mid and Senior Levels) role at...

  • Data Scientist

    2 semanas atrás

    São Luís, Maranhão, Brasil Microsoft Tempo inteiro

    Data Scientist / Applied Scientist (Mid and Senior Levels)Join to apply for the Data Scientist / Applied Scientist (Mid and Senior Levels) role at MicrosoftData Scientist / Applied Scientist (Mid and Senior Levels)1 week ago Be among the first 25 applicantsJoin to apply for the Data Scientist / Applied Scientist (Mid and Senior Levels) role at MicrosoftGet...

  • Solution Engineering

    4 semanas atrás

    São Luís, Maranhão, Brasil Microsoft Tempo inteiro

    Join to apply for the Solution Engineering role at Microsoft 1 day ago Be among the first 25 applicants Join to apply for the Solution Engineering role at Microsoft Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and...

  • Engineering Leader/ Edms and Documentation

    4 semanas atrás

    São Luís, Maranhão, Brasil LHR Saudi Arabia Tempo inteiro

    **Who is our client and your future employer?**:Ranked among the world's largest petrochemicals manufacturers, it is a public company based in Riyadh, Saudi Arabia. With operations in around 50 countries, The Company has a global workforce of over 31,000 talented individuals. The company operates through three strategic Business Units - Petrochemicals,...

  • Senior Land Governance Specialist

    Há 5 dias

    São Luís, Maranhão, Brasil beBeeLegality Tempo inteiro R$70.000 - R$110.000

    Job TitleThe Legal Specialist role involves working on the Lands for Women project, which aims to improve land and environmental regularization in rural communities.This position requires a high level of legal analysis skills, experience in public administration, and knowledge of Brazilian legislation.Supporting project coordination and counterparties in...

  • Solution Engineering

    4 semanas atrás

    São Luís, Maranhão, Brasil Microsoft Tempo inteiro

    Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. We build a culture of inclusion where everyone can thrive at work and beyond, guided by respect, integrity, and...

  • Senior Cost Estimator

    4 semanas atrás

    São Luís, Maranhão, Brasil LHR Saudi Arabia Tempo inteiro

    **Who is our client and your future employer?**:Ranked among the world's largest petrochemicals manufacturers, it is a public company based in Riyadh, Saudi Arabia. With operations in around 50 countries, The Company has a global workforce of over 31,000 talented individuals. The company operates through three strategic Business Units - Petrochemicals,...

  • Cm Specialist

    4 semanas atrás

    São Luís, Maranhão, Brasil LHR Saudi Arabia Tempo inteiro

    **Who is our Client and your future employer?**:Ranked among the world's largest petrochemicals manufacturers, it is a public company based in Riyadh, Saudi Arabia. With operations in around 50 countries, The Company has a global workforce of over 31,000 talented individuals. The company operates through three strategic Business Units - Petrochemicals,...

  • Sr. Specialist, Business Case Development

    4 semanas atrás

    São Luís, Maranhão, Brasil LHR Saudi Arabia Tempo inteiro

    **Who is our client and your future employer?**:Ranked among the world's largest petrochemicals manufacturers, it is a public company based in Riyadh, Saudi Arabia. With operations in around 50 countries, The Company has a global workforce of over 31,000 talented individuals. The company operates through three strategic Business Units - Petrochemicals,...

  • Environmental Monitoring and Evaluation Specialist

    Há 4 dias

    São Luís, Maranhão, Brasil beBeeMonitoring Tempo inteiro R$64.500 - R$85.200

    Job Title: Environmental Monitoring and Evaluation Specialist">About the ProjectThe project "Environmental Regularization Project through Land Governance and Territorial Planning" aims to promote land and environmental regularization in settlement areas and rural communities in Maranhão, with a priority focus on women heads of household.">Project...