Senior Data Engineer

1 dia atrás

Brasília DF, Brasil DRISHTICON Inc Tempo inteiro

We have an immediate contract requirement for Senior Data Engineer with one of our direct clients in USA. Contract and Remote job (Need to support during EST business hours). About the Job duties ● Construct data pipelines using Airflow and Cloud Functions to meet business requirements set on from the Product and Engineering teams ● Maintain and optimize table schemas, views, and queries in our data warehouse and databases ● Perform ad-hoc analysis to troubleshoot stakeholder issues surrounding data and provide insights into feature usage ● Develop workflows and integrations with data partners to expand our data capabilities ● Document data architecture and integration efforts to provide a clear understanding of the data platform to other team members ● Provide guidance on data best practices when building out new product lines ● Automate long running manual processes to free up internal resources ● Create scalable framework for onboarding new data partners Must have ● Experience with data task orchestration (Airflow, CRON, Prefect etc..) with dependency mapping ● Data analysis and data modeling ● Strong experience in Python, SQL, shell scripting ● Experience interacting with APIs, SFTP, Cloud Storage locations (eg. GCS, s3)● Analytical problem solving skills, ability to analyze application logs to troubleshoot issues ● Familiarity with Cloud Computing (GCP a plus) Nice to have ● Experience with Javascript ● Hands on work with Airflow ● ML/MLOps ● Docker and K8s ● NoSQL ● Exposure to producer/consumer messaging systems Some additional notes from our consultant onsite Essential skills: SQL Python Git Apache Airflow (or other orchestrators such as Dagster or Prefect) Nice-to-have skills: Node.js or JavaScript Google BigQuery Event-driven serverless cloud functions (Google Cloud Functions, AWS Lambda or Azure Functions) Asynchronous event-driven messaging (Google Cloud Pub/Sub, AWS SNS, AWS SQS, Azure Service Bus, Azure Event Grid or Azure Storage Queues) Object storage: either cloud-based (Google Cloud Storage, AWS S3 or Azure Blob Storage) or on-premises (e.g., MinIO, Ceph) Bachelor's degree required.

  • Senior Data Engineer

    1 dia atrás

    Brasília, DF, Brasil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    WE ARE HIRING DATA ENGINEER° Offer 100% remotly ONLY Brazil Direct contract with client The Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions on AWS, utilizing Snowflake, dbt, and modern automation tools. This role drives best practices for data quality, validation, and governance, while...

  • Senior Data Engineer

    1 dia atrás

    Brasília, DF, Brasil Flatiron Software Tempo inteiro

    About Flatiron is a global remote software development company with engineers located around the world. We unite experts from diverse backgrounds and experiences in a collaborative culture to deliver exceptional products and services for our clients. As a forward-thinking software engineering company, we provide industry-leading solutions to complex problems...

  • Senior Data Engineer

    4 semanas atrás

    Brasília, Brasil Pride Global Tempo inteiro

    We're Hiring: Senior Data Engineer (MLOps) | Remote from Brazil | Fluent English required | USD-Hourly pay Location : Remote – Brazil only ️ Language : Fluent English required Are you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing e-commerce and...

  • Senior Data Engineer

    Há 13 horas

    Brasília, Brasil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    WE ARE HIRING DATA ENGINEER°Offer 100% remotly ONLY Brazil Direct contract with clientThe Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions on AWS, utilizing Snowflake, dbt, and modern automation tools. This role drives best practices for data quality, validation, and governance, while...

  • Senior Data Engineer

    Há 12 horas

    Brasília, Brasil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    WE ARE HIRING DATA ENGINEER° Offer 100% remotly ONLY Brazil Direct contract with client The Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions on AWS, utilizing Snowflake, dbt, and modern automation tools. This role drives best practices for data quality, validation, and governance, while...

  • Senior Data Engineer

    4 semanas atrás

    Brasília, Brasil Pride Global Tempo inteiro

    🚀 We're Hiring: Senior Data Engineer (MLOps) | Remote from Brazil | Fluent English required | USD-Hourly pay📍Location: Remote – Brazil only 🗣️Language: Fluent English requiredAre you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing e-commerce and...

  • Senior Data Engineer

    4 semanas atrás

    Brasília, Brasil Avenue Code Tempo inteiro

    We are looking for a Senior Data Engineer to design and maintain scalable data pipelines on AWS, ensuring performance, quality, and security. You will collaborate with data scientists and analysts to integrate data from multiple sources and support AI/ML initiatives. Key Responsibilities: Build and optimize ETL pipelines with AWS Glue. Work with...

  • Senior Data Engineer

    1 semana atrás

    Brasília, DF, Brasil Jusfy Tempo inteiro

    A Jusfy está em busca de um Data Engineer para compor o time! Somos uma startup jurídica que busca constantemente soluções para facilitar a vida dos advogados e advogadas do Brasil. Atuamos na área de tecnologia, desenvolvendo produtos e ferramentas que auxiliam na produtividade diária dos nossos clientes. Somos uma empresa jovem e muito promissora....

  • Senior Data Engineer

    4 semanas atrás

    Brasília, Brasil Avenue Code Tempo inteiro

    We are looking for a Senior Data Engineer to design and maintain scalable data pipelines on AWS, ensuring performance, quality, and security. You will collaborate with data scientists and analysts to integrate data from multiple sources and support AI/ML initiatives.Key Responsibilities:Build and optimize ETL pipelines with AWS Glue.Work with ...

  • Senior Data Engineer

    Há 14 horas

    Brasília, Brasil DRISHTICON Inc Tempo inteiro

    We have an immediate contract requirement for Senior Data Engineer with one of our direct clients in USA. Contract and Remote job (Need to support during EST business hours). About the Job duties ● Construct data pipelines using Airflow and Cloud Functions to meet business requirements set on from the Product and Engineering teams ● Maintain and optimize...