Senior Data Engineer

Há 2 dias

Brasília, Brasil DRISHTICON Inc Tempo inteiro

We have an immediate contract requirement for Senior Data Engineer with one of our direct clients in USA. Contract and Remote job (Need to support during EST business hours). About the Job duties ● Construct data pipelines using Airflow and Cloud Functions to meet business requirements set on from the Product and Engineering teams ● Maintain and optimize table schemas, views, and queries in our data warehouse and databases ● Perform ad-hoc analysis to troubleshoot stakeholder issues surrounding data and provide insights into feature usage ● Develop workflows and integrations with data partners to expand our data capabilities ● Document data architecture and integration efforts to provide a clear understanding of the data platform to other team members ● Provide guidance on data best practices when building out new product lines ● Automate long running manual processes to free up internal resources ● Create scalable framework for onboarding new data partners Must have ● Experience with data task orchestration (Airflow, CRON, Prefect etc..) with dependency mapping ● Data analysis and data modeling ● Strong experience in Python, SQL, shell scripting ● Experience interacting with APIs, SFTP, Cloud Storage locations (eg. GCS, s3) ● Analytical problem solving skills, ability to analyze application logs to troubleshoot issues ● Familiarity with Cloud Computing (GCP a plus) Nice to have ● Experience with Javascript ● Hands on work with Airflow ● ML/MLOps ● Docker and K8s ● NoSQL ● Exposure to producer/consumer messaging systemsSome additional notes from our consultant onsiteEssential skills: SQL Python Git Apache Airflow (or other orchestrators such as Dagster or Prefect) Nice-to-have skills: Node.js or JavaScript Google BigQuery Event-driven serverless cloud functions (Google Cloud Functions, AWS Lambda or Azure Functions) Asynchronous event-driven messaging (Google Cloud Pub/Sub, AWS SNS, AWS SQS, Azure Service Bus, Azure Event Grid or Azure Storage Queues) Object storage: either cloud-based (Google Cloud Storage, AWS S3 or Azure Blob Storage) or on-premises (e.g., MinIO, Ceph)Bachelor's degree required.

  • Senior Data Engineer

    Há 2 dias

    Brasília, Brasil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    WE ARE HIRING DATA ENGINEER°Offer 100% remotly ONLY Brazil Direct contract with clientThe Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions on AWS, utilizing Snowflake, dbt, and modern automation tools. This role drives best practices for data quality, validation, and governance, while...

  • Senior data engineer

    1 dia atrás

    Brasília, Brasil Microtalent Is Becoming INSPYR Global Solutions Tempo inteiro

    WE ARE HIRING DATA ENGINEER°Offer 100% remotly ONLY BrazilDirect contract with clientThe Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions on AWS, utilizing Snowflake, dbt, and modern automation tools. This role drives best practices for data quality, validation, and governance, while optimizing...

  • Senior Data Engineer

    Há 2 dias

    Brasília, Brasil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    WE ARE HIRING DATA ENGINEER° Offer 100% remotly ONLY Brazil Direct contract with client The Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions on AWS, utilizing Snowflake, dbt, and modern automation tools. This role drives best practices for data quality, validation, and governance, while...

  • Senior Data Engineer

    Há 2 dias

    Brasília, DF, Brasil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    WE ARE HIRING DATA ENGINEER° Offer 100% remotly ONLY Brazil Direct contract with client The Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions on AWS, utilizing Snowflake, dbt, and modern automation tools. This role drives best practices for data quality, validation, and governance, while...

  • Senior Data Engineer

    4 semanas atrás

    Brasília, Brasil Avenue Code Tempo inteiro

    We are looking for a Senior Data Engineer to design and maintain scalable data pipelines on AWS, ensuring performance, quality, and security. You will collaborate with data scientists and analysts to integrate data from multiple sources and support AI/ML initiatives.Key Responsibilities:Build and optimize ETL pipelines with AWS Glue.Work with ...

  • Cloud data engineer

    1 dia atrás

    Brasília, Brasil Microtalent Is Becoming INSPYR Global Solutions Tempo inteiro

    Employment type:Direct Hire – Full-time, with all benefits required by Brazil lawSalary range:Competitive and negotiable based on experienceLanguage:Bilingual (Advanced English – excellent verbal and written communication skills required)The Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions...

  • Senior Data Engineer

    Há 2 dias

    Brasília, Brasil DRISHTICON Inc Tempo inteiro

    We have an immediate contract requirement for Senior Data Engineer with one of our direct clients in USA. Contract and Remote job (Need to support during EST business hours). About the Job duties ● Construct data pipelines using Airflow and Cloud Functions to meet business requirements set on from the Product and Engineering teams ● Maintain and optimize...

  • Cloud Data Engineer

    Há 2 dias

    Brasília, Brasil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    Employment type: Direct Hire – Full-time, with all benefits required by Brazil law Salary range: Competitive and negotiable based on experience Language: Bilingual (Advanced English – excellent verbal and written communication skills required) The Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data...

  • Cloud Data Engineer

    Há 2 dias

    Brasília, Brasil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    Employment type:Direct Hire – Full-time, with all benefits required by Brazil lawSalary range:Competitive and negotiable based on experience Language:Bilingual (Advanced English – excellent verbal and written communication skills required)The Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions...

  • Cloud Data Engineer

    Há 2 dias

    Brasília, Brasil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    Employment type:Direct Hire – Full-time, with all benefits required by Brazil lawSalary range:Competitive and negotiable based on experience Language:Bilingual (Advanced English – excellent verbal and written communication skills required)The Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions...