Senior Data Engineer

3 semanas atrás

Brasília DF, Brasil DRISHTICON Inc Tempo inteiro

We have an immediate contract requirement for Senior Data Engineer with one of our direct clients in USA. Contract and Remote job (Need to support during EST business hours). About the Job duties ● Construct data pipelines using Airflow and Cloud Functions to meet business requirements set on from the Product and Engineering teams ● Maintain and optimize table schemas, views, and queries in our data warehouse and databases ● Perform ad-hoc analysis to troubleshoot stakeholder issues surrounding data and provide insights into feature usage ● Develop workflows and integrations with data partners to expand our data capabilities ● Document data architecture and integration efforts to provide a clear understanding of the data platform to other team members ● Provide guidance on data best practices when building out new product lines ● Automate long running manual processes to free up internal resources ● Create scalable framework for onboarding new data partners Must have ● Experience with data task orchestration (Airflow, CRON, Prefect etc..) with dependency mapping ● Data analysis and data modeling ● Strong experience in Python, SQL, shell scripting ● Experience interacting with APIs, SFTP, Cloud Storage locations (eg. GCS, s3)● Analytical problem solving skills, ability to analyze application logs to troubleshoot issues ● Familiarity with Cloud Computing (GCP a plus) Nice to have ● Experience with Javascript ● Hands on work with Airflow ● ML/MLOps ● Docker and K8s ● NoSQL ● Exposure to producer/consumer messaging systems Some additional notes from our consultant onsite Essential skills: SQL Python Git Apache Airflow (or other orchestrators such as Dagster or Prefect) Nice-to-have skills: Node.js or JavaScript Google BigQuery Event-driven serverless cloud functions (Google Cloud Functions, AWS Lambda or Azure Functions) Asynchronous event-driven messaging (Google Cloud Pub/Sub, AWS SNS, AWS SQS, Azure Service Bus, Azure Event Grid or Azure Storage Queues) Object storage: either cloud-based (Google Cloud Storage, AWS S3 or Azure Blob Storage) or on-premises (e.g., MinIO, Ceph) Bachelor's degree required.

  • Senior Data Engineer

    3 semanas atrás

    Brasília, DF, Brasil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    WE ARE HIRING DATA ENGINEER° Offer 100% remotly ONLY Brazil Direct contract with client The Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions on AWS, utilizing Snowflake, dbt, and modern automation tools. This role drives best practices for data quality, validation, and governance, while...

  • Senior Data Engineer

    3 semanas atrás

    Brasília, DF, Brasil Flatiron Software Tempo inteiro

    About Flatiron is a global remote software development company with engineers located around the world. We unite experts from diverse backgrounds and experiences in a collaborative culture to deliver exceptional products and services for our clients. As a forward-thinking software engineering company, we provide industry-leading solutions to complex problems...

  • Cloud Data Engineer

    2 semanas atrás

    Brasília, DF, Brasil Microtalent is becoming INSPYR Global Solutions Tempo inteiro €50

    Employment type: Direct Hire – Full-time, with all benefits required by Brazil law Salary range: Competitive and negotiable based on experience Language: Bilingual (Advanced English – excellent verbal and written communication skills required) The Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data...

  • Senior Data Engineer

    Há 20 horas

    Brasília, Brasil Pride Global Tempo inteiro

    We're Hiring: Senior Data Engineer | Remote from Brazil | Fluent English required | Location: Remote – Brazil onlyContact: TemporaryAre you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing e-commerce and circular fashion?We're looking for a Senior Data...

  • Senior Data Engineer

    3 semanas atrás

    Brasília, Brasil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    WE ARE HIRING DATA ENGINEER°Offer 100% remotly ONLY Brazil Direct contract with clientThe Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions on AWS, utilizing Snowflake, dbt, and modern automation tools. This role drives best practices for data quality, validation, and governance, while...

  • Senior Data Engineer

    3 semanas atrás

    Brasília, Brasil Microtalent is becoming INSPYR Global Solutions Tempo inteiro

    WE ARE HIRING DATA ENGINEER° Offer 100% remotly ONLY Brazil Direct contract with client The Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions on AWS, utilizing Snowflake, dbt, and modern automation tools. This role drives best practices for data quality, validation, and governance, while...

  • Senior data engineer

    3 semanas atrás

    Brasília, Brasil Microtalent Is Becoming INSPYR Global Solutions Tempo inteiro

    WE ARE HIRING DATA ENGINEER°Offer 100% remotly ONLY BrazilDirect contract with clientThe Senior Cloud Data Engineer leads the design, architecture, and implementation of secure, scalable data solutions on AWS, utilizing Snowflake, dbt, and modern automation tools. This role drives best practices for data quality, validation, and governance, while optimizing...

  • Senior data engineer

    Há 8 horas

    Brasília, Brasil Pride Global Tempo inteiro

    We're Hiring: Senior Data Engineer | Remote from Brazil | Fluent English required|Location: Remote – Brazil onlyContact:TemporaryAre you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing e-commerce and circular fashion?We're looking for aSenior Data...

  • Senior Data Engineer

    2 semanas atrás

    Brasília, Brasil Sky Systems, Inc. (SkySys) Tempo inteiro

    About the Role We’re partnering with a leadingglobal commerce technology organizationto expand theirData Engineering & Analyticsteam. This is an exciting opportunity for senior-level Data Engineers who are passionate about building modern data solutions, optimizing data pipelines, and driving impactful data-driven decisions within a global enterprise...

  • Senior data engineer

    1 semana atrás

    Brasília, Brasil Prosigliere Tempo inteiro

    Looking for an experienced Senior Data Engineer to join the Prosigliere team.DescriptionWe are seeking a highly skilled and motivated Data Engineer to join our growing team. The ideal candidate will be instrumental in designing, building, and maintaining robust and scalable data pipelines and infrastructure. This role requires a deep understanding of data...