Data Engineer with Expertise in Data Architecture

Há 5 dias


Brasil DataArt Solutions, Inc Tempo inteiro
Job Title: Data Engineer with Expertise in Data Ops

We are seeking a highly skilled DataOps Engineer with hands-on experience in Google Cloud Platform (GCP) to join our team at DataArt Solutions, Inc.

Job Summary

The ideal candidate will have expertise in managing, orchestrating, and optimizing data pipelines, as well as deploying scalable data infrastructure. The role involves ensuring data quality, availability, and reliability while fostering collaboration between data engineers, data scientists, and business teams.

Responsibilities
  • Design, implement, and manage data pipelines on GCP using tools such as Dataflow, BigQuery, Pub/Sub, Cloud Storage, and Cloud Composer.
  • Develop and maintain CI/CD pipelines for data workflows using tools like Cloud Build, Jenkins, or similar.
  • Automate the monitoring, alerting, and optimization of data processes to ensure efficient and reliable data flows.
  • Ensure data quality and integrity through monitoring, validation checks, and data auditing processes.
  • Collaborate with Data Engineers, Analysts, and Business teams to ensure data solutions align with business goals.
  • Optimize performance and cost-efficiency of data infrastructure by tuning storage and query performance on BigQuery and Cloud Storage.
  • Implement robust data security practices, including access management, encryption, and compliance with privacy regulations.
  • Create and maintain documentation for data processes, including technical specs, workflows, and best practices.
  • Use Terraform or Deployment Manager to automate the provisioning and scaling of data infrastructure on GCP.
Requirements
  • Bachelor's degree in Computer Science, Data Engineering, or related fields.
  • 3+ years of experience in a DataOps, Data Engineering, or similar role.
  • Strong experience with Google Cloud Platform services like BigQuery, Dataflow, Pub/Sub, Cloud Composer, and GCS.
  • Proficiency in SQL and experience in managing big data environments and data lakes.
  • Hands-on experience with CI/CD pipelines for data processing and data automation.
  • Experience with infrastructure-as-code tools such as Terraform, Deployment Manager, or equivalent.
  • Solid understanding of data governance principles, including data lineage, security, and compliance.
  • Familiarity with containerization (Docker, Kubernetes) and orchestration tools.
  • Excellent problem-solving and debugging skills.
  • Strong communication skills and the ability to work cross-functionally with various teams.
Benefits
  • Health insurance for you and your loved ones.
  • Sick pay with 10 days without a doctor's note, afterwards as per the laws of your country.
  • Pleasant work environment with two large corporate parties and many small get-togethers for colleagues.
  • Comfort service for solving technical and everyday problems at work.

If you don't find any vacancies that match your skills, let us know and we'll try to help.


  • Senior Data Engineer

    2 semanas atrás


    Brasil ECF Data, LLC Tempo inteiro

    Unlock Your Data PotentialAt ECF Data, LLC, we're on the lookout for a skilled Senior Data Engineer to join our team. As a key player in our data-driven organization, you'll be responsible for designing, building, and managing complex data pipelines that drive business growth.We're a Portuguese consulting company with a strong focus on Technology and...


  • Brasil DataArt Solutions, Inc Tempo inteiro

    Job Title: Data Engineer with Expertise in Data OpsWe are seeking a highly skilled DataOps Engineer with hands-on experience in Google Cloud Platform (GCP) to join our team at DataArt Solutions, Inc.Job SummaryThe ideal candidate will have expertise in managing, orchestrating, and optimizing data pipelines, as well as deploying scalable data infrastructure....

  • Senior Data Engineer

    3 semanas atrás


    Brasil Data Privacy Tempo inteiro

    About the RoleWe are seeking a highly skilled Data Platform Engineer to join our team at TRM Labs. As a key member of our Data Platform team, you will be responsible for designing, building, and maintaining scalable and highly available data infrastructure for our products and services.Key ResponsibilitiesDesign and implement complex data pipelines to...


  • Brasil Solvd, Inc. Tempo inteiro

    Solvd Inc. is a leading software engineering company with a global presence and a team of highly skilled professionals. With over 12 years of experience, we have helped numerous clients create software that improves their operations and opens new markets.We are seeking an experienced Databricks Engineer to join our team. The ideal candidate will have a...


  • Brasil Data Privacy Tempo inteiro

    About the RoleWe're seeking a highly skilled Senior/Staff Software Engineer to join our Data Platform team. As a key member of our team, you will be responsible for designing, developing, and deploying scalable and reliable data infrastructure for our products and services.Key ResponsibilitiesDesign and develop highly available and scalable data services to...


  • Brasil Data Privacy Tempo inteiro

    About TRM LabsTRM Labs is a mission-driven company that aims to build a safer financial system for billions of people. We deliver a blockchain intelligence data platform to financial institutions, crypto companies, and governments to fight cryptocurrency fraud and financial crime.Job DescriptionWe are seeking a highly skilled Software Engineer to join our...

  • Data Architect

    3 semanas atrás


    Brasil ECF Data, LLC Tempo inteiro

    About the RoleWe are seeking a highly skilled Data Architect to join our team at ECF Data, LLC. As a Data Architect, you will play a key role in designing and implementing large-scale data systems that drive business growth and innovation.Key ResponsibilitiesDesign and implement data architectures that meet business requirements and drive data-driven...

  • Data Engineer

    2 semanas atrás


    Brasil Solvd Tempo inteiro

    Solvd Inc. - A Premier Software Engineering CompanyWe are a global software engineering company with 8 offices across the globe and over 800 international employees on staff. With over 12 years of experience, highly skilled teams around the world and deep industry knowledge, we help clients create software that improves their operations and opens new...

  • Data Engineer

    1 semana atrás


    Brasil Solvd, Inc. Tempo inteiro

    Solvd Inc. - A Premier Software Engineering CompanyWe are a global software engineering company with 8 offices across the globe and over 800 international employees on staff. With over 12 years of experience, highly skilled teams around the world and deep industry knowledge, we help clients create software that improves their operations and opens new...

  • Data Engineer

    2 semanas atrás


    Brasil Aitopics Tempo inteiro

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Blue Orange Digital. As a Data Engineer, you will play a key role in designing, building, and deploying data platforms in the cloud, automating their operation, and providing leadership in applying software development principles and best...

  • Data Engineer

    Há 6 dias


    Brasil Blue Orange Digital Tempo inteiro

    Company OverviewBlue Orange Digital is a cloud-based data transformation and predictive analytics development firm with offices in the United States. We help companies make sense of their business challenges by applying modern data analytics techniques, visualizations, and AI/ML. Our team is passionate about working with technologists and data analysts to...

  • Data Engineer

    2 semanas atrás


    Brasil Planahead Tempo inteiro

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Planahead. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using cutting-edge tools and technologiesDevelop and maintain large-scale data systems,...

  • Data Engineer

    3 semanas atrás


    Brasil Planahead Tempo inteiro

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Plan Ahead. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using cutting-edge tools and technologies.Develop and maintain high-performance data...

  • Product Data Analyst

    2 semanas atrás


    Brasil Data Privacy Tempo inteiro

    Product Data AnalystSezzle is seeking a skilled Product Data Analyst to drive business outcomes through data-driven insights. The ideal candidate will collaborate with cross-functional teams to establish key performance indicators and develop data visualizations to inform strategic decision-making.Key Responsibilities:Design and implement data visualizations...

  • Data Engineer Consultant

    2 semanas atrás


    Brasil Thoughtworks Inc. Tempo inteiro

    Job Title: Data Engineer ConsultantAt Thoughtworks Inc., we are seeking a highly skilled Data Engineer Consultant to join our team. As a Data Engineer Consultant, you will play a crucial role in designing, building, and maintaining the software architecture and infrastructure for managing data applications.Key Responsibilities:Collaborate with team members...


  • Brasil Data Privacy Tempo inteiro

    Product Data AnalystSezzle is seeking a skilled Product Data Analyst to drive business outcomes through data-driven insights. The ideal candidate will collaborate with cross-functional teams to establish key performance indicators and monitoring metrics.Key Responsibilities:Develop and maintain data visualizations and dashboards to support data-informed...

  • Data Engineer

    Há 1 mês


    brasil Pyramid Consulting, Inc Tempo inteiro

    Advanced proficiency in complex (ANSI-compliant) SQL queries (required)In-depth knowledge of data warehousing and data modeling techniques (required)Expertise in analytics and reporting (required)Background in Python programming & Airflow orchestrationExperience with Spark/EC2/S3 (desirable)Familiarity with Snowflake/Databricks (advantageous)


  • Brasil Zazmic Inc Tempo inteiro

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our dynamic data team at Zazmic Inc. As a Senior Data Engineer, you will play a critical role in designing, developing, and optimizing scalable data pipelines using Apache Spark and Google Cloud Platform (GCP).Key Responsibilities:Architect, build, and maintain...

  • Azure Data Engineer

    Há 1 mês


    Brasil Luxoft Tempo inteiro

    We are seeking a highly skilled Azure Data Engineer with DevSecOps experience to join our team. The ideal candidate will have strong expertise in Azure cloud services, data engineering, and DevSecOps practices, with a focus on automation, security, and the full software development lifecycle. You will be responsible for developing, maintaining, and...

  • Data Engineer

    2 meses atrás


    Brasil Remobi Tempo inteiro

    Data Engineer - (REMOTE) Brazil About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world....