Data Engineer, Data Lake

Há 3 dias

São Paulo, São Paulo, Brasil Visa Inc. Tempo inteiro

Data Teams play a central role at Pismo, providing data-intensive analytics for internal product teams, while also processing and delivering TBs of high-quality data, mainly in streaming form, needed by our partners to produce outstanding products downstream.
Operating mainly in Brazil, the data team recently extended its scope to accelerate the platformization of data services globally, with representatives in Europe and soon in the US and Asia. We are looking for talented engineers who share our culture of trust, mutual responsibility, and technological excellence to be part of this unprecedented and diverse global data organization.

What you'll do

  • Serve as a senior technical contributor on Pismo's data stack, leading the design and development of robust, scalable data pipelines using modern Big Data frameworks.
  • Drive continuous improvement in platform performance, reliability, and cost-effectiveness, proactively identifying opportunities for innovation.
  • Take ownership of production operations and monitoring (file-based systems), ensuring adherence to SLAs and applying best practices for observability and resilience.
  • Collaborate with cross-functional teams to architect, build, and evolve high-complexity data features, reducing technical debt and championing engineering excellence.
  • Provide mentorship to peers through code reviews, feedback, and support, fostering an environment of knowledge sharing and professional development.
  • Ensure that data pipelines follow the best testing, monitoring, observability, and security practices.
  • Participate in on-call rotations, promptly addressing and resolving production incidents, while proactively implementing preventative measures.
  • Build and optimize ETL/ELT processes to handle large-scale data, leveraging advanced data processing and distributed systems techniques.
  • Maintain rigorous data governance and platform standards, working closely with data stakeholders to ensure consistent, high-quality data assets.
  • Conduct root-cause analyses for critical issues, challenging and refining team processes to enhance efficiency and reliability.
  • Influence multiple teams by promoting a culture of technical excellence, forward-thinking solutions, and continuous improvement.

This is a remote position. A remote position does not require job duties be performed within proximity of a Visa office location. Remote positions may be required to be present at a Visa office with scheduled notice.

Basic Qualifications

  • 2+ years of relevant work experience and a Bachelors degree, OR 5+ years of relevant work experience
  • B1 English or Above (Intermediate)
  • Strong experience as a Data Engineer
  • Good experience with AWS services (e.g., S3, DMS, Lambda, Kinesis, and IAM)
  • Apache Spark experience or similar tools (e.g., Flink, Hadoop)
  • Monitoring tools: Grafana and CloudWatch (logs/tracing/spans/monitoring/alerts/dashboards)
  • SQL experience

Desirable Qualifications

  • CI/CD experience
  • Airflow experience

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

#J-18808-Ljbffr

  • Data Engineer, Data Lake

    Há 4 horas

    São Paulo, São Paulo, Brasil Tink Tempo inteiro

    Company Description Founded by experienced entrepreneurs and engineers in 2016, Pismo is a technology company that provides a comprehensive processing platform for banking, card issuing and financial market infrastructure and helps customers innovate and build the next generation of banking and payment solutions. Pismo joined Visa in 2024. Leveraging Visa's...

  • Data Engineer

    Há 3 horas

    São Paulo, São Paulo, Brasil Yuno Tempo inteiro

    Join to apply for the Data Engineer role at Yuno.Remote, Latam, Full Time, Individual Contributor, +2 years of experience.Who We AreAt Yuno, we are building the payment infrastructure that enables all companies to participate in the global market. Founded by a team of seasoned experts in the payments and IT industries, Yuno provides a high-performance...

  • Data Engineer, Data Lake

    Há 2 dias

    São Paulo, São Paulo, Brasil Pismo Tempo inteiro

    2 days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Pismo is a technology company that provides a comprehensive processing platform for banking, card issuing and financial market infrastructure and helps customers innovate and build the next generation of banking and payment solutions. Pismo joined...

  • Data Engineer Pleno

    Há 3 dias

    São Paulo, São Paulo, Brasil Sauter Tempo inteiro

    Estamos em busca de Data Engineers Plenos para se juntarem à nossa equipe de dados.Se você é apaixonado por construir pipelines de dados robustos, escaláveis e eficientes, e tem uma expertise sólida com o ecossistema do Google Cloud Platform (GCP), essa vaga é para você????Responsabilidades:Projetar, construir e manter pipelines de dados ETL/ELT para...

  • Data Engineer Pleno

    Há 2 dias

    São Paulo, São Paulo, Brasil SAUTER Tempo inteiro

    Estamos em busca de Data Engineers Plenos para se juntarem à nossa equipe de dados. Se você é apaixonado por construir pipelines de dados robustos, escaláveis e eficientes, e tem uma expertise sólida com o ecossistema do Google Cloud Platform (GCP), essa vaga é para vocêResponsabilidadesProjetar, construir e manter pipelines de dados ETL/ELT para...

  • Data Engineer Pleno

    Há 4 horas

    São Paulo, São Paulo, Brasil SAUTER Tempo inteiro

    Estamos em busca de Data Engineers Plenos para se juntarem à nossa equipe de dados. Se você é apaixonado por construir pipelines de dados robustos, escaláveis e eficientes, e tem uma expertise sólida com o ecossistema do Google Cloud Platform (GCP), essa vaga é para você Responsabilidades Projetar, construir e manter pipelines de dados ETL/ELT para...

  • Data engineer pleno

    Há 4 dias

    São Paulo, São Paulo, Brasil Netvagas Tempo inteiro

    Estamos em busca de Data Engineers Plenos para se juntarem à nossa equipe de dados.Se você é apaixonado por construir pipelines de dados robustos, escaláveis e eficientes, e tem uma expertise sólida com o ecossistema do Google Cloud Platform (GCP), essa vaga é para você Responsabilidades:Projetar, construir e manter pipelines de dados ETL/ELT para...

  • Data Engineer

    Há 6 dias

    São Paulo, São Paulo, Brasil Ioasys Tempo inteiro

    Familiaridade com metodologias ágeis; Experiência em Databricks, SQL, Python, ETL/ELT, Modelagem de Dados, Data Lake, Data Warehouse e ferramentas de visualização de dados; Conhecimento em AWS Cloud Watch, KMS, Glue, Lambda, S3, Redshift, Snowflake, Jenkins, GitLab, Denodo, Kubernetes; Alta capacidade de aprendizado; Disponibilidade para atuação...

  • Data Engineer_L3_ Program Tech Lead

    52 minutos atrás

    São Paulo, São Paulo, Brasil Grupo Data Tempo inteiro US$90.000 - US$120.000 por ano

    Muito Gosto Somos o Grupo DATA O nosso propósito é simplificar a vida dos nossos clientes e fazemos isso em todo o mundo, através das nossas soluções de TI. Somos uma multinacional, que opera ativamente em Portugal, e estamos em constante expansão Adoramos trabalhar com grandes empresas e fazer crescer as empresas com as quais colaboramos....

  • Data Engineer

    Há 7 dias

    São Paulo, São Paulo, Brasil DoorDash Tempo inteiro

    About the Team Data is at the foundation of DoorDash's success. The Data Engineering team builds database solutions for various use cases including reporting, product analytics, marketing optimization, and financial reporting. By implementing pipelines, data structures, and data warehouse architectures, this team serves as the foundation for decision-making...