Data Engineer, Data Lake

Company Description

Founded by experienced entrepreneurs and engineers in 2016, Pismo is a technology company that provides a comprehensive processing platform for banking, card issuing and financial market infrastructure and helps customers innovate and build the next generation of banking and payment solutions. Pismo joined Visa in 2024.

Leveraging Visa's solutions, our core platform, and an expanding suite of capabilities, Pismo addresses the technological challenges that large banks, marketplaces, and fintech companies face in migrating from legacy systems to more advanced technology in the market. Pismo's cloud-based platform empowers firms to build and launch financial products rapidly, scaling as they grow to have a broader audience while keeping high security and availability standards.

Pismo's 500+ employees are located in more than 10 countries around the world.

Job Description

Summary

Data Teams play a central role at Pismo, providing data-intensive analytics for internal product teams, while also processing and delivering TBs of high-quality data, mainly in streaming form, needed by our partners to produce outstanding products downstream.

Operating mainly in Brazil, the data team recently extended its scope to accelerate the platformization of data services globally, with representatives in Europe and soon in the US and Asia. We are looking for talented engineers who share our culture of trust, mutual responsibility, and technological excellence to be part of this unprecedented and diverse global data organization.

What you'll do

• Serve as a senior technical contributor on Pismo's data stack, leading the design and development of robust, scalable data pipelines using modern Big Data frameworks.
• Drive continuous improvement in platform performance, reliability, and cost-effectiveness, proactively identifying opportunities for innovation.
• Take ownership of production operations and monitoring (file-based systems), ensuring adherence to SLAs and applying best practices for observability and resilience.
• Collaborate with cross-functional teams to architect, build, and evolve high-complexity data features, reducing technical debt and championing engineering excellence.
• Provide mentorship to peers through code reviews, feedback, and support, fostering an environment of knowledge sharing and professional development.
• Ensure that data pipelines follow the best testing, monitoring, observability, and security practices.
• Participate in on-call rotations, promptly addressing and resolving production incidents, while proactively implementing preventative measures.
• Build and optimize ETL/ELT processes to handle large-scale data, leveraging advanced data processing and distributed systems techniques.
• Maintain rigorous data governance and platform standards, working closely with data stakeholders to ensure consistent, high-quality data assets.
• Conduct root-cause analyses for critical issues, challenging and refining team processes to enhance efficiency and reliability.
• Influence multiple teams by promoting a culture of technical excellence, forward-thinking solutions, and continuous improvement.

This is a remote position. A remote position does not require job duties be performed within proximity of a Visa office location. Remote positions may be required to be present at a Visa office with scheduled notice.

Qualifications

Basic Qualifications

• 2+ years of relevant work experience and a Bachelors degree, OR 5+ years of relevant work experience
• B1 English or Above (Intermediate)
• Strong experience as a Data Engineer
• Good experience with AWS services (e.g., S3, DMS, Lambda, Kinesis, and IAM)
• Apache Spark experience or similar tools (e.g., Flink, Hadoop)
• Python experience
• Architectural design experience
• Git/GitHub experience
• Monitoring tools: Grafana and CloudWatch (logs/tracing/spans/monitoring/alerts/dashboards)
• SQL experience

Desirable Qualifications

• CI/CD experience
• Airflow experience
• CDC (Change data capture) experience

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.