High-Touch Big Data Architect

We are looking for a highly skilled and motivated individual to join our Risk Engineering team as a Senior Software Engineer. This is an exciting opportunity to work on complex business problems and grow your career.

This role involves designing, coding, testing, deploying, and monitoring sophisticated processes in a cloud-based architecture. You will also be responsible for developing and maintaining CI/CD automation using tools such as GitHub Actions, Jenkins, Azure DevOps, etc.

Key Responsibilities:

• Collaborate with partners and stakeholders to learn about customers' business needs and key challenges.
• Design, code, test, deploy, and monitor sophisticated processes in a cloud-based architecture.
• Effectively develop and maintain CI/CD automation using tools such as GitHub Actions, Jenkins, Azure DevOps, etc.
• Implement Infrastructure as Code (IaC) using tools like Terraform, including provisioning and managing cloud-based data infrastructure.
• Perform software development with TDD and BDD, Microservice and event-oriented architectures.
• Analyze data, existing systems, and processes independently to effectively identify bottlenecks and opportunities for improvements.
• Mentor and learn from peers, foster continuous learning of new technology within the team and organization.
• Help in interviews and provide quality and timely feedback.
• Strong at the team's process and best practices, and apply them to given tasks with help from peers and your manager.
• Partner with, assist, or lead team members in development and problem-solving.
• Take strong ownership/accountability, be proactive, and lead.
• Lead a scrum team with proper agile development practices, and ensure high-quality and timely development and delivery that solve target problems effectively.
• Own medium to large complex components or systems/products/platforms.
• Participate and lead technical discussions.
• Design and build high-quality and efficient systems with craftsmanship.
• Independently & productively complete work at medium/large complexity level and proactively seek reviews from senior engineers on your work to ensure high quality.
• Proactively identify and communicate dependencies.
• Proactively review work from peers and provide constructive feedback/comments.
• Build reliable, secure, high-quality, efficient, and easy-to-use big data platforms and tools at scale for supporting all kinds of data transferring, ingestion, processing, serving, delivery, consumption, and data governance needs.
• Build systems, platforms, data pipelines, and tools for E-2-E data life cycle, including data ingestion, cleaning, processing, enrichment, optimization, and serving by leveraging the Data platform. It's our responsibility to deliver high-quality, rich, easy-to-understand & use data for external and internal purposes. For these, you will build data quality measurement & monitoring techniques and systems, metadata and data catalog, Master Data Management, etc.
• Become a subject matter expert in your functional area and best practices.
• Assess unique circumstances and apply creative problem-solving techniques to resolve issues or suggest various approaches.
• Use data and/or AI technology or tools in solutions you design/develop for more effective business outcomes and better customer experience as well as in your design & and development work for high productivity and better solution quality.
• Analyze data to deeply understand risk problems and build effective solutions.
• Eager and good at learning and exploring new technology and innovative approach to improve effectiveness and productivity. Bring the learnings to the team to lead team's grow together.