Chief Architect

Technology Visionary The role of a Technology Visionary will serve as the technical 'north star' for the design, integration and evolution of large-scale distributed data platforms in regulated industries. Key Responsibilities Elevate the end-to-end architecture across on-prem, hybrid and cloud environments based on customer requirements and limitations. Design and integrate solution components, pipelines, orchestration, governance and security layers. Translate business requirements into scalable, compliant architecture blueprints. Lead and participate in Architecture Review Boards (ARBs) to align deployments with enterprise standards. Define and maintain reference architectures, design patterns and integration frameworks. Guide platform engineers and client teams in implementing best practices for security, observability and reliability. Oversee the selection, integration and tuning of open-source components such as Apache Spark, Trino, Airflow, NiFi, YuniKorn, Superset, S3, NiFi, Ranger and DataHub. Partner with product and engineering leadership to evolve the 'North Star' architecture and roadmap. Mentor engineers and collaborate with DevOps, Security and DataOps to drive alignment and platform maturity. Must-Have Core Skills Expertise in Distributed Data Systems: Apache Spark, Trino, Airflow, NiFi, YuniKorn, Superset, Iceberg, Ranger, DataHub, S3. Infrastructure & Automation: Terraform, Kubernetes (K8s), OpenShift (OCP), Docker, Linux. Security & Governance: IAM, SSO, KMS, Kerberos, Encryption, RBAC. Monitoring & Observability: Grafana, Datadog, Prometheus. Programming: Java, Scala, Python. Architecture Practices: Solution design, reference architectures, system modeling, scaling patterns. Desirable Background 8–12 years of experience designing or implementing large-scale distributed data platforms. Proven track record as a technical architect or lead engineer at Cloudera, Databricks, AWS EMR or similar open-source platform providers. Hands-on experience integrating and operating open-source data tools across hybrid-cloud and containerized environments. Strong understanding of enterprise governance and security frameworks (SOX, FFIEC, GDPR). Exceptional communication and stakeholder engagement skills to influence architecture decisions across engineering and client teams.