Senior Azure Data Architect

**About the job Senior Azure Data Architect**

**Summary of Duties & Responsibilities**

The Senior Azure Data Architect is expected to evangelize and educate others on engineering design and development standards. Senior Azure Data Architect is expected to function as a productive member of a team, working and communicating proactively with engineering peers, technical lead, project managers, product owners, and resource managers.

**Essential Functions**
- Design and develop data pipelines.
- Design and develop Azure ML model execution architecture.
- Design and develop methods for handling 3rd party data for use within ML models.
- Evangelize engineering design and development standards.
- Participate in Agile ceremonies including daily stand-ups, sprint planning, retrospectives, and product demonstrations.
- Produce efficient and elegant code that meets business requirements
- Author unit tests that adhere to code coverage guidelines.
- Proactively communicate progress, issues, and risks to stakeholders.
- Accurately estimate assignments.
- Create and maintain technical documentation.
- Mentor less experienced engineers.
- Contribute to the growth and maturity of the Software Engineering Group.
- Performs other related duties as directed.

**Required Skills & Competencies**
- 7 years of hands-on experience designing and implementing multi-tenant solutions using Azure Databricks for data governance, data pipelines for near real-time data warehouse, and machine learning solutions.
- 10 years of extensive, hands-on experience designing and implementing large-scale multi-tenant distributed data architecture for BI and OLTP systems.
- 5 years of hands-on experience designing and developing multi-tenant solutions using Power BI, Power BI Embedded, Power BI Services, Power BI Gateway, and Power BI Dataflow.
- 10 years of advanced hands-on experience designing and implementing large-scale multi-tenant data pipeline (TB or PB in size) including Change Data Capture (CDC) solutions for structured, semi-structured, and unstructured data in batch and real-time environments.
- 5 years of hands-on experience in Azure services including Azure SQL Database, Azure Databricks, Azure Analysis Services, Azure ML Services, and Azure Synapse Analytics.
- 5 years of hands-on experience with data integration using ETL / ELT tools (e.g., SSIS, Azure Data Factory, Airflow).
- Advanced knowledge of Python, Object-Oriented Programming, and unit testing.
- Expert in data modeling.
- Broad experience in Microsoft SQL technologies including SSAS Tabular models, DAX, T-SQL, Service Broker, Replication, and Performance Tuning.
- Broad multi-tenant data architecture and implementation experience across different data stores (e. g., Azure Data Lake GEN2, Azure SQL Data Warehouse, Azure Blob Storage, HDFS), messaging systems (e. g., Azure Event Hubs, Apache Kafka), and data processing engines (e. g., Azure Data Lake Analytics, Apache Hadoop, Apache Spark, Apache Storm, Azure HDInsight).
- Experience with Pandas and parallel processing. Experience with Ray is a plus.
- Experience with data integration through APIs, Web Services, SOAP, and/or REST services.
- Experience using Azure DevOps and CI/CD as well as Agile tools and processes including Git, Jenkins, Jira, and Confluence.
- Additional programming experience is a plus including experience with NET, Scala, R, Java.
- Must have demonstrated experience designing and implementing data pipelines for consumption by machine learning and BI solutions.
- Knowledge of SOA and Micros Services Application Architecture.
- Ability to work in a fast-paced, collaborative team environment.
- Excellent written and verbal communication skills and ability to express ideas clearly and concisely.

**Education or Prior Work Experience**
- Bachelor's degree in CS or related field, master's degree preferred.
- 10+ years of experience with designing and developing complex data architecture solutions.
- 5+ years of design and development experience with Microsoft Azure data architecture and related solutions (e.g., Azure Data Lake Gen2, Azure Data Factory, CDM, Event Hub, Azure Databricks, Synapse, Azure SQL DW).

**Salary**: R$10.00 - R$20.00 per month