Senior DataOps Engineer

Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive long-term career opportunities with leading organizations, access to a global community of professionals, and educational opportunities with leading technology providers.At Andela, we're deeply passionate about creating long-lasting and transformative growth opportunities for all - and doing it in an E.P.I.C. way We're excited to continue building our remote-first team with incredible people like you. After applying for this role, you will join our Andela Community of brilliant technologists by passing a technical screening and live interview. As a community member, you'll have access to a multitude of exclusive technologist roles.Join Andela today to access this opportunity and more in our global marketplaceOur roles are typically filled at lightning speed, so if you're considering applying, get your application in quicklyAbout the clientThe client operates in the health and information services domain, with a strong focus on enabling data-driven decision-making at enterprise scale. Their mission centers on building a modern, cloud-based data platform that serves as a single source of truth for business intelligence, analytics, machine learning, and AI use cases. The culture emphasizes data quality, governance, scalability, and collaboration across engineering, analytics, and business stakeholders.About the roleThis role is focused on building and operating a robust data platform on Azure using Databricks. The engineer will play a key part in DataOps, ensuring data completeness, accuracy, and reliability across enterprise-scale pipelines. You will design monitoring frameworks, implement data quality checks, and support governance initiatives. The role is highly collaborative, working closely with data engineers, analysts, and stakeholders. It also requires strong ownership and the ability to operate independently in a fast-paced environment.ResponsibilitiesDesign and develop a robust monitoring stack for jobs executed in Azure Data Factory, Databricks, MS Fabric, and other platform toolsAssist in building and maintaining data catalogs in Unity Catalog and PurviewDesign and implement a scalable framework for data quality checks across hundreds of columns on large datasetsMonitor data completeness and accuracy to ensure published data meets acceptable criteriaCollaborate with data engineers, analysts, and stakeholders to deliver high-quality data solutionsTroubleshoot and optimize big data workflows for performance and scalabilitySupport governance and oversight of data pipelines and transformation activitiesStay current with emerging technologies and best practices in big data and analyticsMust have skills7+ years of overall experience in Data Engineering / DataOps5+ years of professional software development experience in a Databricks environment (any cloud)Strong experience with DataOps practicesStrong experience with data catalogsStrong experience implementing data quality checks at scaleStrong Python experienceStrong proficiency in Data Governance processes and toolsExperience with Purview and/or Unity CatalogAdvanced SQL skillsSolid understanding of data structures, algorithms, and distributed computingExperience with ETL processes, data cleaning, and large-scale data transformationAbility to work independently and manage priorities in a fast-paced environmentExcellent problem-solving skills with an analytics-driven mindsetBachelor's or Master's degree in Computer Science, Software Engineering, or a related field, or equivalent experienceNice to have skillsExperience with Azure cloud services (preferred)Experience with AWSExperience with GCPFamiliarity with version control systems such as GitExperience with DevOps practicesConditions100% Remote role , primarily aligned to UTC-5 (EST) with a minimum of 5 hours overlap requiredContractor role – 6-month contract, renewable based on budget and performanceFull-time dedication (40 hours/week)BYOD requirementAt Andela, we know our strengths lie in our diverse community whose talents, perspectives, backgrounds and orientations we take pride in. Andela is committed to nurturing a work environment where all individuals are treated with respect and dignity. Everyone has the right to work in a professional atmosphere that promotes equal employment opportunities and prohibits discriminatory practices.Andela provides equal employment opportunities to all employees and applicants without regard to factors including but not limited to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, pregnancy (including breastfeeding), genetic information, HIV/AIDS or any other medical status, family or parental status, marital status, amnesty or status as a covered veteran in accordance with applicable federal, state and local laws. This commitment applies to all terms and conditions of employment, including but not limited to hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation