Senior Data Architect + Databricks, Brazil

1 day ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions. With over 7.400 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality. Since 2017, CI&T and Databricks have collaborated to help enterprise customers gather valuable insights from their data. Together, we significantly influence our clients' Data, AI, and ML journeys. With over 200 seasoned Databricks practitioners and a track record of successful enterprise projects, the partnership between CI&T and Databricks is exceptionally robust. We're growing fast and seeking a talented, motivated Databricks Senior Data Architect to join our team. You'll play a crucial role in designing, developing, and maintaining scalable data pipelines and infrastructure to drive data analytics and machine learning solutions for our clients. Key Responsibilities Architecture Design: Design and implement scalable and efficient data architecture solutions using Databricks, ensuring alignment with best practices and client needs. Data Pipeline Development: Create, test, and maintain robust data pipelines to ingest and process large volumes of data from various sources. Collaboration: Work closely with data engineers, data scientists, and stakeholders to understand data requirements and translate them into technical specifications. Performance Optimization: Monitor and optimize the performance of data pipelines and infrastructure, ensuring high availability and reliability. Technology Evaluation: Track emerging technologies and data processing frameworks to enhance the existing architecture and recommend improvements. Documentation: Develop and maintain comprehensive documentation for data architecture, processes, and workflows. Mentorship: Provide technical guidance and mentorship to junior data architects and engineers within the team. Client Engagement: Collaborate with clients to understand their business objectives and data challenges, providing insights and recommendations to drive their data strategy. Requirements for this Challenge Educational Background: Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field. Experience: Minimum of 5 years of experience in data architecture, data engineering, or a similar role, with hands-on experience in Databricks. Soft Skills: Excellent communication in English and Portuguese, with the ability to work effectively in a team-oriented environment and engage with clients. Technical Skills: Proficiency in Apache Spark, SQL, and data modeling; strong understanding of ETL processes and tools. Cloud Platforms: Experience with cloud platforms such as Azure, AWS, or Google Cloud, especially concerning Databricks services. Networking and IAM setup experience are a plus. Programming Languages: Proficient in the Python programming language. Data Warehousing: Familiarity with data warehousing concepts and technologies. Problem-Solving Skills: Strong analytical and problem-solving skills with a focus on optimizing data solutions. Nice to Have Certifications: Relevant certifications in Databricks, AWS, Azure, or Google Cloud. Machine Learning Knowledge: Understanding of machine learning concepts and frameworks to support data science initiatives. Agile Experience: Experience working in Agile environments and familiarity with DevOps + IaC practices. Additional Programming Languages: Scala, Java, or R. -Health and dental insurance -Meal and food allowance -Extended paternity leave -Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass; - Profit Sharing and Results Participation (PLR); -Life insurance - Continuous learning platform (CI&T University); -Discount club -Free online platform dedicated to physical, mental, and overall well-being -Pregnancy and responsible parenting course -Partnerships with online learning platforms -Language learning platform And many more More details about our benefits here: At CI&T, inclusion starts at the first contact. If you are a person with a disability, it is important to present your assessment during the selection process. This way, we can ensure the support and accommodations that you deserve. If you do not yet have the assessment, don't worry: we can support you in obtaining it. We have a dedicated Health and Well-being team, inclusion specialists, and affinity groups who will be with you at every stage. Count on us to make this journey side by side. Seniority level Seniority level Not Applicable Employment type Employment type Full-time Job function Job function Engineering and Information Technology Industries IT Services and IT Consulting Referrals increase your chances of interviewing at CI&T by 2x Sign in to set job alerts for “Senior Data Architect” roles. We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr