Lead Data Software Engineer

Overview We are in search of a skilled Lead Data Software Engineer for a remote position, ready to contribute to our team's success and bolster our Data Science endeavors. As the Lead Data Software Engineer, you'll be instrumental in crafting and sustaining datamarts, ensuring the delivery of efficient and scalable data solutions that meet the unique needs of our clients. Your primary focus will revolve around constructing and maintaining data pipelines, offering on-call support, and fostering collaboration with Data Science teams to deliver top-tier solutions. Additionally, you'll be tasked with steering a group of proficient professionals, providing mentorship and guidance to empower them to produce cutting-edge solutions for the industry. Responsibilities Guide and nurture the Data Software Engineering team, cultivating a culture of continual learning and growth within the unit Collaborate with interdisciplinary teams to furnish top-notch data solutions aligning with project objectives and timelines Forge and uphold robust Data Software Engineering processes and practices emphasizing automation, innovation, and efficiency Ensure the realization and upkeep of streamlined and scalable data solutions utilizing AWS services Supervise the fine-tuning of data processing and workflow management through Apache Airflow and Apache Spark Consistently assess industry trends and best practices to enhance and implement the most potent Data Software Engineering strategies Provide on-call assistance for data pipelines and datamarts Direct the team in crafting and deploying REST APIs for seamless data integration and communication Engage directly with clients to comprehend their requirements and deliver tailored, effective solutions Steer the organization and structure of the team, guaranteeing the prompt and efficient delivery of projects Collaborate with stakeholders, showcasing excellent communication and leadership skills Requirements A minimum of 5 years of experience as a Data Software Engineer, engaged in substantial projects and intricate data infrastructures At least 1 year of confirmed leadership experience, adeptly managing and motivating a team of Data Software Engineers Proficiency in Amazon Web Services, encompassing the design and implementation of scalable and effective data solutions Substantial expertise in Apache Airflow and Apache Spark, ensuring streamlined data processing and workflow management Advanced familiarity with at least one CI/CD tool, preferably Jenkins, for the efficient delivery of data pipelines Proficiency in Python and SQL, facilitating the creation and upkeep of data pipelines and ETL processes Experience with Databricks and PySpark for data processing and analysis Acquaintance with REST APIs for seamless data integration and communication Robust analytical skills, empowering adept problem-solving and decision-making in intricate environments Effective client-facing skills, facilitating clear communication and collaboration to attain project objectives Exceptional organizational and structuring abilities, championing the efficient delivery of projects Upper-intermediate proficiency in the English language, enabling clear collaboration, presentation, and discussion with the team and stakeholders Nice to have Background with Redshift for data warehousing and analysis We offer International projects with top brands Work with global teams of highly skilled, diverse peers Employee financial programs Paid time off and sick leave Upskilling, reskilling and certification courses Unlimited access to the LinkedIn Learning library and 22,000+ courses Global career opportunities Volunteer and community involvement opportunities EPAM Employee Groups Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn Seniority level Mid-Senior level Employment type Full-time Job function Information Technology, Engineering, and Business Development Industries Software Development, IT Services and IT Consulting, and Technology, Information and Internet Referrals increase your chances of interviewing at EPAM Systems by 2x Get notified about new Lead Software Engineer jobs in Brazil . Joinville, Santa Catarina, Brazil 3 weeks ago Software Engineering Lead (Java - Authorization Latam) We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr