Data engineer

Come to one of the biggest IT Services companies in the world Here you can transform your careerWhy to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to our success in a collaborative environment.We are looking forData Engineerwho wants to learn and transform his career.In this role you will:Extensive experience (5+ years) working as a Data Engineer, with a strong focus on AWS technologies and serverless architectures;Experience working as a Data Engineer, with focus on Azure is valuable;In-depth knowledge of AWS services such as S3, Lambda, Glue, Athena, Redshift, and Dynamo DB, and their capabilities for building scalable data processing systems;Proven expertise in designing and implementing AWS serverless architectures for large-scale data processing and storage;Strong programming skills in languages like Python, Java, or Scala, along with experience using SQL for data manipulation and querying;Hands-on experience with data integration and ETL tools, such as AWS Glue or Apache Spark, for transforming and processing data;EnglishAnd much better if you stand out for:Familiarity with data modeling techniques and data warehousing concepts, including star and snowflake schemas;Solid understanding of data security, access control, and compliance requirements in a data-driven environment;Experience with data visualization tools (e.g., Tableau, Power BI) and the ability to collaborate with analysts and data scientists to deliver actionable insights;Strong problem-solving and analytical skills, with a detail-oriented approach to ensure data accuracy and integrity;Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environmentKey Responsibilities:Design and implement an AWS Serverless Data Lake architecture to efficiently handle large volumes of data and support various data processing workflows;Develop data ingestion pipelines and data integration processes, ensuring the smooth and reliable transfer of data from various sources into the Data Lake;Implement data transformation and data enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency;Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the Data Lake;Optimize data storage and retrieval mechanisms, leveraging AWS services such as S3, Athena, Redshift, or Dynamo DB, to provide high-performance access to the data;Monitor and troubleshoot the Data Lake infrastructure, identifying and resolving performance bottlenecks, data processing errors, and other issues;Continuously evaluate new AWS services and technologies to enhance the Data Lake architecture, improve data processing efficiency, and drive innovation;Mentor and provide technical guidance to junior data engineers, fostering their growth and ensuring adherence to best practices;Collaborate with cross-functional teams to understand business requirements, prioritize tasks, and deliver high-quality solutions within defined timelinesKey Words:Data lake, aws, spark, pythonWhat do we offer?TCS Benefits – Brazil:Health insuranceDental PlanLife insuranceTransportation vouchersMeal/Food VoucherChildcare assistanceGympassTCS Cares – free 0800 that provides psychological assistance (24 hrs/day), legal, social and financial assistance to associatesPartnership with SESCReimbursement of CertificationsFree TCS Learning Portal – Online courses and live trainingInternational experience opportunityDiscount Partnership with Universities and Language SchoolsBring Your Buddy – By referring people you become eligible to receive a bonus for each hireTCS Gems – Recognition for performanceXcelerate – Free Mentoring Career PlatformTata Consultancy Services is an equal opportunity employer, our commitment to diversity & inclusion drives our efforts to provide equal opportunity to all candidates who meet our required knowledge & competency needs, irrespective of any socio-economic background, race, color, national origin, religion, sex, gender identity/expression , age, marital status, disability, sexual orientation or any others. We encourage anyone interested to build a career in TCS to participate in our recruitment & selection process.At Tata Consultancy Services we promote an inclusive culture, we always work for equity. This applies to Gender, People with Disabilities, LGBTQIA+, Religion, Race, Ethnicity. All our opportunities are based on these principles. We think of different actions of inclusion and social responsibility, in order to build a TCS that respects each person. Our motto is Inclusion without exception.At TATA Consultancy Services we promote an inclusive culture, we always work for equity. This applies to Gender, People with Disabilities, LGBTQIA+, Religion, Race, Ethnicity. All our opportunities are based on these principles. We think of different actions of inclusion and social responsibility, in order to build a TCS that respects individuality. Come to be a TCSer#BuildingonbeliefRGS -