Data Engineer

2 semanas atrás


Brasília DF, Brasil Tata Consultancy Services Tempo inteiro

Come to one of the biggest IT Services companies in the world Here you can transform your career Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to our success in a collaborative environment. We are looking for Data Enginee r who wants to learn and transform his career. In this role you will: (responsibilities) Extensive experience (5+ years) working as a Data Engineer, with a strong focus on AWS technologies and serverless architectures; - Experience working as a Data Engineer, with focus on Azure is valuable; - In-depth knowledge of AWS services such as S3, Lambda, Glue, Athena, Redshift, and DynamoDB, and their capabilities for building scalable data processing systems; - Proven expertise in designing and implementing AWS serverless architectures for large-scale data processing and storage; - Strong programming skills in languages like Python, Java, or Scala, along with experience using SQL for data manipulation and querying; - Hands-on experience with data integration and ETL tools, such as AWS Glue or Apache Spark, for transforming and processing data; - English Familiarity with data modeling techniques and data warehousing concepts, including star and snowflake schemas; - Solid understanding of data security, access control, and compliance requirements in a data-driven environment; - Experience withdata visualization tools (e.G., Tableau, Power BI) and the ability to collaborate with analysts and data scientists to deliver actionable insights; - Strong problem-solving and analytical skills, with a detail-oriented approach to ensure data accuracy and integrity; - Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment Key responsibilities: Design and implement an AWS Serverless DataLake architecture to efficiently handle large volumes of data and support various data processing workflows; - Develop data ingestion pipelines and data integration processes, ensuring the smooth and reliable transfer of data from various sources into the DataLake; - Implement data transformation and data enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency; - Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLake; - Optimize data storage and retrieval mechanisms, leveraging AWS services such as S3, Athena, Redshift, or DynamoDB, to provide high-performance access to the data; - Monitor and troubleshoot the DataLake infrastructure, identifying and resolving performance bottlenecks, data processing errors, and other issues; - Continuously evaluate new AWS services and technologies to enhance the DataLake architecture, improve data processing efficiency, and drive innovation; - Mentor and provide technical guidance to junior data engineers, fostering their growth and ensuring adherence to best practices; - Collaborate with cross-functional teams to understand business requirements, prioritize tasks, and deliver high-quality solutions within defined timelines Data lake, aws, spark, python What can you expect from us?- Professional development and constant evolution of your skills, always in line with your interests. - Opportunities to work outside Brazil - A collaborative, diverse and innovative environment that encourages teamwork. What do we offer? TCS Benefits – Brazil: Health insurance Dental Plan Life insurance Transportation vouchers Meal/Food Voucher Childcare assistance Gympass TCS Cares – free 0800 that provides psychological assistance (24 hrs/day), legal, social and financial assistance to associates Partnership with SESC Reimbursement of Certifications Free TCS Learning Portal – Online courses and live training International experience opportunity Discount Partnership with Universities and Language Schools Bring Your Buddy – By referring people you become eligible to receive a bonus for each hire TCS Gems – Recognition for performance Xcelerate – Free Mentoring Career Platform At TATA Consultancy Services we promote an inclusive culture, we always work for equity. This applies to Gender, People with Disabilities, LGBTQIA+, Religion, Race, Ethnicity. All our opportunities are based on these principles. We think of different actions of inclusion and social responsibility, in order to build a TCS that respects individuality. Come to be a TCSer#Buildingonbelief ID: 10331504


  • Senior Data Engineer

    2 semanas atrás


    Brasília, DF, Brasil beBeeDataEngineer Tempo inteiro

    We are seeking a seasoned Data Engineer to join our team. This individual will be responsible for designing, implementing and managing data pipelines using Apache Nifi. This role requires strong experience with Apache Nifi, XML and xPath; Proven understanding of data flow patterns and integration design principles; Familiarity with implementing data...

  • Data Engineer

    3 semanas atrás


    Brasília, DF, Brasil Insight Global Tempo inteiro

    Required Skills & Experience - 5+ years of experience with Power BI development and engineering (DAX and semantic model development and deployment) Strong hands on coding ability in PySpark and Python Professional working experience with Databricks, Fabirc, or similar Spark platforms Fair knowledge on the use of Azure Dev Ops (ADO) to manage repository and...

  • Data Engineer

    3 semanas atrás


    Brasília, DF, Brasil Insight Global Tempo inteiro

    Required Skills & Experience 5+ years of experience with Power BI development and engineering (DAX and semantic model development and deployment) Strong hands on coding ability in PySpark and Python Professional working experience with Databricks, Fabirc, or similar Spark platforms Fair knowledge on the use of Azure Dev Ops (ADO) to manage repository and...

  • Data Engineer

    1 dia atrás


    Brasília, Brasil Brick Abode Tempo inteiro

    We're Hiring: Data Engineer We're looking for a Data Engineer with solid Machine Learning and Optimization experience.This is a full-time remote position on a PJ contract , offering the opportunity to work on challenging and impactful projects.Skills:PythonMachine Learning EngineeringEnglishScikit-learn, XGBoost & LightGBMTime series forecastingDeep learning...

  • Data Engineer

    Há 5 horas


    Brasília, Brasil Brick Abode Tempo inteiro

    We’re Hiring: Data Engineer We’re looking for a Data Engineer with solid Machine Learning and Optimization experience. This is a full-time remote position on a PJ contract , offering the opportunity to work on challenging and impactful projects. Skills: Python Machine Learning Engineering English Scikit-learn, XGBoost & LightGBM Time series...

  • Data engineer

    2 semanas atrás


    Brasília, Brasil Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to...

  • Data Engineer

    Há 7 dias


    Brasília, Brasil Exactius Tempo inteiro

    About Exactius Exactius works with companies to solve complex digital marketing challenges and achieve ambitious growth goals. We bring executive leadership and cross-functional execution teams that can not only form the strategy but can execute and deliver the result. These teams always include a proven performance marketing CMO, along with campaign and...

  • Data Engineer

    4 semanas atrás


    Brasília, DF, Brasil Teachable Tempo inteiro

    What is Teachable? Teachable is a no-code platform for creators who want to build a more impactful business through courses, coaching, downloadable content, and community. With Teachable, creators can engage their online audiences and get paid—on their own terms. Today, tens of thousands of creators use Teachable to share their knowledge and, to date, have...

  • Data engineer

    3 semanas atrás


    Brasília, Brasil Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to...

  • Data Engineer

    Há 5 dias


    Brasília, Brasil Tata Consultancy Services Tempo inteiro

    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to...