Software Engineer

Hoje

We are seeking a skilled and experienced Data Engineer to join our Threat Research team. The primary responsibility of this role will be to design, develop, and maintain data pipelines for threat intelligence ingestion, validation, and export automation flows.

Responsibilities

• Design, develop, and maintain data pipelines for ingesting threat intelligence data from various sources into our data ecosystem.
• Implement data validation processes to ensure data accuracy, completeness, and consistency.
• Collaborate with threat analysts to understand data requirements and design appropriate solutions.
• Develop automation scripts and workflows for data export processes to external systems or partners.
• Optimize and enhance existing data pipelines for improved performance and scalability.
• Monitor data pipelines and troubleshoot issues as they arise, ensuring continuous data availability and integrity.
• Document technical specifications, data flows, and procedures for data pipeline maintenance and support.
• Stay updated on emerging technologies and best practices in data engineering and incorporate them into our data ecosystem.
• Provide technical guidance and support to other team members on data engineering best practices and methodologies.

Requirements

• Proven experience as a Data Engineer or similar role, with a focus on data ingest, validation, and export automation.
• Strong proficiency in Python.
• Experience with data pipeline orchestration tools such as Apache Airflow, Apache NiFi, or similar.
• Familiarity with cloud platforms such as Snowflake, AWS, Azure, or Google Cloud Platform.
• Experience with data validation techniques and tools for ensuring data quality.
• Experience building and deploying images using containerization technologies such as Docker and Kubernetes.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills, with the ability to work effectively in a team environment.

Nice-to-Have

• NoSQL database design and development using MongoDB, AWS DynamoDB, or Azure Cosmos DB.
• Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and services related to data storage/processing
• Exposure to Terraform or other Infrastructure-as-Code tooling.
• Proficient in Azure DevOps for source code and pipeline management.

Why Join Us?

• Opportunity to work on enterprise-scale reporting systems.
• Fully remote role based out of Brazil (supporting EST/CST hours).
• Short-term but impactful 4–5 month contract.
• Work alongside skilled professionals and contribute to meaningful projects.

Interested? Apply today and help deliver trusted reporting data for enterprise decision-making.

This position is fully remote and is a PJ contract. Pay range is 25-29/hr USD.

Required Skills & Experience

• 5+ years of experience as a Data Engineer with minimum 3 years of experience in Azure tool Stack (Databricks , ADF, Synapse Analytics)
• Good to have experience with other Azure services Azure Functions, Event Grid, etc
• Strong expertise in writing complex SQL and transformations.
• Ability to write, review and examine code written in Python and PySpark
• Proficient in Devops CI/CD (High level understanding)
• Experience with RDBMS
• Fundamental knowledge of Data warehousing concepts
• SQL & SQL Tuning within Data Lake (Delta Format)
• Cost Optimizations

Nice to Have Skills & Experience

• Azure Solution Architecture Experience (IaaS/PaaS/SaaS)

Hoje

Come to one of the biggest IT Services companies in the world Here you can transform your career

Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to our success in a collaborative environment.

We are looking for "Senior Software Engineer " Remote in Sao Paulo who wants to learn and transform his career.

In this role you will: (responsibilities)

- Sprint Boot

- Spring Chache

- Spring Data

- Design Patterns

-Junit

-JPA

- TDD

- Familiarity with the Linux environment

MySql

Python;

AWS (S3, Lambda, ECS, EC2, EventBridge, CloudWatch, DynamoDB, StepFunction, Aurora, GlueJob, ApiGateway, Dynamo);

Kafka;

OpenApi3.0;

Docker;

TerraformCloudformation;

Clean Code;

Clean Arch;

Hexagonal Architecture;

GitFlow;

What can you expect from us?

• Professional development and constant evolution of your skills, always in line with your interests.

• Opportunities to work outside Brazil

• A collaborative, diverse and innovative environment that encourages teamwork.

What do we offer?

Health insurance

Life insurance

Gympass

TCS Cares – free 0800 that provides psychological assistance (24 hrs/day), legal, social and financial assistance to associates

Partnership with SESC

Reimbursement of Certifications

Free TCS Learning Portal – Online courses and live training

International experience opportunity

Discount Partnership with Universities and Language Schools

Bring Your Buddy – By referring people you become eligible to receive a bonus for each hire

TCS Gems – Recognition for performance

Xcelerate – Free Mentoring Career Platform

At TATA Consultancy Services we promote an inclusive culture, we always work for equity. This applies to Gender, People with Disabilities, LGBTQIA+, Religion, Race, Ethnicity. All our opportunities are based on these principles. We think of different actions of inclusion and social responsibility, in order to build a TCS that respects individuality. Come to be a TCSer

This refined description preserves core responsibilities and requirements for two roles and restructures them with consistent HTML formatting using only allowed tags. IsExpired: false