Sr. Data Engineer

Sr Data Engineer (São Paulo, Brazil)

Become part of a community of experts in Information Digital Engineering (IDE), turning ideas into reality by embedding AI across the organization. From enhancing existing operations to accelerating the development of next-generation clean energy solutions, your impact will be transformative.
The IDE team creates business value daily through cutting-edge knowledge. We maximize the value of information and data using deep technical expertise and market-leading tools to deliver actionable, data-driven insights.

Your Role: Senior Data Engineer
As a Senior Data Engineer, you are a subject matter expert—curious, innovative, and passionate about mentoring young professionals. You will translate vision and data strategy into IT solutions and promote data-driven thinking across the organization.

Responsibilities
• Communicate effectively with both technical developers and business leaders
• Deliver and embed data foundation initiatives using leading market-standard tools
• Coordinate change management, incident response, and problem resolution processes
• Ensure traceability of requirements from data through testing, training, and transition
• Drive implementation efficiency to reduce costs, accelerate delivery, and maximize value

Being Part of the Team
You'll bring deep technical skills and become a key contributor to defining the data journey. We value collaboration, innovation, and continuous learning to keep you future-ready.

Education & Experience
• University degree in any IT-related discipline
• Minimum of 7 years of experience in the IT industry

️ Required Skills
• Experience building ETL/data warehouse processes using Azure Data Factory and Databricks
• Proficiency with Azure Storage, Synapse Analytics, Data Lake, Analysis Services, and Cosmos DB
• Programming in Python, Scala, Spark SQL; automation with PowerShell or Azure CLI
• Strong SQL skills and experience integrating data across Microsoft and third-party platforms
• Designing and maintaining scalable data pipelines for ingestion, processing, and transformation
• Optimizing and monitoring pipelines for performance, availability, and cost efficiency
• Experience with Azure DevOps for CI/CD and automation
• Designing high-performance, integrated data pipelines across enterprise data sources
• Developing reusable frameworks for big data ingestion and enrichment
• Project management and stakeholder engagement to ensure timely, high-quality delivery

Leadership Skills
We value leadership and offer opportunities to grow. In this role, you will:
• Be self-motivated, innovative, and proactive in driving initiatives to completion
• Communicate effectively with developers, architects, and business stakeholders
• Understand data foundation concepts such as modeling, quality, governance, maturity, and strategy
• Work with version control tools like GitHub and Azure DevOps
• Apply AGILE and KANBAN methodologies

Nice to Have Skill s
• Knowledge of gas/power trading: short-term and physical asset trading (CCGT, wind, solar, battery)
• Risk modeling and risk management understanding
• Quantitative analysis using statistical methods
• Commodity modeling in energy and meteorology
• Experience with scripting languages: YAML, PowerShell, Terraform
• Familiarity with big data tools: Kafka, Hadoop, Spark; stream-processing systems
• Workflow management tools: Azkaban, Luigi, Airflow
• Python libraries: NumPy, Pandas, Django
• Azure certification

Work Culture
We strive to build a diverse and inclusive environment where everyone feels valued and respected. Our focus includes:
• Flexible working conditions (on-site and remote)
• Strong investment in professional development through mentoring, coaching, and formal training
• Career growth opportunities across multiple areas of the organization