Sr. Data Engineer

Sr Data Engineer (São Paulo, Brazil) Become part of a community of experts in Information Digital Engineering (IDE), turning ideas into reality by embedding AI across the organization. From enhancing existing operations to accelerating the development of next-generation clean energy solutions, your impact will be transformative. The IDE team creates business value daily through cutting-edge knowledge. We maximize the value of information and data using deep technical expertise and market-leading tools to deliver actionable, data-driven insights. Your Role: Senior Data Engineer As a Senior Data Engineer, you are a subject matter expert—curious, innovative, and passionate about mentoring young professionals. You will translate vision and data strategy into IT solutions and promote data-driven thinking across the organization. Responsibilities - Communicate effectively with both technical developers and business leaders - Deliver and embed data foundation initiatives using leading market-standard tools - Coordinate change management, incident response, and problem resolution processes - Ensure traceability of requirements from data through testing, training, and transition - Drive implementation efficiency to reduce costs, accelerate delivery, and maximize value Being Part of the Team You'll bring deep technical skills and become a key contributor to defining the data journey. We value collaboration, innovation, and continuous learning to keep you future-ready. Education & Experience - University degree in any IT-related discipline - Minimum of 7 years of experience in the IT industry Required Skills - Experience building ETL/data warehouse processes using Azure Data Factory and Databricks - Proficiency with Azure Storage, Synapse Analytics, Data Lake, Analysis Services, and Cosmos DB - Programming in Python, Scala, Spark SQL; automation with PowerShell or Azure CLI - Strong SQL skills and experience integrating data across Microsoft and third-party platforms - Designing and maintaining scalable data pipelines for ingestion, processing, and transformation - Optimizing and monitoring pipelines for performance, availability, and cost efficiency - Experience with Azure DevOps for CI/CD and automation - Designing high-performance, integrated data pipelines across enterprise data sources - Developing reusable frameworks for big data ingestion and enrichment - Project management and stakeholder engagement to ensure timely, high-quality delivery Leadership Skills We value leadership and offer opportunities to grow. In this role, you will: - Be self-motivated, innovative, and proactive in driving initiatives to completion - Communicate effectively with developers, architects, and business stakeholders - Understand data foundation concepts such as modeling, quality, governance, maturity, and strategy - Work with version control tools like GitHub and Azure DevOps - Apply AGILE and KANBAN methodologies Nice to Have Skills - Knowledge of gas/power trading: short-term and physical asset trading (CCGT, wind, solar, battery)- Risk modeling and risk management understanding - Quantitative analysis using statistical methods - Commodity modeling in energy and meteorology - Experience with scripting languages: YAML, PowerShell, Terraform - Familiarity with big data tools: Kafka, Hadoop, Spark; stream-processing systems - Workflow management tools: Azkaban, Luigi, Airflow - Python libraries: NumPy, Pandas, Django - Azure certification Work Culture We strive to build a diverse and inclusive environment where everyone feels valued and respected. Our focus includes: - Flexible working conditions (on-site and remote)- Strong investment in professional development through mentoring, coaching, and formal training - Career growth opportunities across multiple areas of the organization