Sr. Data Engineer

Sr Data Engineer (São Paulo, Brazil) Become part of a community of experts in Information Digital Engineering (IDE), turning ideas into reality by embedding AI across the organization. From enhancing existing operations to accelerating the development of next-generation clean energy solutions, your impact will be transformative. The IDE team creates business value daily through cutting-edge knowledge. We maximize the value of information and data using deep technical expertise and market-leading tools to deliver actionable, data-driven insights. Your Role: Senior Data Engineer As a Senior Data Engineer, you are a subject matter expert—curious, innovative, and passionate about mentoring young professionals. You will translate vision and data strategy into IT solutions and promote data-driven thinking across the organization. Responsibilities • Communicate effectively with both technical developers and business leaders • Deliver and embed data foundation initiatives using leading market-standard tools • Coordinate change management, incident response, and problem resolution processes • Ensure traceability of requirements from data through testing, training, and transition • Drive implementation efficiency to reduce costs, accelerate delivery, and maximize value Being Part of the Team You'll bring deep technical skills and become a key contributor to defining the data journey. We value collaboration, innovation, and continuous learning to keep you future-ready. Education & Experience • University degree in any IT-related discipline • Minimum of 7 years of experience in the IT industry Required Skills • Experience building ETL/data warehouse processes using Azure Data Factory and Databricks • Proficiency with Azure Storage, Synapse Analytics, Data Lake, Analysis Services, and Cosmos DB • Programming in Python, Scala, Spark SQL; automation with PowerShell or Azure CLI • Strong SQL skills and experience integrating data across Microsoft and third-party platforms • Designing and maintaining scalable data pipelines for ingestion, processing, and transformation • Optimizing and monitoring pipelines for performance, availability, and cost efficiency • Experience with Azure DevOps for CI/CD and automation • Designing high-performance, integrated data pipelines across enterprise data sources • Developing reusable frameworks for big data ingestion and enrichment • Project management and stakeholder engagement to ensure timely, high-quality delivery Leadership Skills We value leadership and offer opportunities to grow. In this role, you will: • Be self-motivated, innovative, and proactive in driving initiatives to completion • Communicate effectively with developers, architects, and business stakeholders • Understand data foundation concepts such as modeling, quality, governance, maturity, and strategy • Work with version control tools like GitHub and Azure DevOps • Apply AGILE and KANBAN methodologies Nice to Have Skills • Knowledge of gas/power trading: short-term and physical asset trading (CCGT, wind, solar, battery)• Risk modeling and risk management understanding • Quantitative analysis using statistical methods • Commodity modeling in energy and meteorology • Experience with scripting languages: YAML, PowerShell, Terraform • Familiarity with big data tools: Kafka, Hadoop, Spark; stream-processing systems • Workflow management tools: Azkaban, Luigi, Airflow • Python libraries: NumPy, Pandas, Django • Azure certification Work Culture We strive to build a diverse and inclusive environment where everyone feels valued and respected. Our focus includes: • Flexible working conditions (on-site and remote)• Strong investment in professional development through mentoring, coaching, and formal training • Career growth opportunities across multiple areas of the organization