Sr. Data Engineer

Sr Data Engineer (São Paulo, Brazil) Become part of a community of experts in Information Digital Engineering (IDE), turning ideas into reality by embedding AI across the organization.From enhancing existing operations to accelerating the development of next-generation clean energy solutions, your impact will be transformative.The IDE team creates business value daily through cutting-edge knowledge.We maximize the value of information and data using deep technical expertise and market-leading tools to deliver actionable, data-driven insights.Your Role: Senior Data EngineerAs a Senior Data Engineer, you are a subject matter expert—curious, innovative, and passionate about mentoring young professionals.You will translate vision and data strategy into IT solutions and promote data-driven thinking across the organization.Responsibilities• Communicate effectively with both technical developers and business leaders• Deliver and embed data foundation initiatives using leading market-standard tools• Coordinate change management, incident response, and problem resolution processes• Ensure traceability of requirements from data through testing, training, and transition• Drive implementation efficiency to reduce costs, accelerate delivery, and maximize valueBeing Part of the TeamYou'll bring deep technical skills and become a key contributor to defining the data journey.We value collaboration, innovation, and continuous learning to keep you future-ready.Education & Experience• University degree in any IT-related discipline• Minimum of 7 years of experience in the IT industry? Required Skills• Experience building ETL/data warehouse processes using Azure Data Factory and Databricks• Proficiency with Azure Storage, Synapse Analytics, Data Lake, Analysis Services, and Cosmos DB• Programming in Python, Scala, Spark SQL; automation with PowerShell or Azure CLI• Strong SQL skills and experience integrating data across Microsoft and third-party platforms• Designing and maintaining scalable data pipelines for ingestion, processing, and transformation• Optimizing and monitoring pipelines for performance, availability, and cost efficiency• Experience with Azure DevOps for CI/CD and automation• Designing high-performance, integrated data pipelines across enterprise data sources• Developing reusable frameworks for big data ingestion and enrichment• Project management and stakeholder engagement to ensure timely, high-quality deliveryLeadership SkillsWe value leadership and offer opportunities to grow.In this role, you will:• Be self-motivated, innovative, and proactive in driving initiatives to completion• Communicate effectively with developers, architects, and business stakeholders• Understand data foundation concepts such as modeling, quality, governance, maturity, and strategy• Work with version control tools like GitHub and Azure DevOps• Apply AGILE and KANBAN methodologiesNice to Have Skill s• Knowledge of gas/power trading: short-term and physical asset trading (CCGT, wind, solar, battery)• Risk modeling and risk management understanding• Quantitative analysis using statistical methods• Commodity modeling in energy and meteorology• Experience with scripting languages: YAML, PowerShell, Terraform• Familiarity with big data tools: Kafka, Hadoop, Spark; stream-processing systems• Workflow management tools: Azkaban, Luigi, Airflow• Python libraries: NumPy, Pandas, Django• Azure certificationWork CultureWe strive to build a diverse and inclusive environment where everyone feels valued and respected.Our focus includes:• Flexible working conditions (on-site and remote)• Strong investment in professional development through mentoring, coaching, and formal training• Career growth opportunities across multiple areas of the organization