Senior Data Engineer – Big Data

We are looking for a Senior Data Engineer to join our team and work with large-scale telemetry data, enabling our product teams to extract value and insights that support business operations and decision-making.What you'll do:Leverage your Python and PySpark expertise to design and implement data processing workflows and metric creation on top of massive datasets.Apply complex data analysis and modeling techniques to drive actionable insights.Support hypothesis generation and testing, exploratory analysis, and preparation of data for statistical modeling, machine learning, and deep learning.Build and deploy ML/DL models, ensuring interpretability and alignment with business goals.Collaborate with cross-functional teams and clients to ensure data-driven outcomes are delivered successfully.Skills and experiences:Advanced English.Strong experience with:Azure Synapse Analytics (pipelines, queries, orchestration).
Azure Data Lake (storage, data ingestion, partitioning strategies).
Spark SQL for distributed querying and optimization.BigQuery, Snowflake, or Hadoop for large-scale data analytics and processing.Azure DatabricksPython and PySpark.Nice to HaveExperience with Cosmos (Microsoft internal Big Data platform) and SCOPE.Exposure to data governance, monitoring, and optimization in distributed data environments.About You:Characteristics that demonstrate success for this role:Exceptional communicationConflict resolution, and decision-making skills in fast-paced,Multicultural environments.Enjoy your career:Some of the best things about working at Avanade:Opportunity to work for Microsoft Alliance Global Partner of the Year (14 consecutive years), with exceptional development and training (minimum 80 hours per year for paid training and certifications)Real-time access to technical and skilled resources globallyDedicated career counselor to encourage your growthEngaged and helpful coworkers genuinely interested in youLearn more about some of our benefits:Meal or food vouchers;Multi-benefit Card up to Senior Consultant;Medical and dental insurance;Certifications and training;Life Insurance;Private Pension;Avababy: pregnancy monitoring and kit for new Avanade fathers and mothers;Participation in the company's results;Wellhub;Daycare Assistance;Career Advisor - Career mentoring;Birthday Off policy on your birthday and children up to 12 years old;Wellness Sessions;For managerial function or higher - Corporate vehicle, parking and fuel assistance.A Great Place To WorkBy bringing your skills and capabilities to Avanade, you'll get specific experiences, unlimited learning and ambitious growth in return.
As we continue to build our diverse and inclusive culture, we have become even more innovative and creative, helping us to better serve our customers and communities.
You'll join a community of smart, supportive employees to uplift, mentor, and mentor you, and rely on their expertise.
You'll have a company built for cutting-edge, business-critical technology solutions committed to improving the way humans work, interact, and live.
It's all here, so take a closer look
Our team is made up of people with different backgrounds and backgrounds.
We believe that this diversity strengthens our company.Create a future for our people who focus on:
• Expand your thinking
• Experiment intensely
• Learn and pivotInspire greatness in our people by:
• Empowering every voice
• Encouraging boldness
• Celebrating progress Accelerate the impact of our people by:
• Surprising the customer
• Prioritizing what matters
• Acting as oneLearn More:To learn more about Avanade, check out these links: Avanade Brasil (@avanadebrasil) - Instagram(3) Avanade Brasil - LinkedInReferencesVisible linkshttps:///?
feedView=allWe work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees.
Avanade believes that all persons are entitled to equal employment opportunities, and we do not discriminate against our employees, applicants, or job seekers because of their race, color, gender, religion, national origin, disability, veteran status, age, marital status, sexual orientation, genetic information, gender identity, or any other protect group status as defined by law.
#J-18808-Ljbffr