Staff Technical Solutions Engineer, Spark Sao Paulo, Brazil

Overview

Staff Technical Solutions Engineer, Spark – Sao Paulo, Brazil. This is a hybrid role requiring ~3 days in the office in São Paulo-SP.

As a Spark Staff Technical Solutions Engineer, you will provide deep technical and consulting solutions for challenging Apache Spark/ML/AI/Delta/Streaming/Lakehouse issues reported by customers and help resolve challenges involving the Databricks unified analytics platform. You will assist customers in their Databricks journey by delivering guidance, knowledge, and expertise to help them realize value and achieve strategic objectives using our products.

Outcomes / Responsibilities

• Perform initial analysis and troubleshooting of Apache Spark issues using Spark UI metrics, DAGs, and Event Logs for customer-reported job slowness.
• Troubleshoot and provide deep code-level analysis of Spark to address issues related to Spark core internals, Spark SQL, Structured Streaming, Delta, Lakehouse, and other Databricks runtime features.
• Help customers set up reproducible Spark problems with solutions in areas such as Spark SQL, Delta, Memory Management, Performance tuning, Streaming, Data Science, and Data Integration.
• Contribute to the development of tools and automation initiatives.
• Participate in the Designated Solutions Engineer program and drive one or two strategic customer day-to-day Spark and Cloud issues.
• Provide best practices guidance around Spark runtime performance and usage of Spark core libraries and APIs for customer-built solutions.
• Provide frontline support for third-party integrations with the Databricks environment.
• Plan and coordinate with Account Executives, Customer Success Engineers, and Resident Solution Architects to address customer issues and share best practices.
• Participate in screen-sharing sessions and Slack conversations with internal stakeholders and customers to drive major Spark issues at an individual contributor level.
• Review Engineering JIRA tickets and proactively inform the support leadership team for follow-up on action items.
• Manage assigned Spark cases daily and adhere to committed SLAs.
• Build an internal wiki and knowledge base with technical documentation for the support team and customers; contribute to company documentation and knowledge base articles.
• Exceed expectations of the support organization KPIs.
• Coordinate with Engineering and Backline Support to identify and report product defects.
• Advocate for customers and participate in weekend and weekday on-call rotations, handling escalations during Databricks runtime outages and critical issues.
• Strengthen AWS/Azure and Databricks platform expertise through continuous learning and internal training.

Competencies / Qualifications

• 8+ years of experience in designing, building, testing, and maintaining Python/Java/Scala applications in project delivery and consulting environments.
• 2+ years of hands-on experience in two or more of Big Data, Hadoop, Apache Spark, Machine Learning, AI, Streaming, Kafka, Data Science, or ElasticSearch at production scale; Spark experience is mandatory.
• Hands-on experience in performance tuning/troubleshooting Hive and Spark-based applications at production scale.
• Experience with JVM and memory management techniques (garbage collection, heap/thread dump analysis) is preferred.
• Working knowledge of Data Lakes and SCD use cases at production scale.
• Experience with SQL-based databases and Data Warehousing/ETL technologies (e.g., Informatica, DataStage, Oracle, Teradata, SQL Server, MySQL) is preferred.
• Linux/Unix administration skills are a plus.
• Hands-on experience with AWS, Azure, or GCP is preferred.
• Excellent written and verbal communication skills.
• Strong analytical and problem-solving abilities in a distributed big data computing environment.

About Databricks

Databricks is the data and AI company. More than 10,000 organizations rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe. To learn more, follow Databricks on Twitter, LinkedIn, and Facebook.

Benefits

Databricks offers comprehensive benefits and perks. For specific regional details, please visit the benefits portal linked in the posting.

Our Commitment to Diversity and Inclusion

Databricks is committed to fostering a diverse and inclusive culture. Hiring practices are inclusive and meet equal employment opportunity standards. Applicants are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical or mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, or other protected characteristics.

Compliance

If access to export-controlled technology or source code is required for performance of job duties, it is within the Employer’s discretion whether to seek a U.S. government license for such positions and the Employer may decline to proceed with an applicant on that basis alone.

Apply for this job

First Name * Last Name * Email * Phone * Resume/CV * Attach (Accepted file types: pdf, doc, docx, txt, rtf)

Cover Letter (Accepted file types: pdf, doc, docx, txt, rtf)

LinkedIn Profile Website

How did you hear about this job?

Are you legally authorized to work in the country where you are applying? *

Do you now or will you in the future need sponsorship for employment visa status? *

Have you previously worked for Databricks?

Note: This posting may include standard job application fields.

#J-18808-Ljbffr

---