Senior Data Engineer

Job Summary

Data Engineers perform a vital role helping produce analytics that provide value for our customers and accelerate our business. This job requires great communication skills, a high degree data literacy, and tool fluency in the modern data stack. Data Engineers typically work in a multi-disciplinary teams with other data, software, and business professionals. Senior data engineers are expected to be technical leaders within the teams they work in, helping other technical individual contributors deliver key results for the business.

Entity

Technology

Job Family Group

IT&S Group

Job Description

Job Summary

Data Engineers perform a vital role helping produce analytics that provide value for our customers and accelerate our business. This job requires great communication skills, a high degree data literacy, and tool fluency in the modern data stack. Data Engineers typically work in a multi-disciplinary teams with other data, software, and business professionals. Senior data engineers are expected to be technical leaders within the teams they work in, helping other technical individual contributors deliver key results for the business.

Responsibilities

• Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners.
• Architects, designs, implements and maintains reliable and scalable data infrastructure to move, process and serve data.
• Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp.
• Adheres to and advocates for software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation),
• Responsible for deploying secure and well-tested software that meets privacy and compliance requirements; develops, maintains and improves CI / CD pipeline,
• Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Design, build, deploy and maintain infrastructure as code. Containerizes server deployments.
• Actively contributes to improve developer velocity.
• Mentors others.

Qualifications

• BS degree in computer science or related field
• Deep and hands-on experience designing, planning, building, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
• Development experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#)
• Advanced database and SQL knowledge
• Experience designing and implementing large-scale distributed data systems
• Deep knowledge and hands-on experience in technologies across all data lifecycle stages
• Strong stakeholder management and ability to lead initiatives through technical influence
• Continuous learning and improvement mindset

Desired

• Solid cloud platform experience technical skills in AWS OR Azure. Exceptional candidates will have deep experience in both, but only one is required.
• Solid hands-on big data experience in Databricks (SPARK) or Palantir. We’ll also consider folks with AWS-Glue, or open source spark as well, but databricks is preferred

Why join us

At bp, we support our people to learn and grow in a diverse and high-reaching environment. We believe that our team is strengthened by diversity. We are committed to fostering an inclusive environment in which everyone is respected and treated fairly.

There are many aspects of our employees’ lives that are meaningful, so we offer benefits to enable your work to fit with your life.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Travel Requirement

No travel is expected with this role

Relocation Assistance

This role is not eligible for relocation

Remote Type

This position is a hybrid of office/remote working

Skills

Cloud Platforms, Cloud Platforms, Collaboration, Communication, Configuration management and release, Continuous deployment and release, Creating a high performing team, Database Design, Digital Project Management, Documentation and knowledge sharing, Emerging technology monitoring, Facilitation, Information Security, Mentoring, Metrics definition and instrumentation, NoSql data modelling, Problem Solving, Relational Data Modelling, Risk Management, Scripting, Secure development, Service operations