Data Engineer

bp External Careers Site

Data Engineer

India | Pune, India

Save Job

You have successfully copied the job URL to clipboard!

Job category

IT&S

Experience level

Intermediate

Relocation available

This role is eligible for relocation within country

Job type

Professionals

Travel required

No travel is expected with this role

Job code

RQ116393

Job category

IT&S

Job type

Professionals

Experience level

Intermediate

Travel required

No travel is expected with this role

Relocation available

This role is eligible for relocation within country

Job code

RQ116393

Job Description

Entity: Technology

Job Family Group: IT&S Group

Job Description:

Let me tell you about the role

Our data engineers build and run the data pipelines and platforms that bp pulse relies on every day. The team builds on Databricks and AWS.

As a Data Engineer, you will build and maintain data pipelines, help keep our data accurate and well-governed, and work closely with senior engineers who will support your growth. It's a hands-on role with plenty of room to develop a great fit if you have solid fundamentals and want to deepen your skills on a modern data stack.

What you will deliver

• Build and maintain reliable, scalable data pipelines on Databricks and AWS.
• Implement data ingestion, validation and transformation.
• Write well-tested software to build, integrate and quality-assure data across bp pulse, meeting privacy and compliance needs.
• Follow good engineering and data practice: technical design, testing, code review, source control, documentation, data modelling and observability.
• Help build and improve CI/CD pipelines and infrastructure as code.
• Run data quality checks to keep data accurate and reliable.
• Help keep pipelines and services healthy monitoring, alerting and business-hours support.
• Work with senior engineers and people across the business to turn needs into dependable data products.

What you will need to be successful

Essential

• Hands-on experience building and maintaining reliable, scalable data pipelines and data products, often alongside more senior engineers.
• Experience with Databricks, PySpark, Spark SQL and Delta Lake (or a similar lakehouse platform, with a real appetite to grow on Databricks).
• Experience with AWS data and serverless services (e.g. Lambda, Glue, S3, Kinesis, SNS/SQS).
• Good Python and SQL skills.
• An understanding of data modelling and data quality fundamentals.
• Some experience with CI/CD and infrastructure as code.
• Strong verbal and written communication skills.
• A curious, continuous-improvement mindset.
• A degree in computer science or a related field, or equivalent knowledge and experience.

Desired

• Experience with dbt or Apache Airflow.
• Familiarity with data quality tools such as Great Expectations.
• Familiarity with open table formats such as Delta, Apache Hudi or Apache Iceberg.
• Experience with Terraform or another infrastructure-as-code tool.
• No prior experience in the energy industry needed.

What we offer

In return, bp offers a competitive salary and bonus, a strong pension, private healthcare, flexible working and real support for your learning and career growth. [P&C to confirm country-specific benefits.]

About bp

Our purpose is to deliver energy to the world, today and tomorrow. For over 100 years, bp has focused on discovering, developing and producing oil and gas in the nations where we operate. We are one of the few companies globally that can provide governments and customers with an integrated energy offering. Delivering our strategy sustainably is fundamental to achieving our ambition to be a net zero company by 2050 or sooner!

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Travel Requirement No travel is expected with this role

Relocation Assistance: This role is eligible for relocation within country

Remote Type: This position is a hybrid of office/remote working

Skills

• Agility core practices, Agility core practices, API and platform design, Cloud Platforms, Collaboration, Communication, Configuration management and release, Continuous deployment and release, Creating a high performing team, Digital Project Management, Documentation and knowledge sharing, Emerging technology monitoring, Facilitation, Information Security, Mentoring, Metrics definition and instrumentation, NoSql data modelling, Problem Solving, Relational Data Modeling, Risk Management, Scripting, Secure development, Service operations and resiliency, Software Design and Development, Solution Architecture {+ 6 more}
• .

Legal Disclaimer:

• We are an equal opportunity employer. We do not discriminate on the basis of protected characteristics like race, religion, color, sex, national origin, sexual orientation, veteran status or disability status. Individuals with an accessibility need may request an adjustment/accommodation related to bp’s recruiting process (e.g., accessing the job application, completing required assessments, participating in telephone screenings or interviews, etc.). If you would like to request an adjustment/accommodation related to the recruitment process, please contact us.

• If you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.

• Expand job description

• Apply

• Facebook

• Linkedin

• Twitter

• Instagram

• Email

• Copy Link

• Full time

• RQ116393

• Data Engineer

• India | Pune, India

• Save Job

• You have successfully copied the job URL to clipboard!

• Similar jobs

• Full time

• RQ116743

• Enterprise Technology Engineer

• India | Pune, India

• 2 days ago

• Save Job

• Full time

• RQ116229

• Senior Data Engineer

• India | Pune, India

• 2 days ago

• Save Job

• Full time

• RQ116240

• Data Engineer

• India | Pune, India

• 2 days ago

• Save Job

• Full time

• RQ116238

• Senior Data Engineer

• India | Pune, India

• 2 days ago

• Save Job

• Full time

• RQ114225

• Hardware Security and Connectivity Engineer

• India | Pune, India

• 2 days ago

• Save Job

• Explore more jobs

• Rewards and benefits

• With ongoing learning and development, your reward goes far beyond the financial.

• Global

• Global

• Australia

• Hungary

• India

• Malaysia

• UK

• Financial wellbeing

• Our innovative Energize recognition points programme and spot awards translate exceptional performance into tangible rewards, to motivate our high performers.

• Pay

• bp offers competitive pay in line with industry standards, making us an employer of choice.

• Discretionary bonus

• We offer discretionary bonuses to reward strong company, business unit and individual performance, and recognition awards, including those related to long service to recognize commitment to the company.

• Retirement & savings

• We offer a range of discretionary retirement and savings plans to help provide you and your family with financial security.

• Insurance benefits

• To give you additional peace of mind, bp provides valuable insurance benefits in some countries. These are designed to provide financial assistance to employees and their families if employees become unwell or die in service.

• Equity

• Depending on your location and job level, there may be equity (stock and share) options you are eligible to join so you can be part of bp’s success.

• Community & growth

• Unlock a distinct development experience with ‘grow@bp’, a comprehensive online platform offering accessible learning opportunities for every bp employee at their fingertips 24/7.

• Learning & development

• bp is a learning organization. Whether you’re looking to reskill, upskill or build the skills you already have, we can help you with the support and resources you need, including mentoring, ‘Growth Week’, getAbstract and LinkedIn Learning.

• Business resource groups (BRGs)

• Our employee-led BRGs – including working families, social mobility and women's network – are communities where we embrace different ideas and perspectives and treat each other with care and respect.

• Volunteer days

• Caring for others is at the heart of who we are at bp and employees can give back to their communities where we operate by engaging in volunteer activities.

• Work-life balance

• bp's hybrid working approach gives employees the opportunit