Data Engineer, Specialist

Vanguard Job Opportunity

Data Engineer, Specialist

Location(s) Hyderabad, Telangana, IN

Work model Hybrid

Date posted October 5, 2026

Job requisition 178342

Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset on a variety of internal and external data.

Responsibilities

• Build and operate production data pipelines on AWS — Glue (PySpark), Step Functions, Lambda, Athena, SNS, and S3 — from ingestion through transformation to reconciled, reportable output.

• Own operational support for production data pipelines, including monitoring, incident management, PagerDuty response, root cause analysis, and driving timely resolution of production issues while continuously improving platform reliability and observability.

• Develop and refactor transformation logic in PySpark, including migrating legacy Pandas/SQL logic and performance-tuning large-scale Spark jobs.

• Implement data reconciliation and sign-off — design recon checks (including parity between old and new implementations), investigate discrepancies to root cause, and produce the evidence the business needs to trust a run.

• Translate complex business and financial logic (asset classification, valuation and pricing rules, methodology calculations) into correct, testable, well-documented code.

• Take features through production readiness — pre-checks, access/role setup, environment promotion, and clear runbooks for ongoing support.

• Contribute to our cloud lakehouse migration — modelling refined tables, building repeatable ETL, and lifting reporting workloads onto a modern Delta/Databricks platform.

• Keep running pipelines healthy — monitor scheduled jobs, triage failures (partitioning, schema/data-type issues, backfills), and keep periodic (month-end / quarter-end) processing on time.

• What we're looking for

• Must have

• 5+ years in data engineering with strong Python and SQL.

• Hands-on PySpark / Spark for large-scale data transformation, including debugging and performance tuning.

• Production experience with AWS data services — Glue, Athena, S3, Lambda, Step Functions (or close equivalents on another major cloud).

• Solid data modelling skills and a rigorous, reconciliation-first approach to data quality.

• Ability to read a business or technical specification and turn it into correct, maintainable pipeline logic.

• Comfortable with Git-based workflows, CI/CD, and infrastructure-as-code.

• Nice to have

• Databricks / lakehouse (Delta Lake) experience.

• Background in financial services — custody, fund accounting, unit pricing, or regulatory/financial reporting.

• Experience with access governance and IAM (e.g. role provisioning) and writing operational runbooks.

• Track record migrating legacy reporting or ETL onto modern cloud data platforms.

Location

This role is based in Hyderabad, Telangana at Vanguard India. Only qualified external applicants will be considered.

Our mission

Vanguard adheres to a simple purpose: To take a stand for all investors, to treat them fairly, and to give them the best chance for investment success.

Our commitment to you

Vanguard takes the same long-term view of your success—at work and in life—with Benefits and Rewards packages that reflect what you care about, throughout all the phases and stages of your life. Our Total Rewards programs provide you and your loved ones with wellness support for key areas in your life:

Financial wellness We're committed to enabling your financial success and provide competitive offers and programs.

Physical wellness We're committed to providing benefits that support your physical health and wellness.

Personal wellness We're committed to providing resources that help support the full scope of your life.

How we work

Vanguard has implemented a hybrid working model for most of our employees (crew members), designed to capture the benefits of enhanced flexibility while enabling in-person learning, collaboration, and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long-term client outcomes and enrich the employee experience.

Learn more about our complete benefits and rewards package

Our commitment to equal employment opportunity

Vanguard is an equal opportunity employer. Vanguard is committed to providing all crew members a working environment that is free from discrimination, prejudice and bias. Through this Equal Employment Opportunity (EEO) Policy, Vanguard reaffirms its commitment to equal employment opportunity for all applicants and crew members without regard to race, color, national origin or ancestry, religion, gender, sex, sexual orientation, gender identity or expression, age, disability, marital status, veteran or military status. In addition, Vanguard prohibits discrimination based on genetic information, as well as any other characteristic protected by federal, state or local law.

Applicants with disabilities may be entitled to reasonable accommodation under the Americans with Disabilities Act and certain state or local laws. A reasonable accommodation is a change in the way things are normally done which will ensure an equal employment opportunity without imposing undue hardship on Vanguard. Please inform Careers at Vanguard if you need assistance completing this application or to otherwise participate in the application process.