Manager, Data Storage Platforms

Job title: Manager, Data Storage Platforms

Responsibilities

• Lead and mentor a team of data platform engineers

• Accountable for strategic planning and technical roadmap development for data platforms

• Oversee the design, implementation, and maintenance of data engineering pipelines in a multi-cloud environment, including integrations with a variety of data sources (structured, semi-structured, and unstructured data)

• Collaborate with the Domain Data Product Delivery teams and other stakeholders in Architecture, Data Integration, DevOps, and Data Governance to deliver data platform initiatives

• Ensure data engineering standards align with industry best practices for data governance, data quality, and data security

• Monitor and optimize the performance of data pipelines, ensuring they meet SLAs for data availability and quality

• Evaluate and recommend new data technologies and tools to improve data engineering processes and outcomes, in collaboration with the Domain Data Product Delivery teams

• Effectively communicate and realize vision and strategy for the organization that aligns with the business and patient needs

• Embrace and embed agile ways of working in support of a fail-fast-learn-fast culture and enabling continual improvement

• Foster a collaborative work environment with strong working relationships within and across businesses and functions, and with strategic external partners

• Manage datasets using Apache Hudi (version 0.11.x and higher), focusing on supporting near real-time data processing and incremental data loading utilizing cutting-edge features for more efficient data lake management and complex data transformation pipelines

• Implement the latest versions of Terraform (0.12.x and higher) to efficiently handle infrastructure changes and versioning with enhanced security and flexibility

• Key Experiences & Attributes

• Bachelor’s degree or higher in computer science or relevant subject area

• Minimum 5+ years of progressive technical experience in one or more of the cloud-based data warehouse/data lake platforms such as AWS S3, Snowflake, Databricks, Microsoft Synapse

• Significant experience in leading teams in Data & Analytics programs with experience in native digital technologies (cloud, big data and predictive) in organizations driving product development

• Change Agent – Catalyst for the teams and expected to lead the transformation to a fail-fast-learn-fast culture enabling continual improvement

• Servant Leader – Able to gain respect from their team and willing to get their hands dirty to get the job done

• Courageous - Able to effectively challenge and influence peers and teams, leading them through difficult or uncertain situations

• Significant experience working in a global matrix environment

• Must be a strategic, innovative problem solver, and have strong influencing and communication skills

• Strong knowledge of business process flow and/or entity relationship modeling

• Demonstrated outstanding written and verbal communication skills. Ability to work effectively with other technology teams as well as business partners. Ability to effectively present information, interact with, and respond to questions from managers, employees, customers, and vendors

• Experience in applying best practices to ELT/ETL data transformation from variety of data sources to AWS and other data warehouse platforms like Snowflake, Databricks, Microsoft Synapse etc.

• Required Technical Skills

• AWS CDK (TypeScript/Python)

• AWS Glue (ETL, Catalog, Crawlers, Job Bookmarks)

• AWS Lambda, API Gateway, SQS, SNS, Step Functions, EventBridge

• Amazon Kinesis, Route 53, S3 (events, triggers)

• Terraform (0.12+)

• Apache Hudi (0.11+) and CDC methodologies

• AWS DMS

• Apache Spark (2.4+) and PySpark

• Amazon EMR (5.x+)

• Python (3.6+) for automation and pipeline development

• IBM DataStage (for supplemental ETL workflows)

• Snowflake, Databricks, Microsoft Synapse

• Reasonable Accommodation

• Vantive is committed to working with and providing reasonable accommodations to individuals with disabilities globally. If, because of a medical condition or disability, you need a reasonable accommodation for any part of the application or interview process, please click on the link here and let us know the nature of your request along with your contact information. Form Link

• Recruitment Fraud Notice

• Vantive has discovered incidents of employment scams, where fraudulent parties pose as Vantive employees, recruiters, or other agents, and engage with online job seekers in an attempt to steal personal and/or financial information. To learn how you can protect yourself, review our Recruitment Fraud Notice.