Data Platform Engineer

About the Role Crux is seeking a Data Platform Engineer to help customers go live quickly by onboarding data sources and building reliable, self-healing pipelines using AI-driven tooling. You will enable onboarding from natural language prompts across websites, PDFs, and other sources, and ensure pipelines recover from source changes with minimal downtime. What You'll Do

• Onboard data sources in hours using natural language prompts to extract data from websites, PDFs, and other formats.
• Build reusable pipelines that can be scheduled and delivered to destinations like Snowflake, Databricks, BigQuery, S3.
• Implement auto-healing and self-healing rules to adapt to schema drift and upstream changes, significantly increasing uptime.
• Implement execution + detection features, automatic issue detection, and in-app as well as email notifications.
• Enforce quality standards using deterministic data quality assertions to ensure correctness.
• Monitor, diagnose, and repair data flows within a policy-governed, AI-driven framework to maintain compliance.
• Collaborate with customers and product to iterate connectors and transformations toward the user’s desired data format. What We're Looking For
• Experience designing and implementing data integration pipelines and ETL processes.
• Familiarity with organizing data from diverse sources (web scraping, PDFs, APIs) and transforming into standard formats.
• Comfort with AI-driven data workflows and natural language prompts for data extraction.
• Ability to diagnose schema drift and upstream changes, and rewrite connectors quickly.
• Knowledge of data quality validation and monitoring; experience with Snowflake, BigQuery, Databricks, or S3 is a plus.
• Strong problem-solving, communication, and documentation skills. Nice to Have
• Experience with zero-trust security and enterprise-grade compliance.
• Experience with self-healing AI-driven data pipelines.
• Familiarity with governance, lineage, and auditing requirements. Compensation & Benefits
• Trial with free compute credits: 10M credits available (AI tokens, compute, and storage credits breakdown provided upon signup).
• Pro Extended Access: $100/month includes up to 20M credits per month across AI tokens, compute hours, and storage.
• Enterprise/Teams: Custom pricing; discuss options with an expert.