About this role
Software Engineer – Data Infrastructure
Full time
Apply to Job
New York, New York | Onsite
1 - 8 Years of Experience
Apply to Job
Share this job
Who is Recruiting from Scratch:
Recruiting from Scratch is a premier talent firm that focuses on placing the best product managers, software, and hardware talent at innovative companies. Our team is 100% remote and we work with teams across the United States to help them hire.
Software Engineer – Data Infrastructure
Location
New York, NY
Fully on-site, five days per week.
Company Stage of Funding
Early-stage startup
Founded: 2025
Total Funding: $2M
Team Size: Approximately 4 people across engineering and design.
Office Type
Fully on-site in New York City, five days per week. This is a small founding team environment with lightweight processes, occasional planning sessions, and substantial independent coding time.
Salary
$165,000–$290,000 base salary, depending on experience.
Equity
Competitive equity compensation.
Visa
Candidates must have valid US work authorization. New visa sponsorship is not available. Visa transfers may potentially be considered for exceptional candidates.
Employment Type
Full-time
Company Description
This company is building a modern data infrastructure platform for alternative investment managers, including private equity firms, hedge funds, and other asset managers. As private markets continue to grow, investment firms need better ways to consolidate information from fragmented systems, spreadsheets, financial records, documents, and third-party tools.
The platform ingests data from disparate sources and transforms it into structured, typed, and related records with permissions and full data lineage. It also provisions and manages dedicated AWS infrastructure for customers, providing a governed data foundation on which applications and AI-powered workflows can operate.
The product is designed to replace spreadsheets and legacy investment operations tools with modern, scalable infrastructure. It brings sophisticated data capabilities traditionally associated with large financial institutions to a broader market of private investment managers.
The company has raised approximately $2M and is backed by investors including Primary Ventures, Inverted Capital, and industry leaders with experience at major investment firms and financial data companies. The founding team brings expertise from fintech, investing, Microsoft, Goldman Sachs, and high-growth startups.
The platform is AI-native, using LLMs across data extraction, transformation, and structuring workflows. The company also works directly with asset managers and their portfolio companies to establish customized data infrastructure and technical roadmaps.
The Software Engineer – Data Infrastructure role is designed for engineers who want to build foundational systems from scratch in a very small, high-caliber team. Engineers work across the data infrastructure stack, own projects end to end, and contribute directly to architectural decisions.
The culture emphasizes autonomy, engineering craft, speed, and comfort with ambiguity. Rather than following extensive processes or waiting for detailed instructions, engineers receive broad areas of ownership and are expected to make progress independently over extended periods. The team also uses internal AI tooling and parallel agents to accelerate development.
What You Will Do
- Build Core Data Infrastructure
Design and ship production systems for data ingestion, structured context, and the governed data foundation that applications rely on.
Build infrastructure that consolidates information from documents, spreadsheets, meetings, financial systems, CRMs, and third-party tools.
Transform diverse data formats into structured, typed, and related records.
Develop systems that preserve data lineage, permissions, and relationships across information sources.
Create foundational infrastructure that supports reliable downstream applications and AI-powered workflows.
Make architectural decisions that shape the platform as it evolves.
- Build and Manage Customer-Specific AWS Infrastructure
Design systems that provision and manage full AWS clusters on behalf of customers.
Build infrastructure workflows that support isolated, customer-specific environments.
Automate infrastructure provisioning, configuration, and lifecycle management.
Use AWS and infrastructure-as-code tooling to make deployments repeatable and reliable.
Ensure customer environments support the platform's data, security, and application requirements.
Develop scalable infrastructure patterns that can support additional customers as the business grows.
- Develop Data Ingestion and Transformation Systems
Build pipelines that ingest data from a variety of financial and operational systems.
Design reliable workflows for extracting, transforming, validating, and structuring information.
Work with structured and unstructured data from documents, spreadsheets, ledgers, and third-party applications.
Develop typed data models and relationships that make information usable across the platform.
Implement workflows that preserve data quality, traceability, and access permissions.
Identify opportunities to improve ingestion reliability, processing speed, and maintainability.
- Build AI-Native Data Workflows
Use LLMs extensively throughout the engineering workflow and product development process.
Build infrastructure that supports AI-driven data extraction, transformation, and structuring.
Integrate model-powered workflows into reliable production systems.
Leverage internal AI infrastructure, parallel agents, and containerized development environments to increase engineering velocity.
Explore ways to automate complex data workflows using LLMs.
Ensure AI-powered processing produces structured, traceable, and useful outputs.
- Own Engineering Problems End to End
Take ambiguous technical briefs and turn them into production systems that customers rely on daily.
Own projects from problem definition and architectural design through implementation, deployment, and iteration.
Make progress independently with minimal hand-holding.
Identify technical risks, evaluate trade-offs, and determine practical implementation approaches.
Work through unfamiliar problems without relying on extensive documentation or predefined processes.
Take responsibility for the quality and reliability of the systems you build.
- Shape Green-Field Architecture and Technical Direction
Build new systems and infrastructure rather than working exclusively on established legacy codebases.
Contribute to architecture decisions across the data infrastructure stack.
Evaluate technical approaches and choose solutions that balance speed, reliability, scalability, and maintainability.
Develop reusable patterns and abstractions that support future product capabilities.
Collaborate with the founding team to determine how the platform should evolve.
Help establish engineering practices as the team and product grow.
- Work Across the Full Data Infrastructure Stack
Contribute to backend services, APIs, data pipelines, cloud infrastructure, and supporting application components.
Use Python and FastAPI to build backend services and data workflows.
Work with Temporal, dbt, Terraform, AWS, Docker, and related infrastructure technologies.
Collaborate across the stack rather than being restricted to a narrowly defined engineering function.
Help solve problems that span application code, infrastructure, and data processing.
Build practical solutions that serve real customer requirements.
- Collaborate in a Lean, High-Autonomy Team
Work closely with the founding team and other engineers on high-impact technical problems.
Participate in lightweight standups and occasional planning sessions.
Communicate progress and technical decisions without relying on extensive project management processes.
Seek feedback when useful while maintaining independent ownership.
Contribute to a culture of high standards, strong engineering craft, and continuous improvement.
Help build the company's engineering culture as the team grows.
Ideal Candidate Background
Experience Requirements
Approximately 1–8 years of software engineering experience, with a strong focus on data infrastructure and Python.
The role description also references a target of 1–6 years of experience; prioritize candidates based on demonstrated engineering ability and scope of ownership.
Strong software engineering fundamentals and experience building production systems.
Experience developing backend services, data pipelines, infrastructure, or platform components.
Ability to own projects end to end with limited supervision.
Comfortable working in an ear