Research Scientist Intern - Neural Representations Compression

Research Scientist Intern - Neural Representations Compression

In the rapidly evolving fields of AI, Augmented Reality (AR), and Virtual Reality (VR), industry compression research is shifting from human-consumed media to non-human-consumed internal neural model states. These representations include latent tensors, weights, Gaussian splats, feature maps, and depth/alpha buffers exchanged between neural networks. As high-capability models exceed on-device compute limits while cloud execution is constrained by latency, privacy, and power, systems are adopting split inference—partitioning model execution between devices and datacenters connected by neural bitstreams. In this architecture, the compression ratio on the split link serves as a primary determinant of round-trip latency, bandwidth efficiency, and battery performance.

Advancing compression techniques for neural representations expands beyond rendering outputs to critical non-media data streams. Key emergent areas include Feature Coding for Machines (FCM) for intermediate network features, visual and multimodal token pruning/compression, low-latency action and control streams for embodied systems, KV cache compression for distributed LLM prefill and decode stages, model deltas for on-device personalization, and persistent scene state streams for interactive world models. Establishing specialized compression capabilities across these representations directly impacts the operating efficiency and scalability of split-inference AI and XR applications.

The intern will explore several key directions in compression and streaming techniques for neural representations:

1. Latent Vector Compression: Developing efficient quantization, entropy coding, and learned prior models for compact, high-dimensional latent spaces exchanged in split-inference architectures.
2. Gaussian Splat Compression: Creating specialized compression and streaming algorithms that maintain the spatial distribution, opacity, and color parameters of 3D Gaussian splats with high rendering fidelity and low memory footprint.

Throughout the project, the intern will conduct a thorough review of existing literature, implement prototype models, and benchmark them against traditional compression methods. The final goal is to develop a neural compression framework that outperforms current techniques in terms of compression ratio, speed, and fidelity.

This research not only contributes to the academic field but also has direct applications in improving the operational efficiency of AR/VR systems, ultimately pushing the boundaries of what is possible in digital interaction spaces.

Research Scientist Intern - Neural Representations Compression Responsibilities

• Explore issues involved in processing, compressing and streaming neural and/or learned representations.
• Identify, with assistance of the mentor(s), opportunities for significantly improving compression efficiency and/or quality.
• Work with peers to build a working prototype of the proposed algorithm.
• Communicate ongoing research progress and final results.

Minimum Qualifications

• Currently has, or is in the process of obtaining, a PhD degree in the field of Image and Video Processing, Signal Processing, Information Theory, Machine Learning, Computer Graphics, or related field
• Coding experience in C/C++ and/or Python
• Experience in image and video processing
• Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as ICIP, DCC (Data Compression Conference), CVPR, IEEE Transactions or Letters, ACM SIGGRAPH, etc

Preferred Qualifications

• Intent to return to a degree-program after the completion of the internship/co-op
• Knowledgeable about applications related to neural networks and compression
• Knowledgeable about existing image and video codec standards (H.26x, VPx, JPEG, etc)
• Knowledgeable about existing Point Cloud compression standards (MPEG PCC)
• Knowledgeable about Learning-based compression

About Meta

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.

For those who live in or expect to work from California if hired for this position, please click here for additional information.

United States of America: $7,650/month to $12,667/month + benefits Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.

Equal Employment Opportunity

Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.

Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.

Apply for this job Take the first step toward a rewarding career at Meta.

Apply now

APPLY NOW

Find your role

Explore jobs that match your skills and experience. Search by technology, team or location to find an opening that’s right for you.

View jobs

Meta AI

Recruiters can view your conversations with AI. Using AI is optional and does not impact the outcome of your application process. Learn more about AI usage and settings.

Sign up

to ask follow-up questions