Shared Spatial Memory for Project Teams

OnSight is a mobile AR tool that helps teams on physical job sites document and share visual context by pinning photos directly in space. Inspired by real construction workflows, it offers a simple, low-friction alternative to spreadsheets or high-end BIM systems. Built in Unity after rapid prototyping, OnSight has drawn strong feedback and revealed broader potential for use in maintenance, facilities, and beyond.

My role involved ideation, conducting user research, UX/UI design, and building the experience in Unity.
Tools
User Interviews, UX/UI Design, Figma, Adobe Aero, Polycam, Unity
Timeline
4 days, 2024

Catch began as an online payment method.

Catch rewards shoppers for using ACH or debit at checkout. Merchants save on credit card fees and offer store credit to boost loyalty, while shoppers earn high rewards (typically 10%) without the drawbacks of credit.
Description
Description

Adding new brands required checkout integration.

By 2024, we had integrated with around 70 merchants, but growth was limited by the need for merchant integration. Potential partner brands had scarce resources for integration, and due to our small network, we didn't yet have the traffic to demonstrate short term value — a real chicken-and-egg situation.

Meeting Workers Where They Are

Despite hesitation around adopting new tech, one behavior stood out: workers were already using their phones to take and share progress photos. We saw an opportunity to build something familiar, fast, and spatial—without asking users to overhaul their workflows.
A builder documents his progress.

A Lightweight AR Tool for Visual Site Memory

We created OnSight, a simple augmented reality documentation tool for teams working on physical job sites. The mobile app allows users to place photos directly in physical space, creating a shared visual memory of progress, notes, or context—right where it’s needed.
A manager reviews what has changed.

Informed by Real Construction Site Habits

The idea came from interviews with engineers, architects, and builders, where we found that project changes are constant and historical context is critical. While high-end tools exist, most teams rely on DIY methods like spreadsheets, group texts, or even colored tape to track progress.

How It Works in the Field

OnSight bridges the gap between complex BIM systems and informal tracking methods. Users simply open the app, tap to take a photo, and it’s automatically pinned in AR to that physical location. Anyone else on the team can then see it in the same spot, offering instant, location-specific insight.
Snapping and pinning photos with a tap.
Viewing photos left by teammates.

Prototyping from Paper to AR

We used Adobe Aero and Polycam for early prototyping, then built the app in Unity. Learning these tools helped us quickly validate the interaction and explore what’s feasible in today’s spatial computing ecosystem.
We used 3D cubes to make sure we could get positioning and direction working correctly with raycasting.
Next, we replaced the cubes with photo captures (with a little help from our friend Leo here).

Feedback from the Pros

An issue came up in the field yesterday that the app would have been perfect for! Maintenance folks and even the building users (especially in highly technical spaces like labs, R&D facilities, manufacturing) are always trying to locate sensors, valves, etc, that are hidden. The current way they store their location is spreadsheets and tribal knowledge
Robert Richmond
Construction Project Manager
I think you guys are on the right track! You guys asked many good and right questions.  I look forward to seeing the final product!
Yisi Liu

Landscape Architect

Whoa, that is so cool! I think this would be super useful. Keep me in the loop as you develop it!!
Catalina Pagnotta

Architect and Real Estate Agent

It seems like that would be a good complement to something like a VR BIM!  I think you might want to think about the market. Residential construction is usually pretty cheap, I think it would difficult to find a market with buy-in, but this type of thing is definitely growing in things like industrial construction on really complicated projects.
Andrew Rodgers
Senior Construction Engineer