Where Your AI Notes Live Is Part of the Product

When I think about AI notes, storage is not an implementation detail. Local files, local models and cloud models create different product trade-offs.

·

2–3 minutes

·

Black-and-white hand-drawn illustration of a child beside a laptop with a local files folder and lock, representing choice and control over where AI learning notes are stored.

When an AI notes tool produces a good summary, it is easy to stop at the output.

While building ScribeShot, I keep coming back to another question:

Where do the notes, screenshots and conversations actually live?

That sounds like an implementation detail.

I think it is a product decision.

A note-taking app is also a data system

ScribeShot can hold more than summaries.

It can contain screenshots, questions, transcripts, study notes and a record of what I chose to save from a video.

Once a tool collects that much context, “does the AI work well?” is only one part of the design.

I also care about whether the user can understand what is stored, where it is stored and what leaves the machine when AI processes it.

Local AI changes the trade-off, not the need to think about it

ScribeShot can be configured to use a local AI model on the Mac or a cloud provider such as OpenAI.

ScribeShot configuration screen showing the choice between a cloud AI provider and a local LLM, with a local Gemma model selected.

I like having that choice because the trade-off is real.

A local model can reduce how much material needs to leave the computer. A cloud model can offer different capabilities and convenience.

Neither option should be treated as magic.

The important part is making the decision visible enough that the person using the product can choose deliberately.

Boring local folders can be a feature

One of the least glamorous parts of ScribeShot is also one of the parts I value most.

The notes and related files can live in ordinary folders on the computer.

macOS Finder screenshot showing local folders created for ScribeShot video notes, representing that the files are stored on the computer.

That means the learning record is not useful only inside one interface.

Tools change. Apps disappear. Workflows move.

If the underlying material is understandable and portable, changing tools later becomes much easier.

I think of this as boring portability. It is not impressive in a demo, but it matters after the demo.

Local does not automatically mean private

There is a tempting oversimplification here:

Local = safe. Cloud = unsafe.

Reality is messier.

A computer can be shared. Files can be backed up. A cloud model can still be enabled. The source material may already come from an online service.

So I prefer practical questions over labels:

  • What information does the tool store?
  • Where is it stored?
  • When does information leave the device?
  • Can I move or delete the files later?
  • Which parts of the workflow depend on a cloud service?

The implementation becomes part of the interface

Most users should not need to become security engineers to use a note-taking app.

But important data choices should not be buried so deeply that they are impossible to reason about.

This has become one of my design constraints for ScribeShot:

A useful AI product should make the important data trade-offs understandable.

The quality of the summary still matters.

So does what happens to everything around it.

Written by Rakesh Kalra, a software engineer with 20+ years of experience who still prefers building things. ThinkBySketch is where I share small tools, experiments and lessons from trying to make work and learning simpler. About ThinkBySketch →

One useful experiment at a time

Get the next thing I’m trying.

Small tools, systems and ideas for building, learning and working better, including the experiments that do not work.

After subscribing, check your inbox and click the confirmation link.