Will check it out

I've released the v 1.0.0 with a bunch of improvements + a signed app. It's the first time I've done this, so still working out exactly what's required: https://github.com/dragthelake/ambient-context or ambientcontext.app

Update: I've added a prompt to process the raw output into something more useful: https://github.com/dragthelake/ambient-context/blob/main/doc...

This is pretty magical tbh

Also added MIT license and added some more pruning to reduce initial capture by around 10%.

Oh interesting, I'll check it out

Appshots is fine for what it is, but not great for building ambient context about your daily usage/work.

But we can clean that extracted text from Appshots.

UPDATE: As i just checked it is also using Accessibility API. So i guess we will have access to the same set to data.

So the markdown is scaffolding the app generates deterministically.

The ## heading is built from the block's timestamps, the app name and the window title. The frontmatter is per-day boilerplate. The file:/url: line is the window's backing document where the app exposes one. The captured text underneath is written exactly as the tree handed it over: plain lines, no reconstruction.

That lossiness is also why the file/URL references exist. Trying to rebuild a document's formatting from its accessibility tree is a losing game, so instead each block records where the real document lives, and the LLM reading the file can open the original if the fragments aren't enough. "Plain markdown" was meant as "a markdown file you can open anywhere", not "faithful markdown conversion of what you saw"

One app that's using this technique (not exactly sure if it's the same) is Littlebird: https://littlebird.ai/

I also saw that HeyClicky started doing something similar but end up removing from the product.

Because you then have the macOS orange screen sharing warning/icon. I don't really want to record my screen, just the text is enough.

Agree

Yeah don't get your hope up too much. I need to push through more cleaning up of what's captured. Let me know how it goes, keen for some feedback

My son gets too distracted by any screen (we have had to implement a total screen ban), so screen-based learning doesn't work after a few days. Is there a way to create an analogue paper version? ie with printer and scanner.