deepfates

|||

Memery

Memery lets you use human language to search your image collections.

For years I was frustrated every time I tried to find an image on my hard drive: a meme to send to a friend, a photo of an important moment, a screenshot of a relevant quote. No matter how organized your folders, a hierarchical tree just can’t capture all the dimensions of an image collection. And once you’ve found the right folder, your filenames better be easy to remember, or you still have to scan visually through hundreds of images.

This is a pre-computer workflow, sifting through folders of images and recognizing the one you need by eye. Computers make it faster, but they don’t reduce the cognitive friction much.

That’s where Memery comes in.

Under the hood, memery uses the CLIP transformer developed by OpenAIto make image search meaning-full.

You can search for concrete nouns, like bird” or wizard”, or abstract concepts like graph” or love”. You can also search for text found in the image, like the word signal”.

Here’s memery searching for cat” in a dataset of wholesome memes:

memery searching for “cat” in a dataset of wholesome memesmemery searching for “cat” in a dataset of wholesome memes

Memery is also a library that can be included in python applications. For example, here’s the first two results for bird” in this website’s image folder:


from memery.core import queryFlow

birds = queryFlow('../images/', 'bird')

birds[:2]

1020it [00:00, 74742.57it/s]
1020it [00:00, 28044.88it/s]
  0%|          | 0/1 [00:00<?, ?it/s]

starting timer
Checking files
Indexing
Loaded 996 encodings
Encoding 6 new images

100%|██████████| 1/1 [00:00<00:00,  6.17it/s]

Building treemap
Saving 1001 encodings
Converting query
Searching 1001 images
Done in 5.060962200164795 seconds

['../images/E84wm5UWEAAr5ie.png', '../images/images/E84wm5UWEAAr5ie.png']

 

Memery has many other features, including a browser-based GUI and a command-line interface. It’s an open source project, and you can help! Find memery at Github, test it out, file issues and pull requests.

Together we can solve the meme search problem.

Up next Circles I made a dataset of circles. I could not get a GAN to train on them at the time, but I went to all the trouble to align them, so I decided I would Worldview interview My friend Ben Ratkey was interviewing people about their worldviews, and I agreed to participate. idea:1) I write up a list of fundamental but
Latest posts Silicon AI Sparkl Invisible Movies The Mirror of Language Worldview interview Memery Circles Language Arts series Language Arts 1.0 Language Arts 0.3 Language Arts 0.2 Language Arts 0.1 The Big Sleep Signal GAN Autocomplete everywhere Learning loops Seasons change Berduck Book Cover Generator See and Point New social gestures Digital gardens Zones of the mind Legiblate Where the humans end Accelerating succession Gardening algorithms The law of the instrument A cybernetic meadow Robot Face Smooth Spaces