4 comments

  • exceptione an hour ago

    So what figure exactly is tested for 10k+? Is it 12k, 100k or more like 1m? I couldn't find.

      zazuke 41 minutes ago

      The "exact" tests were made with 12k notes in my test vault and 10k in my personal vault. I haven't tested for 100k, but it would be interesting, do you have a vault or example of such a vault?

        exceptione 21 minutes ago

        I know people hit the 10K really fast. 10K is the limit for which obsidian switches algorithms (personally, I don't understand how 10K db rows would be a problem, but ok). It is very easy to run into 100k:

        - external sources like the documentation for your programming languages, frameworks etc that come as markdown

        - if you store every entity as a note, like you do with obsidian bases. Think task tracking, habit trackers, book collections

        - clippings, daily notes, project notes, zettels etc

        So if I would design a search improvement, I would test the 100k, 200k, 500k, 1m mark with synthetic data.

      zazuke an hour ago

      it should be doing fine on any size, but I noticed OmniSearch hits limits around 10k notes for me, you could also use it way before and way over. But I guess if you have fewer than 4k, you might not need sophisticated search, except if you enjoy the added features such as preview and searching by title, headers, and semantics.