Ruby.social

2 posts2 participants0 posts today

PhilAnd just a day later, here's a git repo with more philosophy than good code. I think the philosophy part is more important personally, the code we can fix later. <a href="https://git.bajsicki.com/phil/gptel-org-tools" rel="nofollow noopener noreferrer" target="_blank">https://git.bajsicki.com/phil/gptel-org-tools</a> TL;DR: Emacs (and its ecosystem) makes the whole vectorization/ RAG/ training stuff entirely redundant for this application. Yes, this code fails still... a bunch, especially given the current lack of guardrails. But the improvement I've seen in the last few days makes me cautiously believe that with enough safeguards and a motivating enough system prompt, an active assistant may be possible. Image attached isn't nearly as good as I've seen, but it's an off-hand example that demonstrates it working. The only thing missing for me to be happy with this is one of those organic, grass-fed LLM models whose existence isn't predicated on theft. <a href="https://fed.bajsicki.com/tags/emacs" rel="nofollow noopener noreferrer" target="_blank">#emacs</a> <a href="https://fed.bajsicki.com/tags/orgmode" rel="nofollow noopener noreferrer" target="_blank">#orgmode</a> <a href="https://fed.bajsicki.com/tags/gptel" rel="nofollow noopener noreferrer" target="_blank">#gptel</a> <a href="https://fed.bajsicki.com/tags/orgql" rel="nofollow noopener noreferrer" target="_blank">#orgql</a> RE: <a href="https://fed.bajsicki.com/notes/a6jw3n155z" rel="nofollow noopener noreferrer" target="_blank">https://fed.bajsicki.com/notes/a6jw3n155z</a>

PhilSo... I strongly disagree with LLMs (mostly with the marketing and the training data issue), but I found a use-case for myself that they may actually be 'alright' at. I organize my life in <a href="https://fed.bajsicki.com/tags/Emacs" rel="nofollow noopener noreferrer" target="_blank">#Emacs</a> <a href="https://fed.bajsicki.com/tags/orgmode" rel="nofollow noopener noreferrer" target="_blank">#orgmode</a> It's great. But over the years, my notes and journals and everything have become so large, that I don't really have a grasp of all the bits and pieces that I have logged. So I started using org-ql recently, which works great for a lot of cases, but not all. Naturally, I wanted more consolidation between the results, and better filtering, as well as a more general, broad view of the topics I wanted to look up in my notes. So I started writing some tooling for <a href="https://fed.bajsicki.com/tags/gptel" rel="nofollow noopener noreferrer" target="_blank">#gptel</a>, to allow LLMs to call tools within Emacs, and leverage existing packages to do just that. It's in its inception, and works only 20-25% of the time (because the LLM needs to write the queries in the first place), but it works reasonably well even with smaller models (Mistral Small 24B seems to do alright with 16k context, using llama.cpp). In general: - It kinda works, when it wants to. - The main failure point at the moment is that the LLM isn't able to consistently produce proper syntax for org-ql queries. - The context window sucks, because I have years of journals and some queries unexpectedly explode, leading to the model going stupid. So far it's been able to: - retrieve journal entries - summarize them - provide insights on habits (e.g. exercise, sleep quality, eating times) - track specific people across my journal and summarize interactions, sentiment, important events It doesn't sound like a lot, but these are things which would take me more time to do in the next year than I already spent on setting this up. And I don't need to do anything to my existing notes. It just reads from them as they are, no RAG, no preprocessing, no fuss. At the same time, this is only part of my plan. Next: 1. Add proper org-agenda searches (such that the LLM can access information about tasks done/ planned) 2. Add e-mail access (via mu4e, so it can find all my emails from people/ businesses and add them as context to my questions) 3. Add org-roam searches (to add more specific context to questions - currently I'm basing this entire project around my journal, which isn't ideal) 4. Build tooling for updating information about people in my people.org file (currently I do this manually and while there's a bunch of stuff, I would love if it was more up to date with my journal, as an additional context resource) For now, this is neat, and I think there's potential in this as a private, self-hosted personal assistant. Not ideal, not smart by any means (god it's really really not smart), but with sufficient guardrails, it can speed some of my daily/ weekly tasks up. Considerably. So yeah. I'm actually pretty happy with this, so far. PS. <a href="https://fed.bajsicki.com/tags/orgql" rel="nofollow noopener noreferrer" target="_blank">#orgql</a> because org-ql doesn't show as an existing tag.

Re 420Search other org headings with a link to the current one (Org-ql)<a href="https://github.com/alphapapa/org-ql/discussions/472" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://github.com/alphapapa/org-ql/discussions/472</a><a href="https://tooting.ch/tags/OrgMode" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OrgMode</a> <a href="https://tooting.ch/tags/OrgQl" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OrgQl</a> <a href="https://tooting.ch/tags/Emacs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Emacs</a>

jae<a href="https://mstdn.social/@SrEstegosaurio" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@SrEstegosaurio</a> <a href="https://mstdn.social/@SrEstegosaurio" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@SrEstegosaurio</a> ! I've only used <a href="https://social.vivaldi.net/tags/obsidian" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#obsidian</a> for a day or two, so I don't know much about it. I wonder what Dataview can do better than <a href="https://social.vivaldi.net/tags/orgroam" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#orgroam</a>. I haven't actually queried in <a href="https://social.vivaldi.net/tags/OrgMode" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OrgMode</a> much, but beyond the basic Org search features on <a href="https://social.vivaldi.net/tags/emacs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#emacs</a>, there's <a href="https://social.vivaldi.net/tags/OrgQL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OrgQL</a> <a href="https://github.com/alphapapa/org-ql" rel="nofollow noopener noreferrer" target="_blank">https://github.com/alphapapa/org-ql</a> which may or may not fit in your use cases.

Recent searches

Search options

Administered by:

Server stats:

#OrgQL