Local LLM Thesaurus
It’s always more fun to work on something other than what I should explicitly be doing in the moment, so ideas and small projects naturally arise from procrastination. I was having trouble returning to my NaNoWriMo work after my sisters visited last weekend, and I took fifteen minutes to learn how to locally run an LLM. My ninety percent use-case for LLMs is word refinement. While writing I will get a word stuck in my head, the wrong word for the exact feeling I’d like to describe. So, I tell some LLM (often Claude) to provide several more synonyms with varying connotations. This doesn’t rely on having up-to-date knowledge or internet access, so a nimble, offline, and local LLM would fit the task perfectly. ...