Hi everyone,
I made an open-source Python toolkit/library, named Cogitator, to make it easier to try and use different chain-of-thought (CoT) reasoning methods. The project is at the beta stage, but it supports using models provided by OpenAI and Ollama. It includes implementations for Cot strategies and frameworks like Self-Consistency, Tree of Thoughts, and Graph of Thoughts.
GitHub link of the project: https://github.com/habedi/cogitator
Dumb jokes aside, I took a look at your GitHub page, and this is exactly what I've been looking for when I do local LLM work. Cogitator seems like a nice, pythonic approach vs. using the raw `ollama run` command, esp. given the focus on chain of thought. I think I'll start using this tool. Nice work!
This technology is not heretical, praise the Omnissiah!
I might add support for other model providers (like Google and Azure) in the future. Although I'm trying to keep the scope of the project very small because it's easier for me to maintain it.
Anyway, I think adding new LLM providers is pretty straightforward if you want to do it yourself. You just need to implement the API of the BaseLLM (see the `cogitator/model/base.py` file) for your provider. After that, you just use it like how you use OllamaLLM or OpenAILLM.
Great work
Also, are you using this tool as part of another project? It’d be interesting to see what the main applications of CoT prompting are (the examples are great but a little basic)