It isn't actually the same, though - they don't support streaming. How are you getting around this?
ahyatt
joined 1 year ago
I've now added this to the llm
package. Although I have to say it's not nearly as complete as Ollama is. In particular, it lacks embedding functionality and streaming.
I think you are right, at least for problems of configuring multiple packages together. I think there may be another useful way to organize configs, but I haven’t come up with anything yet. For now use-package is pretty optimal.