🦙 Ollama Haskell
ollama-haskell is an unofficial Haskell client for Ollama, inspired by ollama-python. It enables interaction with locally running LLMs through the Ollama HTTP API — directly from Haskell.
✨ Features
- 💬 Chat with models
- ✍️ Text generation (with streaming)
- ✅ Chat with structured messages and tools
- 🧠 Embeddings
- 🧰 Model management (list, pull, push, show, delete)
- 🗃️ In-memory conversation history
- ⚙️ Configurable timeouts, retries, streaming handlers
⚡ Quick Example
{-# LANGUAGE OverloadedStrings #-}
module Main where
import Data.Ollama.Generate
import qualified Data.Text.IO as T
main :: IO ()
main = do
let ops =
defaultGenerateOps
{ modelName = "gemma3"
, prompt = "What is the meaning of life?"
}
eRes <- generate ops Nothing
case eRes of
Left err -> putStrLn $ "Something went wrong: " ++ show err
Right r -> do
putStr "LLM response: "
T.putStrLn (genResponse r)
📦 Installation
Add to your .cabal file:
build-depends:
base >=4.7 && <5,
ollama-haskell
Or use with stack/nix-shell.
📚 More Examples
See examples/OllamaExamples.hs for:
- Chat with conversation memory
- Structured JSON output
- Embeddings
- Tool/function calling
- Multimodal input
- Streaming and non-streaming variants
🛠 Prerequisite
Make sure you have Ollama installed and running locally. Run ollama pull llama3 to download a model.
🧪 Dev & Nix Support
Use Nix:
nix-shell
This will install stack and Ollama.
👨💻 Author
Created and maintained by @tusharad. PRs and feedback are welcome!
🤝 Contributing
Have ideas or improvements? Feel free to open an issue or submit a PR!
