LLM Integration
Answers to common questions about Potato. For anything not covered here, ask on Discord or check the documentation.
LLM Integration
Yes. Potato integrates with OpenAI, Anthropic Claude, Google Gemini, and local LLMs via Ollama. You can configure AI pre-annotation to speed up human annotation workflows.
Add an `llm` section to your config specifying the provider, model, and prompt template. Potato will call the LLM API for each item and pre-fill annotation fields that annotators can accept or correct.
Yes. Potato supports Ollama for local models, so the text never leaves your machine while annotators still get model suggestions.
Yes. Potato is well-suited for collecting human preference data for RLHF. Use pairwise comparison to have annotators choose between model outputs, or Likert scales to rate response quality.
Still Have Questions?
Ask on Discord for a quick answer, or browse the documentation for step-by-step guides.