Integrationen
Verbinden Sie Potato mit KI-Modellen, Crowdsourcing-Plattformen und exportieren Sie in Ihre bevorzugten ML-Frameworks.
KI & LLM-Integration
Annotation mit KI-Unterstützung beschleunigen
OpenAI
OpenAI models for intelligent hints, auto-suggestions, and keyword highlighting.
Dokumentation ansehen →Anthropic Claude
Claude models for nuanced annotation assistance and quality checking.
Dokumentation ansehen →Google Gemini
Gemini models for multimodal annotation support across text and images.
Dokumentation ansehen →Local LLMs (Ollama)
Run AI-assisted annotation with local LLMs using Ollama. Keep your data completely private.
Dokumentation ansehen →HuggingFace
Access open-source models via HuggingFace Inference API for flexible AI assistance.
Dokumentation ansehen →OpenRouter
Access multiple AI providers through a single API with OpenRouter integration.
Dokumentation ansehen →vLLM
Self-hosted high-performance inference with vLLM for maximum control and speed.
Dokumentation ansehen →LangChain
Automatic trace ingestion from LangChain agents via callback handler. Capture full agent runs as annotation-ready traces.
Dokumentation ansehen →OpenAI Vision
OpenAI vision models for multimodal annotation assistance on images and screenshots.
Dokumentation ansehen →Anthropic Vision
Claude vision models for image and screenshot annotation assistance.
Dokumentation ansehen →Hugging Face Hub
Publish a model trained on your annotations to a Hub repository, private by default, with a model card written from the training run.
Dokumentation ansehen →Hugging Face Inference
Score an Inference Endpoint or serverless model on your labeled items, then show its predictions to annotators as pre-labels.
Dokumentation ansehen →Roboflow
Send images to a hosted or self-hosted Roboflow model and review its boxes and outlines as pre-labels.
Dokumentation ansehen →CVAT Nuclio functions
Call a CVAT serverless detector on your images and score its boxes against the boxes your annotators drew.
Dokumentation ansehen →Label Studio ML backend
Ask a running Label Studio ML backend for predictions, score them on held-out items, and review them in Potato as pre-labels.
Dokumentation ansehen →KI-gestützte Funktionen
- Intelligente Label-Vorschläge
- Automatische Schlüsselwort-Hervorhebung
- Qualitätsprüfungsunterstützung
- Vorannotation zur Überprüfung
- Erklärungsgenerierung
- Konsistenzprüfung
Arbeitskräfte-Optionen
Ihr eigenes Team nutzen oder mit Crowdsourcing skalieren
Ihr eigenes Team
Empfohlen für sensible DatenBetreiben Sie Potato lokal oder auf Ihren eigenen Servern mit Ihren hauseigenen Annotatoren. Ideal für sensible Daten, die nicht extern geteilt werden können, IRB-genehmigte Studien oder wenn Sie bereits ein ausgebildetes Annotationsteam haben.
Vorteile
Oder mit Crowdsourcing-Plattformen skalieren
Prolific
Academic-friendly crowdsourcing with quality participants. Full integration with completion URLs and participant tracking.
Funktionen
SONA Systems
University subject pools. Participants arrive with a SONA survey code, and Potato grants their credit from the server when they finish.
Funktionen
Connect and other panels
Providers for CloudResearch Connect, Clickworker and Microworkers, and a generic provider for any panel that passes a participant ID.
Funktionen
Unterstützte Datenformate
Daten in beliebigen gängigen Formaten importieren
Text
.txt, .json, .jsonl
Images
.jpg, .png, .gif, .webp
Audio
.mp3, .wav, .ogg, .m4a
Video
.mp4, .webm, .mov
Documents
.pdf, .html
Exportformate
Annotationen in gängige ML-Formate exportieren
General
- JSONL
One JSON object per annotator per item
- CSV
Tabular export for spreadsheet analysis
- Parquet
Columnar format for pandas, DuckDB or Spark
NLP
- CoNLL
Standard format for NER and sequence labeling
- Hugging Face
Push annotations to the Hub as a dataset
- spaCy (via CoNLL)
Export CoNLL, then run spacy convert
Computer Vision
- COCO
MS COCO format for object detection
- YOLO
YOLO format for real-time detection
- Pascal VOC
XML bounding boxes, one file per image
Agent Trace Formats
Import agent traces from 15 frameworks for annotation. Convert via CLI or ingest in real time via webhook.
Agent Frameworks
- LangChain / LangSmith
Hierarchical runs, tool calls
- Langfuse
Polling or export; scores sent back
- OpenAI
Function calling, assistants
- Anthropic Claude
Tool use, thinking blocks
- MCP
Model Context Protocol sessions
- OpenTelemetry
Distributed span hierarchy
- ATIF
Standard interchange format
Web Agents
- WebArena
Screenshots, element targeting
- Web Agent
Mind2Web, Computer Use, raw recordings
Coding Agents
- Claude Code
Anthropic Messages API with tool_use
- Aider
Markdown chat with edit blocks
- SWE-Agent
Thought/action/observation trajectories
- SWE-bench
Model and gold patches, test lists
General
- ReAct
Generic thought/action/observation
- Multi-Agent
CrewAI, AutoGen, LangGraph
Agent Training Exports
Export agent annotations directly to training pipeline formats
Kommandozeile und Python
Programmatischer Zugriff für Automatisierung
Befehlszeile
# Check a config for errors
potato validate config.yaml --strict
# Start the annotation server
potato start config.yaml
# Export annotations to COCO
python -m potato.export -c config.yaml \
-f coco -o exports/Einen Export in Python laden
# Export to CSV first:
# python -m potato.export -c config.yaml -f csv -o exports/
import pandas as pd
# One row per annotator per item
df = pd.read_csv("exports/annotations.csv")
print(df.groupby("user_id").size())Bereit loszulegen?
Installieren Sie Potato und beginnen Sie in Minuten mit der Integration in Ihre bevorzugten Tools.