Skip to content

整合

將 Potato 與 AI 模型、眾包平臺連線,並匯出到您常用的機器學習框架。

AI 與大語言模型整合

用 AI 輔助增強標註效率

OpenAI

OpenAI models for intelligent hints, auto-suggestions, and keyword highlighting.

檢視文件 →

Anthropic Claude

Claude models for nuanced annotation assistance and quality checking.

檢視文件 →

Google Gemini

Gemini models for multimodal annotation support across text and images.

檢視文件 →

Local LLMs (Ollama)

Run AI-assisted annotation with local LLMs using Ollama. Keep your data completely private.

檢視文件 →

HuggingFace

Access open-source models via HuggingFace Inference API for flexible AI assistance.

檢視文件 →

OpenRouter

Access multiple AI providers through a single API with OpenRouter integration.

檢視文件 →

vLLM

Self-hosted high-performance inference with vLLM for maximum control and speed.

檢視文件 →

YOLO

Visual object detection with YOLO for image and video annotation tasks.

檢視文件 →

LangChain

Automatic trace ingestion from LangChain agents via callback handler. Capture full agent runs as annotation-ready traces.

檢視文件 →

OpenAI Vision

OpenAI vision models for multimodal annotation assistance on images and screenshots.

檢視文件 →

Anthropic Vision

Claude vision models for image and screenshot annotation assistance.

檢視文件 →

AI 驅動功能

  • 智慧標籤建議
  • 自動關鍵詞高亮
  • 品質檢查輔助
  • 預標註稽核
  • 解釋生成
  • 一致性檢查

標註團隊方案

使用您自己的團隊或通過眾包擴充套件規模

您自己的團隊

推薦用於敏感資料

在本地或您自己的伺服器上執行 Potato,使用內部標註員。非常適合不能外洩的敏感資料、通過 IRB 審批的研究,或已有訓練有素的標註團隊的情況。

優勢

資料永遠不離開您的伺服器無按標註員計費完全控制訪問許可權支援離線工作
檢視本地部署指南 →

或通過眾包平臺擴充套件規模

Prolific

Academic-friendly crowdsourcing with quality participants. Full integration with completion URLs and participant tracking.

功能特性
Completion URL handlingParticipant ID trackingAttention checksQuality filters
檢視文件 →

SONA Systems

University subject pools. Participants arrive with a SONA survey code, and Potato grants their credit from the server when they finish.

功能特性
Server-side credit grantingPer-participant survey codesClient-side credit fallbackAttention checks
檢視文件 →

Connect and other panels

Providers for CloudResearch Connect, Clickworker and Microworkers, and a generic provider for any panel that passes a participant ID.

功能特性
Participant ID from the URLCompletion codes or redirectsMicroworkers VCODEsGeneric provider
檢視文件 →

支援的資料格式

以任何常見格式匯入資料

Text

.txt, .json, .jsonl

Images

.jpg, .png, .gif, .webp

Audio

.mp3, .wav, .ogg, .m4a

Video

.mp4, .webm, .mov

Documents

.pdf, .html

匯出格式

將標註匯出為主流機器學習格式

General

  • JSONL

    One JSON object per annotator per item

  • CSV

    Tabular export for spreadsheet analysis

  • Parquet

    Columnar format for pandas, DuckDB or Spark

NLP

  • CoNLL

    Standard format for NER and sequence labeling

  • Hugging Face

    Push annotations to the Hub as a dataset

  • spaCy (via CoNLL)

    Export CoNLL, then run spacy convert

Computer Vision

  • COCO

    MS COCO format for object detection

  • YOLO

    YOLO format for real-time detection

  • Pascal VOC

    XML bounding boxes, one file per image

Agent Trace Formats

Import agent traces from 15 frameworks for annotation. Convert via CLI or ingest in real time via webhook.

Agent Frameworks

  • LangChain / LangSmith

    Hierarchical runs, tool calls

  • Langfuse

    Observation spans, scores

  • OpenAI

    Function calling, assistants

  • Anthropic Claude

    Tool use, thinking blocks

  • MCP

    Model Context Protocol sessions

  • OpenTelemetry

    Distributed span hierarchy

  • ATIF

    Standard interchange format

Web Agents

  • WebArena

    Screenshots, element targeting

  • Web Agent

    Mind2Web, Computer Use, raw recordings

Coding Agents

  • Claude Code

    Anthropic Messages API with tool_use

  • Aider

    Markdown chat with edit blocks

  • SWE-Agent

    Thought/action/observation trajectories

  • SWE-bench

    Model and gold patches, test lists

General

  • ReAct

    Generic thought/action/observation

  • Multi-Agent

    CrewAI, AutoGen, LangGraph

Agent Training Exports

Export agent annotations directly to training pipeline formats

PRMProcess reward model training format
DPO / RLHFPreference pairs for alignment training
SWE-benchCompatible evaluation results

命令列與 Python

用於自動化的程式設計介面

命令列

# Check a config for errors
potato validate config.yaml --strict

# Start the annotation server
potato start config.yaml

# Export annotations to COCO
python -m potato.export -c config.yaml \
    -f coco -o exports/

在 Python 中載入匯出檔案

# Export to CSV first:
# python -m potato.export -c config.yaml -f csv -o exports/
import pandas as pd

# One row per annotator per item
df = pd.read_csv("exports/annotations.csv")
print(df.groupby("user_id").size())

準備好開始了嗎?

安裝 Potato,幾分鐘內即可與您常用的工具整合。