Skip to content

Blog

Neuigkeiten, Anleitungen und Updates vom Potato-Team.

AnnouncementsMar 9, 2026

Potato 2.3: Agentische Annotation, Solo Mode und die Zukunft menschlicher Evaluierung

Potato 2.3.0 führt agentische Annotation mit 12 Trace-Format-Konvertern, Solo Mode für menschlich-LLM-kollaboratives Labeling, Best-Worst Scaling, SSO/OAuth, Parquet-Export und 15 Demo-Projekte ein.

Potato Team·9 min read
Announcements11 min read

Potato 2.3: Agentic Annotation, Solo Mode, और Human Evaluation का भविष्य

Potato 2.3.0 में agentic annotation के साथ 12 trace format converters, Solo Mode, Best-Worst Scaling, SSO/OAuth, Parquet export, और 15 demo projects प्रस्तुत किए गए हैं।

Announcements11 min read

Potato 2.3: Annotazione Agentica, Solo Mode e il Futuro della Valutazione Umana

Potato 2.3.0 introduce l'annotazione agentica con 12 convertitori di formato traccia, Solo Mode per l'etichettatura collaborativa umano-LLM, Best-Worst Scaling, SSO/OAuth, esportazione Parquet e 15 progetti demo.

Announcements10 min read

Potato 2.3: Agentic Annotation, Solo Mode, and the Future of Human Evaluation

Potato 2.3.0 introduces agentic annotation with 12 trace format converters, Solo Mode for human-LLM collaborative labeling, Best-Worst Scaling, SSO/OAuth, Parquet export, and 15 demo projects.

Guides9 min read

KI-Agenten evaluieren: Ein vollständiger Leitfaden zur menschlichen Annotation von Agenten-Traces

Erfahren Sie, wie Sie mit Potatos agentischen Annotationsfunktionen eine vollständige Evaluierungspipeline für KI-Agenten einrichten – von der Trace-Importierung bis zum Annotationsschema-Design.

Guides10 min read

AI Agents का मूल्यांकन: Agent Traces की Human Annotation के लिए संपूर्ण गाइड

Potato की agentic annotation सुविधाओं का उपयोग करके AI agent outputs का human evaluation कैसे सेट करें — trace import से annotation schema design तक।

Guides10 min read

Valutare gli Agenti AI: Una Guida Completa all'Annotazione Umana delle Tracce degli Agenti

Scopri come configurare la valutazione umana degli output di agenti AI utilizzando le funzionalità di annotazione agentica di Potato, dall'importazione delle tracce alla progettazione degli schemi di annotazione.

Guides10 min read

Evaluating AI Agents: A Complete Guide to Human Annotation of Agent Traces

Learn how to set up human evaluation of AI agent outputs using Potato's agentic annotation features, from trace import to annotation schema design.

Tutorials11 min read

Solo Mode: Wie ein Annotator 10.000 Beispiele beschriften kann

Schritt-für-Schritt-Tutorial zur effizienten Beschriftung großer Datensätze mit Potatos Solo Mode und menschlich-LLM-Kollaboration – Annotationskosten um bis zu 90 % reduzieren.

Tutorials12 min read

Solo Mode: एक Annotator कैसे 10,000 Examples Label कर सकता है

Human-LLM collaboration के साथ बड़े datasets को कुशलतापूर्वक label करने के लिए Potato के Solo Mode का उपयोग करने पर चरण-दर-चरण tutorial, annotation लागत को 90% तक कम करते हुए।

Tutorials12 min read

Solo Mode: Come un Solo Annotatore Può Etichettare 10.000 Esempi

Tutorial passo per passo sull'utilizzo di Solo Mode di Potato per etichettare in modo efficiente grandi dataset con la collaborazione umano-LLM, riducendo il costo dell'annotazione fino al 90%.

Tutorials11 min read

Solo Mode: How One Annotator Can Label 10,000 Examples

Step-by-step tutorial on using Potato's Solo Mode to efficiently label large datasets with human-LLM collaboration, reducing annotation cost by up to 90%.

Guides10 min read

Web-Browsing-Agenten annotieren: Von WebArena-Traces zur menschlichen Evaluierung

Wie man Potatos Web-Agent-Trace-Anzeige nutzt, um autonome Web-Browsing-Agenten mit schrittweisen Screenshots, SVG-Overlays und schrittweisen Annotationsschemata zu evaluieren.

Guides11 min read

Web Browsing Agents को Annotate करना: WebArena Traces से Human Evaluation तक

Potato के web agent trace display का उपयोग करके स्वायत्त web browsing agents का मूल्यांकन कैसे करें — चरण-दर-चरण screenshots, SVG overlays, और per-step annotation schemas के साथ।

Guides11 min read

Annotare gli Agenti di Navigazione Web: Dalle Tracce WebArena alla Valutazione Umana

Come utilizzare il display delle tracce degli agenti web di Potato per valutare agenti di navigazione web autonomi, con screenshot passo per passo, overlay SVG e schemi di annotazione per passo.

Guides10 min read

Annotating Web Browsing Agents: From WebArena Traces to Human Evaluation

How to use Potato's web agent trace display to evaluate autonomous web browsing agents, with step-by-step screenshots, SVG overlays, and per-step annotation schemas.

Announcements5 min read

Potato 2.2: Events, Entity Linking, Export, and 55 Survey Instruments

Potato 2.2.0 adds 9 new annotation schemas, a pluggable export system, MACE competence estimation, 55 validated survey instruments, and remote data sources.

Announcements6 min read

Potato 2.1: Instance Display, Visual AI, and Span Linking

Potato 2.1.0 brings the instance display system, visual AI support for image and video annotation, span linking, multi-field spans, and layout customization.

Guides9 min read

Visuelle KI zur Beschleunigung von Bild- und Video-Annotation einsetzen

KI-gestützte Objekterkennung, Pre-Annotation und Klassifizierung für Bild- und Videoaufgaben mit YOLO, Ollama, OpenAI und Claude einrichten.

Guides11 min read

Image और Video Annotation को तेज़ करने के लिए Visual AI का उपयोग

YOLO, Ollama, OpenAI, और Claude के साथ image और video tasks के लिए AI-powered object detection, pre-annotation, और classification सेट करें।

Guides10 min read

Usare l'AI Visiva per Accelerare l'Annotazione di Immagini e Video

Configura il rilevamento di oggetti assistito dall'AI, la pre-annotazione e la classificazione per task su immagini e video con YOLO, Ollama, OpenAI e Claude.

Guides10 min read

Using Visual AI to Speed Up Image and Video Annotation

Set up AI-powered object detection, pre-annotation, and classification for image and video tasks with YOLO, Ollama, OpenAI, and Claude.

Guides8 min read

Migrating from Label Studio to Potato

Step-by-step guide for manually converting Label Studio projects, templates, and annotations to Potato format.

Guides4 min read

Running Annotation Studies on Prolific

Complete guide to integrating Potato with Prolific for crowdsourced annotation, including payment and quality control.

Guides6 min read

Legal Document Annotation Best Practices

Specialized techniques for annotating contracts, court documents, and regulatory filings with domain expertise.

Guides5 min read

Medical Image Annotation with Potato

Best practices for annotating medical images using Potato's standard image annotation features.

Tutorials4 min read

Polygon Annotation for Segmentation Tasks

How to configure polygon drawing tools for image segmentation, with tips for complex shapes and overlapping regions.

Guides3 min read

Active Learning: Intelligenter annotieren, nicht mehr

Wie man Unsicherheits-Sampling nutzt, um Annotationen zu priorisieren und den gesamten Beschriftungsaufwand um bis zu 50 % zu reduzieren.

Guides4 min read

Active Learning: स्मार्ट तरीके से Annotate करें, कठिन नहीं

Annotations को prioritize करने और कुल labeling effort को 50% तक कम करने के लिए uncertainty sampling का उपयोग कैसे करें।

Guides4 min read

Active Learning: Annota in Modo Più Intelligente, Non Più Faticoso

Come usare l'uncertainty sampling per prioritizzare le annotazioni e ridurre il lavoro totale di etichettatura fino al 50%.

Guides3 min read

Active Learning: Annotate Smarter, Not Harder

How to use uncertainty sampling to prioritize annotations and reduce the total labeling effort by up to 50%.

Tutorials3 min read

Drawing Bounding Boxes for Object Detection

Complete guide to setting up bounding box annotation for computer vision tasks, including label colors and validation.

Guides4 min read

Exporting Annotations to Hugging Face Datasets

How to convert your Potato annotations into Hugging Face dataset format for model training and sharing.

Tutorials6 min read

Image Comparison and Preference Tasks

Build side-by-side image comparison interfaces for preference ranking, A/B testing, and quality assessment.

Announcements3 min read

Introducing Potato 2.0: AI-Powered Annotation

We're excited to announce Potato 2.0 with AI-powered features, multimedia support, and active learning capabilities.

Guides3 min read

Automatic Keyword Highlighting

Configure AI-powered keyword highlighting to draw annotator attention to important terms and phrases.

Guides7 min read

Deploying to Amazon Mechanical Turk

Step-by-step instructions for running Potato annotation tasks on MTurk with qualification tests and approval workflows.

Tutorials4 min read

Creating a Sentiment Analysis Task

Build a complete sentiment classification task with radio buttons, tooltips, and keyboard shortcuts for efficient labeling.

Guides6 min read

Content Moderation Annotation Setup

Configure Potato for toxicity detection, hate speech classification, and sensitive content labeling with annotator wellbeing in mind.

Guides4 min read

Custom HTML Templates in Potato

Create custom annotation interfaces with HTML templates, CSS styling, and JavaScript interactivity.

Tutorials6 min read

Pronunciation Assessment Annotation

Build a language learning annotation task for rating pronunciation quality with audio playback and Likert scales.

Tutorials4 min read

Speaker Diarization Annotation

Build a speaker identification task with audio waveforms, timestamp markers, and speaker label assignment.

Tutorials3 min read

Video Annotation with Frame-by-Frame Controls

Set up video annotation tasks with precise frame navigation, timestamp markers, and temporal event labeling.

Tutorials5 min read

Audio Event Detection and Tagging

Set up annotation for detecting specific sounds like speech, music, applause, or environmental noises with timestamp spans.

Tutorials2 min read

In 5 Minuten mit Potato loslegen

Eine schnelle Anleitung zur Einrichtung Ihres ersten Annotationsprojekts mit Potato – von der Installation bis zu Ihren ersten beschrifteten Daten.

Tutorials2 min read

5 मिनट में Potato के साथ शुरुआत करें

Installation से अपने पहले labeled data तक, Potato के साथ अपना पहला annotation project सेट करने के लिए एक त्वरित गाइड।

Tutorials2 min read

Iniziare con Potato in 5 Minuti

Una guida rapida per configurare il tuo primo progetto di annotazione con Potato, dall'installazione ai tuoi primi dati etichettati.

Tutorials2 min read

Getting Started with Potato in 5 Minutes

A quick guide to setting up your first annotation project with Potato, from installation to your first labeled data.

Guides5 min read

Measuring Inter-Annotator Agreement

How to calculate and interpret Cohen's Kappa, Fleiss' Kappa, and Krippendorff's Alpha for your annotation projects.

Announcements3 min read

Potato Featured at EMNLP 2022

Our paper on Potato was accepted at EMNLP 2022. Learn about the research behind the tool and how to cite it in your work.

Guides7 min read

Quality Control for Crowdsourced Annotation

Best practices for ensuring annotation quality in annotation projects, including practical strategies you can implement with and beyond Potato.

Tutorials4 min read

Image Classification with Potato

Learn how to set up image classification tasks with thumbnail previews, zoom controls, and multi-label support.

Guides4 min read

LLMs für intelligente Annotations-Hinweise integrieren

Erfahren Sie, wie Sie OpenAI, Claude oder Gemini nutzen, um Ihren Annotatoren intelligente Hinweise und Vorschläge bereitzustellen.

Guides4 min read

Smart Annotation Hints के लिए LLMs को Integrate करना

OpenAI, Claude, या Gemini का उपयोग करके अपने annotators को intelligent hints और suggestions प्रदान करना सीखें।

Guides4 min read

Integrare gli LLM per Suggerimenti di Annotazione Intelligenti

Scopri come usare OpenAI, Claude o Gemini per fornire suggerimenti e hint intelligenti ai tuoi annotatori.

Guides4 min read

Integrating LLMs for Smart Annotation Hints

Learn how to use OpenAI, Claude, or Gemini to provide intelligent hints and suggestions to your annotators.

Tutorials5 min read

Music Genre Classification Annotation

Create a music annotation task with waveform visualization, 30-second previews, and hierarchical genre labels.

Guides6 min read

Deploying Potato on a Server

Production deployment guide for Potato including Docker, cloud platforms, and SSL configuration.

Tutorials3 min read

Multi-Object Tracking Annotation

An overview of multi-object tracking annotation concepts and how Potato's video annotation capabilities can support basic tracking workflows.

Tutorials6 min read

Classifying Emotions in Speech

Create an audio emotion classification task with waveform display, playback speed controls, and Likert scales.

Tutorials4 min read

Building Your First NER Annotation Task

Step-by-step tutorial on creating a named entity recognition annotation task with span labels and keyboard shortcuts.

Guides3 min read

Understanding Potato Data Formats

A deep dive into JSON and JSONL data formats, with examples for text, image, audio, and multimodal annotation.

Tutorials5 min read

Setting Up Audio Transcription Review

Configure waveform visualization, playback controls, and text correction interfaces for audio transcription tasks.

Stay updated

Get notified about new tutorials, releases, and community highlights.