News, tutorials, and updates from the Potato team.
Potato now supports coding agent annotation with diff rendering, terminal output display, and process reward schemas. Import traces from Claude Code, Aider, and SWE-Agent.
Set up GitHub PR-style code review annotation in Potato with inline diff comments, file-level quality ratings, and approve or reject verdicts for coding agent output.
Compare Potato with LangSmith and Langfuse for AI agent evaluation across trace rendering, annotation, coding agent support, live observation, pricing, and self-hosting.
Get notified about new tutorials, releases, and community highlights.
Step-by-step tutorial on using Potato's Solo Mode to efficiently label large datasets with human-LLM collaboration, reducing annotation cost by up to 90%.
How to use Potato's web agent trace display to evaluate autonomous web browsing agents, with step-by-step screenshots, SVG overlays, and per-step annotation schemas.
Integrate Potato with Prolific for crowdsourced annotation — completion URL setup, participant ID tracking, attention checks, payment configuration, and quality filtering.
Annotate legal documents in Potato — contracts, court filings, and regulatory text — with span labeling, entity extraction, and privacy-first self-hosted deployment.
Convert Potato annotations to HuggingFace Datasets format — covering JSON export structure, dataset card generation, Hub upload, and integration with transformers training.
Build side-by-side image comparison tasks in Potato for preference ranking, A/B testing, and visual quality assessment — with randomized order and pairwise scoring.
Configure Potato for toxicity detection, hate speech classification, and sensitive content labeling with annotator wellbeing in mind.
Build custom annotation interfaces in Potato using HTML templates, CSS styling, and JavaScript — side-by-side layouts, custom widgets, and embedded media displays.
Set up your first Potato annotation project in 5 minutes — from pip install to a running server with a YAML config, sample data, and your first labeled instances.
Calculate and interpret Cohen's Kappa, Fleiss' Kappa, and Krippendorff's Alpha for Potato annotation projects — with Python code examples and interpretation guidelines.
Create a music annotation task in Potato with waveform visualization, 30-second preview playback, hierarchical genre label trees, and pairwise preference comparisons.
Deploy Potato to production with Docker, nginx, SSL, and cloud platforms including AWS, GCP, and Azure. Includes systemd service configuration and scaling tips.
