Skip to content
beginnersurvey

Likert Scale Survey

Multi-question survey using Likert scales to measure agreement, satisfaction, or frequency.

Try it live — no install

Boot the real Potato server in your browser (WebAssembly) and annotate with this exact config. Nothing leaves your machine.

Run live in your browser

Get This Design

View on GitHub(opens in a new tab)

Clone or download from the repository

Quick start:

bash
git clone https://github.com/davidjurgens/potato-showcase.git
cd potato-showcase/templates/surveys/likert-scale-survey
potato start config.yaml

Configuration File

yaml
# Likert Scale Survey Configuration
# Multi-question survey for measuring attitudes and opinions

task_dir: "."
annotation_task_name: "User Experience Survey"

data_files:
  - "data/survey_items.json"

item_properties:
  id_key: "id"
  text_key: "product_description"
  text_display_key: "product_description"

user_config:
  allow_all_users: true

annotation_schemes:
  - annotation_type: "likert"
    name: "ease_of_use"
    description: "The product is easy to use"
    size: 5
    min_label: "Strongly Disagree"
    max_label: "Strongly Agree"

  - annotation_type: "likert"
    name: "meets_needs"
    description: "The product meets my needs"
    size: 5
    min_label: "Strongly Disagree"
    max_label: "Strongly Agree"

  - annotation_type: "likert"
    name: "would_recommend"
    description: "I would recommend this product to others"
    size: 5
    min_label: "Strongly Disagree"
    max_label: "Strongly Agree"

  - annotation_type: "likert"
    name: "value_for_money"
    description: "The product provides good value for money"
    size: 5
    min_label: "Strongly Disagree"
    max_label: "Strongly Agree"

  - annotation_type: "likert"
    name: "overall_satisfaction"
    description: "Overall, I am satisfied with the product"
    size: 7
    min_label: "Very Dissatisfied"
    max_label: "Very Satisfied"

  - annotation_type: "multiselect"
    name: "best_features"
    description: "Which features do you like most?"
    labels:
      - name: "Design"
      - name: "Performance"
      - name: "Reliability"
      - name: "Customer Support"
      - name: "Documentation"
      - name: "Price"

  - annotation_type: "text"
    name: "feedback"
    description: "Any additional feedback?"
    required: false

output: "annotation_output/"

output_annotation_dir: "annotation_output/"
output_annotation_format: "json"

Sample Data

json
[
  {
    "id": "survey_001",
    "product_description": "Please rate your experience with Potato Annotation Tool - a lightweight, configurable annotation platform for NLP research."
  },
  {
    "id": "survey_002",
    "product_description": "Please rate your experience with our new documentation system - an interactive guide for setting up annotation tasks."
  }
]

// ... and 1 more items

Details

Annotation Types

likertmultiselecttext

Domain

researchuser-feedback

Use Cases

surveyuser-researchfeedback

Tags

surveylikertratingfeedbackquestionnaire

Found an issue or want to improve this design?

Open an Issue(opens in a new tab)

Related Designs

AgentBoard Progress Scoring

Assess multi-turn LLM agent progress by identifying achieved milestones, scoring overall progress, categorizing the agent environment, and noting partial progress observations.

multiselectlikert

OSWorld: Desktop Agent Task Evaluation

Evaluation of multimodal agents performing open-ended tasks in real desktop environments. Annotators assess task success, identify OS-level actions, rate efficiency, and analyze failures across Ubuntu, Windows, and macOS environments.

radiomultiselect

RefactorBench Multi-File Evaluation

Evaluate multi-file refactoring operations generated by coding agents. Annotators assess whether refactorings preserve behavior, identify the types of refactoring applied, rate code improvement, and provide detailed review comments.

radiomultiselect