Skip to content
beginnersurvey

Likert Scale Survey

Multi-question survey using Likert scales to measure agreement, satisfaction, or frequency.

Q1: Rate your experience12345Q2: Primary use case?ResearchIndustryEducationQ3: Additional feedback

Configuration Fileconfig.yaml

yaml
# Likert Scale Survey Configuration
# Multi-question survey for measuring attitudes and opinions

task_dir: "."
annotation_task_name: "User Experience Survey"

data_files:
  - "data/survey_items.json"

item_properties:
  id_key: "id"
  text_key: "product_description"
  text_display_key: "product_description"

user_config:
  allow_all_users: true

annotation_schemes:
  - annotation_type: "likert"
    name: "ease_of_use"
    description: "The product is easy to use"
    size: 5
    min_label: "Strongly Disagree"
    max_label: "Strongly Agree"

  - annotation_type: "likert"
    name: "meets_needs"
    description: "The product meets my needs"
    size: 5
    min_label: "Strongly Disagree"
    max_label: "Strongly Agree"

  - annotation_type: "likert"
    name: "would_recommend"
    description: "I would recommend this product to others"
    size: 5
    min_label: "Strongly Disagree"
    max_label: "Strongly Agree"

  - annotation_type: "likert"
    name: "value_for_money"
    description: "The product provides good value for money"
    size: 5
    min_label: "Strongly Disagree"
    max_label: "Strongly Agree"

  - annotation_type: "likert"
    name: "overall_satisfaction"
    description: "Overall, I am satisfied with the product"
    size: 7
    min_label: "Very Dissatisfied"
    max_label: "Very Satisfied"

  - annotation_type: "multiselect"
    name: "best_features"
    description: "Which features do you like most?"
    labels:
      - name: "Design"
      - name: "Performance"
      - name: "Reliability"
      - name: "Customer Support"
      - name: "Documentation"
      - name: "Price"

  - annotation_type: "text"
    name: "feedback"
    description: "Any additional feedback?"
    required: false

output: "annotation_output/"

output_annotation_dir: "annotation_output/"
output_annotation_format: "json"

Sample Datasample-data.json

json
[
  {
    "id": "survey_001",
    "product_description": "Please rate your experience with Potato Annotation Tool - a lightweight, configurable annotation platform for NLP research."
  },
  {
    "id": "survey_002",
    "product_description": "Please rate your experience with our new documentation system - an interactive guide for setting up annotation tasks."
  }
]

// ... and 1 more items

Try it live — no install

Boot the real Potato server in your browser (WebAssembly) and annotate with this exact config. Nothing leaves your machine.

▶ Run live in your browser

Get This Design

View on GitHub

Clone or download from the repository

Quick start:

git clone https://github.com/davidjurgens/potato-showcase.git
cd potato-showcase/templates/surveys/likert-scale-survey
potato start config.yaml

Details

Annotation Types

likertmultiselecttext

Domain

researchuser-feedback

Use Cases

surveyuser-researchfeedback

Tags

surveylikertratingfeedbackquestionnaire

Found an issue or want to improve this design?

Open an Issue

Related Designs

AgentBoard Progress Scoring

Assess multi-turn LLM agent progress by identifying achieved milestones, scoring overall progress, categorizing the agent environment, and noting partial progress observations.

multiselectlikert

OSWorld: Desktop Agent Task Evaluation

Evaluation of multimodal agents performing open-ended tasks in real desktop environments. Annotators assess task success, identify OS-level actions, rate efficiency, and analyze failures across Ubuntu, Windows, and macOS environments.

radiomultiselect

RefactorBench Multi-File Evaluation

Evaluate multi-file refactoring operations generated by coding agents. Annotators assess whether refactorings preserve behavior, identify the types of refactoring applied, rate code improvement, and provide detailed review comments.

radiomultiselect