Skip to content

ऑडियो एनोटेशन

Waveform visualization और playback controls के साथ audio files को annotate करें।

Potato 2.0 Peaks.js द्वारा संचालित waveform visualization, segment labeling, और व्यापक keyboard shortcuts के साथ शक्तिशाली audio annotation प्रदान करता है।

उपयोग के मामले

  • Speech transcription और समीक्षा
  • Speaker diarization
  • संगीत विश्लेषण
  • Audio event detection
  • Speech में भावना पहचान
  • Call center गुणवत्ता आश्वासन

Audio Support सक्षम करना

अपने कॉन्फ़िगरेशन में audio_annotation section जोड़ें:

yaml
annotation_schemes:
  - annotation_type: audio_annotation
    name: audio_segments
    description: "Segment and label the audio"
    labels:
      - Speech
      - Music
      - Silence
      - Noise

Operational Modes

Potato तीन audio annotation modes का समर्थन करता है:

Label Mode

Audio को segment करें और प्रत्येक segment को category labels assign करें:

yaml
annotation_schemes:
  - annotation_type: audio_annotation
    name: speaker_diarization
    mode: label
    description: "Identify speakers in the audio"
    labels:
      - Speaker A
      - Speaker B
      - Overlap

Questions Mode

Per-segment annotation questions जोड़ें:

yaml
annotation_schemes:
  - annotation_type: audio_annotation
    name: speech_quality
    mode: questions
    description: "Evaluate speech segments"
    segment_schemes:
      - annotation_type: radio
        name: speaker_type
        description: "Who is speaking?"
        labels: ["host", "guest", "unknown"]
      - annotation_type: likert
        name: clarity
        description: "How clear is this segment?"
        size: 5
        min_label: "Unintelligible"
        max_label: "Perfectly clear"

Both Mode

Labeling को per-segment questions के साथ मिलाएँ:

yaml
annotation_schemes:
  - annotation_type: audio_annotation
    name: full_analysis
    mode: both
    description: "Label and analyze audio segments"
    labels:
      - Speech
      - Music
      - Noise
    segment_schemes:
      - annotation_type: radio
        name: foreground
        description: "Is this the foreground audio?"
        labels: ["Yes", "No"]

कॉन्फ़िगरेशन Options

बुनियादी सेटअप

yaml
annotation_schemes:
  - annotation_type: audio_annotation
    name: segments
    description: "Create audio segments"
    labels:
      - Label A
      - Label B
 
    # Optional constraints
    min_segments: 1
    max_segments: 50

Keyboard Shortcuts

Labels को number keys 1-9 का उपयोग करके assign किया जा सकता है:

yaml
annotation_schemes:
  - annotation_type: audio_annotation
    name: speakers
    description: "Mark each speaker turn"
    labels:
      - Speaker A  # Press 1
      - Speaker B  # Press 2
      - Overlap    # Press 3

Label Colors

Segment colors customize करें:

yaml
annotation_schemes:
  - annotation_type: audio_annotation
    name: segments
    description: "Segment the recording and label each region"
    labels:
      - name: Speech
        color: "#22C55E"
      - name: Music
        color: "#3B82F6"
      - name: Silence
        color: "#9CA3AF"

Waveform प्रदर्शन

लंबी audio files के साथ इष्टतम प्रदर्शन के लिए, BBC audiowaveform tool install करें:

bash
# macOS
brew install audiowaveform
 
# Ubuntu/Debian
sudo apt-get install audiowaveform
 
# Or build from source
# https://github.com/bbc/audiowaveform

यह server-side waveform generation सक्षम करता है। इसके बिना, client-side generation का उपयोग किया जाता है (30 मिनट से कम की files के लिए उपयुक्त)।

Waveform Caching

बेहतर प्रदर्शन के लिए caching configure करें:

yaml
audio_annotation:
  waveform_cache_dir: waveform_cache/     # Where pre-computed waveforms are stored
  waveform_look_ahead: 3                  # Pre-compute the next N instances
  waveform_cache_max_size: 50             # Maximum cached waveform files
  client_fallback_max_duration: 1800      # Longest file the browser will render, in seconds

Data Format

सरल Audio Reference

json
[
  {"id": "1", "audio_path": "audio/recording_001.wav"},
  {"id": "2", "audio_path": "audio/recording_002.wav"}
]
yaml
data_files:
  - "data/audio_data.json"
 
item_properties:
  id_key: id
  text_key: audio_path   # The field holding the audio URL

Transcripts के साथ

json
[
  {
    "id": "1",
    "audio_path": "audio/call_001.wav",
    "transcript": "Hello, how can I help you today?"
  }
]

Output Format

Annotations segment timestamps के साथ सहेजी जाती हैं:

json
{
  "id": "audio_1",
  "annotations": {
    "segments": [
      {
        "start": 0.0,
        "end": 2.5,
        "label": "Speaker A",
        "questions": {
          "clarity": 4,
          "emotion": "Neutral"
        }
      },
      {
        "start": 2.5,
        "end": 5.2,
        "label": "Speaker B"
      }
    ]
  }
}

Keyboard Shortcuts

Potato कुशल annotation के लिए व्यापक keyboard shortcuts प्रदान करता है:

Shortcutक्रिया
SpacePlay/Pause
[वर्तमान स्थिति पर segment start सेट करें
]वर्तमान स्थिति पर segment end सेट करें
1-9वर्तमान segment को label assign करें
Deleteवर्तमान segment हटाएँ
Left Arrow5 seconds पीछे जाएँ
Right Arrow5 seconds आगे जाएँ
Up ArrowZoom in
Down ArrowZoom out
Homeशुरुआत पर जाएँ
Endअंत पर जाएँ
+Playback speed बढ़ाएँ
-Playback speed घटाएँ

उदाहरण कॉन्फ़िगरेशन

Speaker Diarization

yaml
annotation_task_name: "Speaker Diarization"
task_dir: "."
port: 8000
 
data_files:
  - "data/recordings.json"
 
item_properties:
  id_key: id
  text_key: audio_path
 
annotation_schemes:
  - annotation_type: audio_annotation
    name: speakers
    mode: label
    description: "Identify who is speaking"
    labels:
      - Speaker 1
      - Speaker 2
      - Speaker 3
      - Overlap
      - Silence
    min_segments: 1
 
# Diarization recordings run long, so precompute a few ahead of the annotator.
audio_annotation:
  waveform_cache_dir: waveform_cache/
  waveform_look_ahead: 5
 
output_annotation_dir: "output/"
export_annotation_format: jsonl
 
user_config:
  allow_all_users: true

Transcription Review

yaml
annotation_task_name: "Transcription Quality Review"
task_dir: "."
port: 8000
 
data_files:
  - "data/transcripts.json"
 
item_properties:
  id_key: id
  text_key: audio_path
 
annotation_schemes:
  - annotation_type: audio_annotation
    name: errors
    mode: questions
    description: "Mark transcription errors"
    # Questions mode collects answers per marked region, so the error type and
    # the correction stay attached to the stretch of audio they describe.
    segment_schemes:
      - annotation_type: radio
        name: error_type
        description: "What kind of error is this?"
        labels: ["Substitution", "Deletion", "Insertion", "Speaker mix-up"]
      - annotation_type: text
        name: correction
        description: "What should the transcript say?"
 
  - annotation_type: radio
    name: overall_accuracy
    description: "Overall transcript accuracy"
    labels:
      - Accurate
      - Minor errors
      - Major errors
      - Unusable
 
output_annotation_dir: "output/"
export_annotation_format: jsonl

Call Center QA

yaml
annotation_task_name: "Call Center Quality Assurance"
task_dir: "."
port: 8000
 
data_files:
  - "data/calls.json"
 
item_properties:
  id_key: call_id
  text_key: recording_path
 
annotation_schemes:
  # Segment-level annotation
  - annotation_type: audio_annotation
    name: conversation
    mode: both
    description: "Segment the conversation"
    labels:
      - Agent
      - Customer
      - Hold
      - Silence
    # Who is speaking is a label; how the turn went is a question about it.
    segment_schemes:
      - annotation_type: radio
        name: tone
        description: "Tone of this turn"
        labels: ["Calm", "Neutral", "Escalated"]
 
  # Call-level assessment
  - annotation_type: likert
    name: professionalism
    description: "Agent professionalism"
    size: 5
    min_label: "Poor"
    max_label: "Excellent"
 
  - annotation_type: likert
    name: resolution
    description: "Issue resolution"
    size: 5
    min_label: "Unresolved"
    max_label: "Fully resolved"
 
  - annotation_type: multiselect
    name: issues
    description: "Select any issues observed"
    labels:
      - Long hold time
      - Agent interrupted
      - Incorrect information
      - Missing greeting
      - Unprofessional language
 
  - annotation_type: text
    name: notes
    description: "Additional observations"
    rows: 4
 
output_annotation_dir: "output/"
export_annotation_format: jsonl

समर्थित Audio Formats

  • WAV (सर्वोत्तम गुणवत्ता के लिए अनुशंसित)
  • MP3
  • OGG
  • FLAC
  • M4A
  • WebM

प्रदर्शन सुझाव

  1. audiowaveform install करें - लंबी audio files के लिए आवश्यक
  2. Caching सक्षम करें - Pre-generated waveforms संग्रहीत करने के लिए cache_dir का उपयोग करें
  3. गुणवत्ता के लिए WAV का उपयोग करें - Compressed formats में artifacts हो सकते हैं
  4. Audio pre-process करें - Levels normalize करें, अनावश्यक silence trim करें
  5. File sizes पर विचार करें - बड़ी files लोडिंग धीमी करती हैं
  6. Precompute का उपयोग करें - प्रारंभिक instances के लिए waveforms pre-generate करें

समस्या निवारण

Waveform लोड नहीं हो रहा

  • जांचें कि audio file path सही है
  • सत्यापित करें कि file format समर्थित है
  • लंबी files के लिए audiowaveform install करें
  • Browser console में errors जांचें

धीमा प्रदर्शन

  • audiowaveform tool install करें
  • Waveform caching सक्षम करें
  • Audio file sizes कम करें
  • precompute_depth setting का उपयोग करें

Segments सहेजे नहीं जा रहे

  • सुनिश्चित करें कि output directory writable है
  • Annotation format configuration जांचें
  • सत्यापित करें कि segment में start और end times दोनों हैं