OSWorld: Desktop Agent Task Evaluation

[
  {
    "id": "osw_001",
    "text": "Create a new spreadsheet in LibreOffice Calc with a monthly budget template, add formulas for totals, and save it as 'budget_2024.xlsx' on the Desktop.",
    "os_type": "Ubuntu 22.04",
    "applications": "LibreOffice Calc, Files",
    "screenshots": "Screenshot 1: Ubuntu desktop with GNOME shell. Taskbar at top shows Activities, clock, system tray. Desktop is clean with a wallpaper showing the Ubuntu Jammy Jellyfish default background. The Files icon and LibreOffice Calc icon are visible in the dock on the left side.\n\nScreenshot 2: LibreOffice Calc is open with a new blank spreadsheet. The agent has typed headers in row 1: A1='Category', B1='January', C1='February', D1='March', E1='Total'. Rows 2-7 contain budget categories: Rent, Groceries, Utilities, Transport, Entertainment, Savings. Cell styling shows bold headers with a light blue background.\n\nScreenshot 3: The spreadsheet now has sample values filled in for January through March. Column E contains SUM formulas (visible in the formula bar: =SUM(B2:D2)). Row 8 shows 'Monthly Total' with SUM formulas for each column. The cell E8 shows a grand total. Number formatting shows dollar signs.\n\nScreenshot 4: Save As dialog is open. The file name field shows 'budget_2024'. The format dropdown shows 'Microsoft Excel (.xlsx)'. The location breadcrumb shows Desktop. The Save button is highlighted.",
    "trajectory": "Step 1: Click LibreOffice Calc icon in dock\nStep 2: Type 'Category' in cell A1, press Tab\nStep 3: Type month headers 'January', 'February', 'March', 'Total' in B1:E1\nStep 4: Type budget categories in A2:A7 (Rent, Groceries, Utilities, Transport, Entertainment, Savings)\nStep 5: Enter sample budget values in B2:D7\nStep 6: Click cell E2, type =SUM(B2:D2), press Enter\nStep 7: Drag fill handle from E2 down to E7 to copy formula\nStep 8: Type 'Monthly Total' in A8\nStep 9: Enter =SUM(B2:B7) in B8, drag fill to E8\nStep 10: Select headers row, apply bold formatting and background color\nStep 11: Press Ctrl+Shift+S to open Save As dialog\nStep 12: Navigate to Desktop in file browser\nStep 13: Type 'budget_2024' in filename field\nStep 14: Select 'Microsoft Excel (.xlsx)' from format dropdown\nStep 15: Click Save\nStep 16: STOP — Task complete",
    "final_state": "File 'budget_2024.xlsx' saved on Desktop. LibreOffice Calc shows the completed budget spreadsheet with category labels, three months of data, SUM formulas in Total column and Monthly Total row, and formatted headers. Desktop file manager confirms the file exists at ~/Desktop/budget_2024.xlsx."
  },
  {
    "id": "osw_002",
    "text": "Download an image from Firefox, open it in GIMP, resize it to 800x600, and export it as a PNG to the Documents folder.",
    "os_type": "Ubuntu 22.04",
    "applications": "Firefox, GIMP, Files",
    "screenshots": "Screenshot 1: Firefox browser open showing an image search results page. Multiple thumbnail images are displayed in a grid layout. The agent is right-clicking on a landscape photograph showing a mountain lake at sunset.\n\nScreenshot 2: Firefox right-click context menu is visible over the image. Menu options include 'Open Image in New Tab', 'Save Image As...', 'Copy Image', 'Copy Image Link'. The cursor is hovering over 'Save Image As...'.\n\nScreenshot 3: GIMP is open with the downloaded image loaded. The image shows the mountain lake photograph at its original resolution (2400x1800 visible in the title bar). The 'Scale Image' dialog is open showing Width: 800, Height: 600, with the chain link icon (maintain aspect ratio) unlocked. Interpolation set to 'Cubic'.\n\nScreenshot 4: GIMP 'Export Image As' dialog is open. The filename field shows 'mountain_lake.png'. The file browser is navigated to the Documents folder (/home/user/Documents). PNG export options are visible below with compression level slider.",
    "trajectory": "Step 1: Click Firefox icon in dock\nStep 2: Navigate to image search page\nStep 3: Right-click on mountain lake photograph\nStep 4: Click 'Save Image As...' from context menu\nStep 5: Save to Downloads folder as 'mountain_lake.jpg'\nStep 6: Open GIMP from Applications menu\nStep 7: File > Open, navigate to Downloads, select 'mountain_lake.jpg'\nStep 8: Image > Scale Image from menu bar\nStep 9: Unlock aspect ratio chain link\nStep 10: Set width to 800, height to 600\nStep 11: Click 'Scale' button\nStep 12: File > Export As\nStep 13: Navigate to Documents folder\nStep 14: Change filename to 'mountain_lake.png'\nStep 15: Click 'Export'\nStep 16: Click 'Export' in PNG options dialog\nStep 17: STOP — Task complete",
    "final_state": "Image exported as 'mountain_lake.png' in Documents folder. GIMP shows the resized image at 800x600 pixels. File manager confirms /home/user/Documents/mountain_lake.png exists with the correct dimensions."
  }
]

// ... and 6 more items