Test: SDK-backed Customization Marketplace #340922

PRs: #339896, #340606, #340609

• anyOS Michael Lively (@Yoyokrazy)
• anyOS Martin Aeschlimann (@aeschli)

Complexity: 5

Authors: Paul (@pwang347)

Create Issue

The Copilot harness now owns GitHub Feed discovery, installation state, and install/uninstall operations through the Copilot SDK.

Setup

1. Run Profiles: New Window with Temporary Profile and open an empty folder.

2. Start a new chat and select Copilot in Session Target. Do not send a message.

3. Add these User Settings (JSON):

   "chat.customizations.marketplace.enabled": true,
   "chat.customizations.marketplace.sources.publicFeed.enabled": true

4. Sign out of all GitHub accounts from the Accounts menu.

Discovery and sign-in

1. Run Chat: Open Customizations > Discover.
2. Open All Sources. Verify it lists GitHub Feed, MCP Gallery, Copilot Connectors, and each configured plugin marketplace by its own name.
3. Select GitHub Feed and search figma.
4. Verify GitHub Feed shows Sign In instead of search results.
5. Select Sign In, complete GitHub sign-in, and verify the same figma query recovers automatically.
6. Verify exactly one Figma MCP server appears with an image or MCP icon.
7. Clear the search. Verify available featured cards include Azure and Security Best Practices.

Install, uninstall, and icons

1. Install these cards:
   • Figma from GitHub Feed
   • Security Best Practices from GitHub Feed
   • Playwright from MCP Gallery
   • Azure from GitHub Feed
2. Accept any SDK review or marketplace trust prompt that names the selected item and source.
3. For each card, verify Installing... changes to Uninstall without showing Install or Retry Install in between.
4. Open MCP Servers and Plugins. Verify each installed item has one row and opens the matching details.
5. Verify every card, installed row, and details header has a visible publisher image or type icon. No icon should be blank, broken, or attached to another item.
6. Switch to a light theme, then a dark theme. Verify the icons remain visible and aligned.
7. Run Developer: Reload Window. Verify all four items remain installed with the same cards, rows, and icons.
8. Uninstall Figma and Playwright from MCP Servers. Uninstall Security Best Practices and Azure from Discover.
9. Verify only the selected row disappears and its card offers Install again.
10. Reinstall Playwright, then uninstall it again. Verify there is never more than one Playwright row or stale Installed state.

Strict marketplace policy

1. Put this in the managed settings file, then restart VS Code Insiders:

   {
     "strictKnownMarketplaces": [
       { "source": "github", "repo": "github/awesome-copilot" }
     ]
   }

   • macOS: /Library/Application Support/GitHubCopilot/managed-settings.json
   • Windows: %ProgramFiles%\GitHubCopilot\managed-settings.json
   • Linux: /etc/github-copilot/managed-settings.json

2. Select Copilot in Session Target and reopen Discover.

3. Verify GitHub Feed is absent while MCP Gallery and policy-allowed marketplace names remain.

4. Search figma. Verify no GitHub Feed result or GitHub Feed sign-in action appears.

5. Select the allowed awesome-copilot marketplace. Install and uninstall Security Best Practices.

6. Remove strictKnownMarketplaces, restart Insiders, select Copilot, and reopen Discover.

7. Verify GitHub Feed and the Figma result return.