Repository navigation
docs(portal): clarify prompt features are analysis-only metadata (#1276) - #1461
Open
Derrick Richard (DerrickUnleashed) wants to merge 6 commits into
Open
Derrick Richard (DerrickUnleashed) wants to merge 6 commits into
Derrick Richard (DerrickUnleashed) wants to merge 6 commits into
Conversation
Derrick Richard (DerrickUnleashed)
requested a review
from Wassim Chegham (manekinekko)
as a code owner
October 3, 2026 15:23
Author
|
@microsoft-github-policy-service agree |
Wassim Chegham (manekinekko)
approved these changes
Oct 5, 2026
Derrick Richard (DerrickUnleashed)
requested a review
from Wassim Chegham (manekinekko)
October 5, 2026 14:51
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Closes #1276.
Users confused prompt features with something that affects run behavior. The Portal copy implied features describe "capabilities the agent's prompt or output uses", which reads like a runtime toggle. Prompt features are detection rules over a task prompt, and they are analysis metadata only: they categorize prompts so you can slice and filter runs.
Verified in source:
taskPrompt.featuresis only read by report-template trigger evaluation (packages/shared/src/report-templates/trigger-evaluator.ts) and run filtering (apps/api/src/routes/requests/index.ts). It is never injected into an agent prompt, and never influences orchestration or judging.apps/portal/src/pages/PromptFeatureList.tsx— correct the header tooltip (it described agent capabilities) and the page description.apps/portal/src/pages/PromptFeatureDetail.tsx— add a "Metadata only" note above the detection-prompt editor.apps/portal/src/components/PromptFeatureWizard.tsx— step 1 states that features only categorize prompts for analysis.website/src/content/docs/guides/prompt-features.mdx— new note: features are never sent to the agent and never change the prompt, run execution, or scoring; edit the task prompt, not its features.AGENTS.md— replace "Feature flags tracking what capabilities agents request" (implied runtime behavior) with the prompt-categorization description.Demos
N/A — copy-only changes to existing Portal pages and docs; no behavior or UI layout changes.
Before
N/A
After
N/A
Testing
pnpm --filter portal lint(tsc --noEmit) — cleanpnpm vitest run apps/portal— 68 files / 467 tests passpnpm --dir website test— passSITE=https://microsoft.github.io BASE_PATH=/scope pnpm --dir website build— 214 pages builtDocumentation and compatibility
Checklist
up()/down()and keep it CosmosDB-compatible. — N/A (no database changes)NOTICE/NOTICE-REVIEW.txtwithpnpm noticeas needed. — N/A (no dependency changes)