Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
154 changes: 154 additions & 0 deletions .github/ISSUE_TEMPLATE/openprose-cli-benchmark-profile.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,154 @@
{
"name": "OpenProse CLI benchmark profile or cell proposal",
"description": "Propose a frozen benchmark profile or one exact cell for separate review",
"title": "[CLI benchmark proposal]: ",
"body": [
{
"type": "markdown",
"attributes": {
"value": "Use this form only for a rigorous benchmark profile or cell proposal. A benchmark proposal does not authorize live collection. Do not include credentials, tokens, account identifiers, private paths, or raw provider transcripts. Do not report a suspected security vulnerability here; use the private vulnerability report at https://github.com/openprose/prose-cli/security/advisories/new."
}
},
{
"type": "dropdown",
"id": "proposal_type",
"attributes": {
"label": "Proposal type",
"options": [
"New benchmark profile",
"New cell in a frozen profile",
"Profile or cell amendment"
]
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "research_question",
"attributes": {
"label": "Research question",
"description": "State what comparison the proposal would support and its limits."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "profile_identity",
"attributes": {
"label": "Frozen profile",
"description": "Identify the frozen benchmark profile and its version or digest; describe proposed amendments explicitly."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "cell_identity",
"attributes": {
"label": "Exact cell",
"description": "Specify the exact admitted adapter, harness version, model ID, authentication route, and exact target artifact digest."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "semantic_contract",
"attributes": {
"label": "Semantic contract",
"description": "Identify the authoritative task corpus, acceptance criteria and scoring rules."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "execution_controls",
"attributes": {
"label": "Execution controls",
"description": "Specify the fixed seed, environment, repetition count, ordering and isolation controls."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "stops_retries_cost",
"attributes": {
"label": "Stops, retries and accounting",
"description": "Specify stop conditions, retry rules, accounting including failed attempts, and the cost observation channel."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "evidence_authority",
"attributes": {
"label": "Evidence and authority",
"description": "Identify retained evidence, provenance and independent review; benchmark inclusion does not establish semantic conformance, portability, or public ranking."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "reproduction",
"attributes": {
"label": "Reproduction",
"description": "Provide synthetic reproducible steps and public fixture references; use REDACTED for private values."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "upstream_evidence",
"attributes": {
"label": "Upstream evidence",
"description": "Link public documentation that supports the proposed controls and measurements."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "affiliation",
"attributes": {
"label": "Affiliation",
"description": "Disclose any relevant affiliation or financial interest, or write none."
},
"validations": {
"required": true
}
},
{
"type": "checkboxes",
"id": "disclosure",
"attributes": {
"label": "Disclosure",
"options": [
{
"label": "I removed credentials, account identifiers, private paths, and raw provider output.",
"required": true
}
]
},
"validations": {
"required": true
}
}
]
}
110 changes: 110 additions & 0 deletions .github/ISSUE_TEMPLATE/openprose-cli-bug.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,110 @@
{
"name": "OpenProse CLI bug or install problem",
"description": "Report a reproducible CLI installation or execution problem using synthetic evidence.",
"title": "[CLI bug]: ",
"body": [
{
"type": "markdown",
"attributes": {
"value": "Do not include credentials, tokens, account identifiers, private paths, or raw provider output. Use the literal word REDACTED for removed values. Do not attach raw provider transcripts. For a suspected security vulnerability, use the private vulnerability report at https://github.com/openprose/prose-cli/security/advisories/new."
}
},
{
"type": "textarea",
"id": "problem_area",
"attributes": {
"label": "Problem area",
"description": "Describe whether this affects installation, startup, a harness adapter or output."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "environment",
"attributes": {
"label": "Environment",
"description": "Provide operating system, architecture and installation method; omit private paths and account identifiers."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "cli_version",
"attributes": {
"label": "Exact CLI version",
"description": "Provide the exact CLI version and Bun or Rust implementation; include public harness versions if relevant."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "reproduction",
"attributes": {
"label": "Minimal reproduction",
"description": "Provide synthetic inputs and argument arrays that reproduce the problem."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "expected",
"attributes": {
"label": "Expected behavior",
"description": "Describe what should happen."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "actual",
"attributes": {
"label": "Actual behavior",
"description": "Describe observed behavior and exit status without raw provider output."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "diagnostics",
"attributes": {
"label": "Sanitized diagnostics",
"description": "Provide only relevant sanitized error codes and messages, or write none. Use the literal word REDACTED for private values."
},
"validations": {
"required": true
}
},
{
"type": "checkboxes",
"id": "disclosure",
"attributes": {
"label": "Disclosure",
"options": [
{
"label": "I removed credentials, tokens, account identifiers, private paths, and raw provider output.",
"required": true
},
{
"label": "This is not a suspected security vulnerability.",
"required": true
}
]
},
"validations": {
"required": true
}
}
]
}
132 changes: 132 additions & 0 deletions .github/ISSUE_TEMPLATE/openprose-cli-harness-model.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,132 @@
{
"name": "OpenProse CLI harness or model request",
"description": "Request a new harness adapter, admitted harness version, or model or authentication route",
"title": "[CLI harness/model request]: ",
"body": [
{
"type": "markdown",
"attributes": {
"value": "Use this form for adapter admission, an exact admitted harness version, or a model or authentication route. Do not use this form for a benchmark profile or cell. Do not include credentials, tokens, account identifiers, private paths, or raw provider transcripts. Do not report a suspected security vulnerability here; use the private vulnerability report at https://github.com/openprose/prose-cli/security/advisories/new. Remember: adapter admission, benchmark inclusion, semantic conformance, portability, and public ranking are separate decisions."
}
},
{
"type": "dropdown",
"id": "request_type",
"attributes": {
"label": "Request type",
"options": [
"New harness adapter",
"New admitted harness version",
"Model or authentication route"
]
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "requested_identity",
"attributes": {
"label": "Requested harness or model",
"description": "Provide the exact harness version, exact model ID, and version command and expected output. Use public identifiers only."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "user_journey",
"attributes": {
"label": "User journey",
"description": "Describe the task and why existing admitted routes do not meet it."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "distribution_platform",
"attributes": {
"label": "Distribution and platform",
"description": "Name the public installation source, operating system and architecture."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "protocol_isolation",
"attributes": {
"label": "Protocol and isolation",
"description": "Describe structured output, noninteractive operation, cancellation and process isolation."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "authentication_billing",
"attributes": {
"label": "Authentication and billing",
"description": "Describe the authentication route and who pays; never include credentials or account identifiers."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "reproduction",
"attributes": {
"label": "Minimal reproduction",
"description": "Provide synthetic inputs, argument arrays and expected behavior. Use the literal word REDACTED for private values."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "upstream_evidence",
"attributes": {
"label": "Upstream evidence",
"description": "Link public protocol, version and model documentation supporting the request."
},
"validations": {
"required": true
}
},
{
"type": "textarea",
"id": "affiliation",
"attributes": {
"label": "Affiliation",
"description": "Disclose any relevant affiliation or financial interest, or write none."
},
"validations": {
"required": true
}
},
{
"type": "checkboxes",
"id": "disclosure",
"attributes": {
"label": "Disclosure",
"options": [
{
"label": "I removed credentials, account identifiers, private paths, and raw provider output.",
"required": true
}
]
},
"validations": {
"required": true
}
}
]
}
Loading
Loading