fix(policy): restore policy.local and proposal conformance (#3689)

* fix(policy): restore policy.local and proposal conformance

Signed-off-by: Piotr Mlocek <pmlocek@nvidia.com>

* test(conformance): select policy scenarios by name

Signed-off-by: Piotr Mlocek <pmlocek@nvidia.com>

* test(conformance): reduce policy scenario timing flakes

Signed-off-by: Piotr Mlocek <pmlocek@nvidia.com>

* test(conformance): assert proposals target Bash

Signed-off-by: Piotr Mlocek <pmlocek@nvidia.com>

---------

Signed-off-by: Piotr Mlocek <pmlocek@nvidia.com>

Author: pimlock

CI.md

@@ -40,6 +40,21 @@ The GitHub ruleset should require the `OpenShell / ...` statuses published by
 `Required CI Gates` plus the direct `OpenShell / Trivy Changes` result, not the
 push-triggered workflow jobs themselves.
 
+### Run only the policy advisor conformance tests
+
+Manually dispatch `Integration Tests` on the candidate branch with an
+`artifact-run-id` from a build of the same commit. Set `category` to
+`policy-advisor` and `test-matrix` to:
+
+```json
+[{"environment":"ubuntu-docker-rootful","installer":"binaries","testsuite":"policy-advisor"}]
+```
+
+This runs the `mechanistic-proposal` and `policy-local` conformance tests in the
+installed-artifact suite. The artifact run must contain the candidate CLI and
+gateway binaries and runtime images. This manual run does not replace the
+required PR E2E gate.
+
 ## Informational security reports
 
 Security workflow compute runs directly on GitHub-hosted runners instead of

TESTING.md

@@ -181,8 +181,11 @@ lifecycle management, output parsing, and cleanup.
 Suites:
 
 - Common suite (`--features e2e`) - driver-neutral CLI behavior, sandbox lifecycle, sync, port forwarding, policy, and provider tests.
-- CLI conformance (`openshell-conformance`) - the portable deployment smoke
-  scenario plus focused tests for its reusable command runner.
+- CLI conformance (`openshell-conformance`) - named scenarios for lifecycle,
+  mechanistic drafts, and the sandbox-local API, including agent-authored
+  permission requests. Driver E2E wrappers run every scenario. The
+  installed-artifact conformance suite runs all scenarios and offers a focused
+  `policy-advisor` testsuite for manual integration runs.
 - Driver suites (`--features e2e-docker`, `e2e-podman`, `e2e-kubernetes`, or
   `e2e-vm`) - CLI conformance plus the common and driver-specific coverage for
   the selected deployment.

architecture/sandbox.md

@@ -321,6 +321,16 @@ captured before the bypass fence, mapped back to its workload process, authorize
 through the same egress pipeline, and dialed only through the pinned addresses.
 Omitted protocol endpoints retain explicit-proxy behavior.
 
+Policy DNS reserves `policy.local` inside each sandbox without requiring an
+authored network endpoint or a trusted external lookup. The source-backed TCP
+boundary routes plain HTTP on the reserved address and port 80 to the
+supervisor's sandbox-local policy API; it does not open an upstream connection.
+The API checks the effective agent proposal setting for every request. Policy
+denials at the staged TCP authorization gate enter the supervisor's denial
+aggregator with the resolved binary and destination, so the mechanistic mapper
+can propose a scoped rule. Invalid mappings and destination validation failures
+do not become policy proposals.
+
 Provider credential placeholders are resolved through the live provider state
 for each HTTP request, after destination and L7 policy admission. A static
 credential resolves only when the request host, port, and path match an endpoint

crates/openshell-conformance-cli/src/main.rs

@@ -91,7 +91,7 @@ fn list(output: OutputFormat) -> Result<(), String> {
     match output {
         OutputFormat::Text => {
             for candidate in scenarios() {
-                println!("{:<16} {}", candidate.name, candidate.description);
+                println!("{:<24} {}", candidate.name, candidate.description);
             }
         }
         OutputFormat::Json => {
@@ -231,6 +231,22 @@ mod tests {
         assert!(error.contains("openshell-conformance list"));
     }
 
+    #[test]
+    fn selects_named_policy_scenarios() {
+        let selected = select_scenarios(&[
+            "mechanistic-proposal".to_string(),
+            "policy-local".to_string(),
+        ])
+        .unwrap();
+        assert_eq!(
+            selected
+                .iter()
+                .map(|scenario| scenario.name)
+                .collect::<Vec<_>>(),
+            ["mechanistic-proposal", "policy-local"]
+        );
+    }
+
     #[test]
     fn parses_binary_override_and_json_output() {
         let cli = Cli::try_parse_from([

crates/openshell-conformance/Cargo.toml

@@ -14,10 +14,8 @@ repository.workspace = true
 rand.workspace = true
 serde.workspace = true
 serde_json.workspace = true
-tokio.workspace = true
-
-[dev-dependencies]
 tempfile = "3"
+tokio.workspace = true
 
 [lints]
 workspace = true

crates/openshell-conformance/src/executor.rs

@@ -50,6 +50,7 @@ impl CliExecutor for ProcessCli {
             process
                 .args(&args)
                 .envs(environment)
+                .env("NO_COLOR", "1")
                 .stdout(Stdio::piped())
                 .stderr(Stdio::piped())
                 .kill_on_drop(true);

crates/openshell-conformance/src/lib.rs

@@ -23,7 +23,10 @@ use tokio::time::sleep;
 
 use self::executor::{CliExecutionError, CliExecutor, ProcessCli};
 
-pub use scenarios::{SANDBOX_LIFECYCLE_SCENARIO, SMOKE_SCENARIO};
+pub use scenarios::{
+    MECHANISTIC_PROPOSAL_SCENARIO, POLICY_LOCAL_SCENARIO, SANDBOX_LIFECYCLE_SCENARIO,
+    SMOKE_SCENARIO,
+};
 
 /// An installed conformance scenario.
 #[derive(Debug)]
@@ -41,7 +44,12 @@ impl Scenario {
     }
 }
 
-const SCENARIOS: &[Scenario] = &[SMOKE_SCENARIO, SANDBOX_LIFECYCLE_SCENARIO];
+const SCENARIOS: &[Scenario] = &[
+    SMOKE_SCENARIO,
+    SANDBOX_LIFECYCLE_SCENARIO,
+    MECHANISTIC_PROPOSAL_SCENARIO,
+    POLICY_LOCAL_SCENARIO,
+];
 
 /// Returns every scenario compiled into this distribution.
 pub fn scenarios() -> &'static [Scenario] {

crates/openshell-conformance/src/scenarios/mod.rs

@@ -3,8 +3,10 @@
 
 //! Registered, portable conformance scenarios.
 
+mod policy_behavior;
 mod sandbox_lifecycle;
 mod smoke;
 
+pub use policy_behavior::{MECHANISTIC_PROPOSAL_SCENARIO, POLICY_LOCAL_SCENARIO};
 pub use sandbox_lifecycle::SANDBOX_LIFECYCLE_SCENARIO;
 pub use smoke::SMOKE_SCENARIO;