Compare commits
74
Commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
aa78ff896f | ||
|
|
588b4cac51 | ||
|
|
dd7fd109a7 | ||
|
|
844ff1c312 | ||
|
|
a5d7782610 | ||
|
|
829537c17a | ||
|
|
46329034e1 | ||
|
|
d973ba3cd7 | ||
|
|
edbb0a4913 | ||
|
|
919e723de8 | ||
|
|
be1d4521ec | ||
|
|
37c86e844d | ||
|
|
831221d930 | ||
|
|
f100b0b915 | ||
|
|
c94447f97e | ||
|
|
aa3e7090a1 | ||
|
|
2f7663b03f | ||
|
|
4da489879f | ||
|
|
569d40513a | ||
|
|
ac4b09843b | ||
|
|
a918047f93 | ||
|
|
68aedd157a | ||
|
|
f84e47c7c7 | ||
|
|
e8de5edbf0 | ||
|
|
deabec04d4 | ||
|
|
7c1e95ab97 | ||
|
|
5a4a72ffb8 | ||
|
|
77f41fb60e | ||
|
|
ddedcf0c15 | ||
|
|
c8968a3c80 | ||
|
|
937b697d07 | ||
|
|
a7a4f0b39d | ||
|
|
e3eb54b97a | ||
|
|
0a671a5faa | ||
|
|
9998fe2679 | ||
|
|
3b14a4ad17 | ||
|
|
7b76de039c | ||
|
|
7070ca6f67 | ||
|
|
49205f50d4 | ||
|
|
43973f3c2f | ||
|
|
246921ace2 | ||
|
|
3bc9143918 | ||
|
|
71593180ad | ||
|
|
f55cc70e62 | ||
|
|
37483236fb | ||
|
|
a9dafeca41 | ||
|
|
f371c4d173 | ||
|
|
4c7967fbc9 | ||
|
|
00f1497cec | ||
|
|
423f7103c8 | ||
|
|
dc9d311b32 | ||
|
|
c7cb7e1e15 | ||
|
|
f2c1d79341 | ||
|
|
74a1c8c0d3 | ||
|
|
98ca03e3ee | ||
|
|
0bd28d6b38 | ||
|
|
eb16b39bf5 | ||
|
|
0f440b8817 | ||
|
|
135d06345a | ||
|
|
791f3bfcff | ||
|
|
bc418366a9 | ||
|
|
bb3c2a16d6 | ||
|
|
336f0e0b3c | ||
|
|
d3cc1b7d2e | ||
|
|
a0d6eb69ff | ||
|
|
fa4cd3cf76 | ||
|
|
fbe7c3a214 | ||
|
|
96b3912667 | ||
|
|
831b346b70 | ||
|
|
3e5c94743f | ||
|
|
964d27d385 | ||
|
|
5b27628fab | ||
|
|
d5dd7357f3 | ||
|
|
e638a5db23 |
@@ -37,6 +37,7 @@ set before opening a PR, not between edits.
|
||||
| `bin/dejima-provider-lib.sh`, `forges/`, `workflows/`, `harnesses/` | `test/providers.bats` |
|
||||
| `bin/dejima-attach`, `-ttyd`, `-notify-watch`, `web/`, `systemd/` | `test/remote.bats` |
|
||||
| `bin/dejima-project-lib.sh`, `-dep`, `-project`, `-allow` | `test/project.bats` |
|
||||
| `bin/dejima-update-check` | `test/config.bats` |
|
||||
| `bin/dejima-anthropic-proxy`, `docker/anthropic-proxy-forwarder.js` | `test/proxy.bats` |
|
||||
| `docker/`, `hooks/`, `README.md`, `docs/` | `test/static.bats` |
|
||||
| anything under `docker/` that has to actually boot | `test/runtime.bats` (needs Docker) |
|
||||
|
||||
@@ -27,23 +27,24 @@
|
||||
**Agents work best without you babysitting them. Bound the blast radius, let them
|
||||
work, and assume they are hostile.**
|
||||
|
||||
An agent with permission prompts turned off gets a lot done. It can also be
|
||||
turned against you mid-session, by a prompt injection or a poisoned
|
||||
dependency, and it will not announce that it has been. dejima is built for
|
||||
that case: the agent works without asking, and what it can reach, take and
|
||||
break was decided before it started.
|
||||
Most sandboxes stop at the container. The blast radius does not. A contained
|
||||
session still opens pull requests, and your CI runs that commit before anyone
|
||||
reads it; an escape from the container lands on a machine with its own reach
|
||||
across your network. **dejima puts a control on every layer it passes
|
||||
through.**
|
||||
|
||||
dejima is a **sandboxed development environment for unsupervised agentic
|
||||
work.** It runs a coding agent (Claude Code, or whatever command you point it
|
||||
at) inside a firewalled Docker container with `--dangerously-skip-permissions`
|
||||
(no permission prompts, all tool use auto-accepted), against a project
|
||||
bind-mounted from the host. The agent gets to work without stopping to ask;
|
||||
the container is what makes that trade a reasonable one.
|
||||
work**: a coding agent running with its permission prompts off, inside a
|
||||
firewalled Docker container, against a project bind-mounted from your host.
|
||||
Claude Code and Cline today, selected in the config, and neither is a
|
||||
default. A prompt injection or
|
||||
a poisoned dependency can turn it mid-session and it will not announce that, so
|
||||
what it can reach, take and break is decided before it starts.
|
||||
|
||||
A container on its own is only confinement. What makes this a development
|
||||
environment is the rest: a forge workflow the agent drives itself, project
|
||||
context written for the agent rather than for you, and enough of a trail left
|
||||
behind that you can walk away from a session and still pick up what it did.
|
||||
A container alone is only confinement. The rest is what makes it somewhere to
|
||||
work: a forge workflow the agent drives itself, project context written for the
|
||||
agent rather than for you, and enough of a trail that you can walk away from a
|
||||
session and still pick up what it did.
|
||||
|
||||
**What bounds it:**
|
||||
|
||||
@@ -82,7 +83,9 @@ behind that you can walk away from a session and still pick up what it did.
|
||||
- **A PR and issue workflow the agent drives itself.** `gitea-pr` and
|
||||
`gitea-issue` let a session open pull requests and issues against Gitea or
|
||||
Forgejo and pull review feedback back in, on a token scoped for exactly
|
||||
that. Merging stays a human decision, made outside the sandbox.
|
||||
that; on GitHub the same work goes through `gh`, plus a `github-pr` for the
|
||||
one thing `gh` cannot do. Merging stays a human decision, made outside the
|
||||
sandbox.
|
||||
- **Project context written for the agent.** A project ships a `.dejima.md`
|
||||
saying how work is done in it - `CLAUDE.md`'s job under a harness-agnostic
|
||||
name - and dejima loads it alongside a briefing on where the session is,
|
||||
@@ -277,7 +280,7 @@ Ships today:
|
||||
|
||||
- **Forges:** `none`, `gitea`, `github`
|
||||
- **Workflows:** `local-only`, `branch-push`, `worktree-pr`
|
||||
- **Harnesses:** `claude-code`
|
||||
- **Harnesses:** `claude-code`, `cline`
|
||||
|
||||
The defaults are `forge = none` and `workflow = local-only`: a fresh install
|
||||
commits locally and pushes nowhere.
|
||||
@@ -297,16 +300,20 @@ sandbox escape if you get it wrong.
|
||||
|
||||
### Core (required)
|
||||
|
||||
1. **Install your harness on the host and sign in to it there**, before any
|
||||
of the rest. dejima never authenticates anything: the credential proxy
|
||||
holds the credential your harness wrote on the host and hands the
|
||||
container a placeholder, so if there is nothing on the host there is
|
||||
nothing to hold. A session in that state starts normally and then cannot
|
||||
reach the model, which looks like a dejima fault and is not one. See
|
||||
1. **Install your harness on the host**, before any of the rest, and sign in
|
||||
to it there if it needs a credential. dejima never authenticates
|
||||
anything: the credential proxy holds what your harness wrote on the host
|
||||
and hands the container a placeholder, so if there is nothing on the host
|
||||
there is nothing to hold. A session in that state starts normally and
|
||||
then cannot reach the model, which looks like a dejima fault and is not
|
||||
one. A harness pointed at a model you serve yourself needs no credential
|
||||
and none of this applies to it - see
|
||||
[Sign in on the host first](#sign-in-on-the-host-first).
|
||||
2. `./install.sh`: symlinks the CLIs into `~/.local/bin` and the hooks into
|
||||
`~/.claude/hooks`, and writes a starter `~/.config/dejima/config` if none
|
||||
exists yet. It is idempotent, so re-run it after pulling; it never
|
||||
2. `./install.sh`: symlinks the CLIs into `~/.local/bin`, writes a starter
|
||||
`~/.config/dejima/config` if none exists yet, and registers whatever guard
|
||||
hooks the harness you selected can host - into that harness's own config
|
||||
directory, and only for the one selected. A harness that hosts none says
|
||||
so and nothing is written. It is idempotent, so re-run it after pulling; it never
|
||||
overwrites an existing config.
|
||||
3. Put `~/.local/bin` on your `PATH` if it isn't already.
|
||||
That is enough to run `dejima`. No push credential is needed to get this far,
|
||||
@@ -359,19 +366,20 @@ the table below.
|
||||
|
||||
## Usage
|
||||
|
||||
Run `./install.sh` first; it symlinks the CLIs into `~/.local/bin` and the
|
||||
hooks into `~/.claude/hooks`, and everything below assumes those are on your
|
||||
`PATH`. See [Setup](#setup) for the rest of the first-run steps.
|
||||
Run `./install.sh` first; it symlinks the CLIs into `~/.local/bin`, and
|
||||
everything below assumes that is on your `PATH`. See [Setup](#setup) for the rest of the first-run steps.
|
||||
|
||||
```sh
|
||||
dejima # sandbox the current directory
|
||||
dejima ~/repos/some-project
|
||||
```
|
||||
|
||||
By default the container's entry point is bare `claude` (always running with
|
||||
`--dangerously-skip-permissions`, regardless of how it's invoked; see
|
||||
`docker/harness-wrapper.sh`), so a fresh clone of this repo works with no
|
||||
editor setup at all.
|
||||
The container's entry point is whatever the selected harness declares, always
|
||||
with that harness's own no-prompt flag applied regardless of how it is invoked
|
||||
(see `docker/harness-wrapper.sh`). There is no default: `[core] harness` has
|
||||
none and a launch is refused without it, which is what stops a later release
|
||||
changing your selection for you. Set it and a fresh clone of this repo works
|
||||
with no editor setup at all.
|
||||
|
||||
The loop, in the part every workflow shares: point it at a project, ask for a
|
||||
change, and let the session work. What happens after that is the workflow you
|
||||
@@ -472,6 +480,12 @@ So: run your harness once on the host, sign in, confirm it answers, and then
|
||||
point dejima at a project. When a credential expires, refresh it the same
|
||||
way - on the host, not in a session.
|
||||
|
||||
**None of this applies to a harness pointed at a model you serve yourself.**
|
||||
There is no credential, so there is nothing for the proxy to hold and nothing
|
||||
to expire; what that setup needs instead is for the endpoint to be reachable
|
||||
from inside the container, which is an allowlist question rather than a
|
||||
sign-in one.
|
||||
|
||||
## Config parity with your host Claude Code setup
|
||||
|
||||
Global `CLAUDE.md`, settings, hooks, skills, plugins and git identity all
|
||||
@@ -618,6 +632,15 @@ default it can never push there: GitHub's IP ranges are only allowlisted on
|
||||
port 443, so port 22 is physically unreachable, not merely discouraged by a
|
||||
hook.
|
||||
|
||||
That rests on **two** properties, and it is worth naming both because the
|
||||
sentence above stays readable if either one quietly stops being true. The
|
||||
allowlist decides what is reachable over IPv4. What makes port 22 unreachable
|
||||
*at all* is that the container also blocks IPv6 outright - an allowlist naming
|
||||
one address family says nothing about the other, and a session with IPv6 could
|
||||
reach GitHub's v6 ranges on any port it liked. `init-firewall.sh` refuses to
|
||||
start rather than run with IPv6 live and unfilterable, which is what holds the
|
||||
second half up.
|
||||
|
||||
Pass `--allow-github-push` to open port 22 for that one launch, paired with
|
||||
a repo-scoped deploy key in `[core] ssh_key` rather than a forwarded
|
||||
personal agent. The one exception is `[github] token_file`: pointed at a
|
||||
@@ -636,8 +659,8 @@ Two front doors and a notification path, none of which exist until you
|
||||
configure them.
|
||||
|
||||
It is documented separately because getting the bind address wrong is the one
|
||||
mistake here that exposes a `--dangerously-skip-permissions` shell to your
|
||||
network, and that deserves more room than a section.
|
||||
mistake here that exposes a no-prompt agent shell to your network, and that
|
||||
deserves more room than a section.
|
||||
|
||||
**→ [docs/remote-access.md](docs/remote-access.md)** - `[remote-access]`, picking a
|
||||
bind address and verifying it, the SSH and web front doors, reading and typing
|
||||
@@ -675,8 +698,8 @@ under `~/.claude/projects`. After the container exits it diffs them and tells
|
||||
you what changed.
|
||||
|
||||
It is **advisory, not a block**. It fires after the session has ended, so a
|
||||
finding is something to read and clean up before your next `git` or `claude`
|
||||
in that repo. Its diff is also time-windowed: it reports that a path changed
|
||||
finding is something to read and clean up before your next `git` command or
|
||||
session in that repo. Its diff is also time-windowed: it reports that a path changed
|
||||
while the session was running, not that the session changed it.
|
||||
|
||||
`dejima-audit show` indexes what is waiting; `dejima-audit ack` walks it,
|
||||
@@ -697,8 +720,9 @@ surface it watches, what it cannot see, and how the baseline works.
|
||||
|
||||
What this sandbox does and does not protect you from - the containment
|
||||
boundary, what a compromised session can still reach, the deliberate
|
||||
trade-offs behind `--dangerously-skip-permissions`, and why the exit-time
|
||||
audit's findings are a time window, not a verdict on who caused them.
|
||||
trade-offs behind running an agent with no permission prompts, and why the
|
||||
exit-time audit's findings are a time window, not a verdict on who caused
|
||||
them.
|
||||
|
||||
**→ [docs/security.md](docs/security.md)**
|
||||
|
||||
@@ -722,6 +746,7 @@ covers, and how to run them.
|
||||
| [responsible-use.md](docs/responsible-use.md) | How to use this without making things worse |
|
||||
| [security.md](docs/security.md) | Provider trust, the egress firewall, identity, and logging |
|
||||
| [threat-model.md](docs/threat-model.md) | What is assumed hostile, and where each layer's compromise stops |
|
||||
| [research-review.md](docs/research-review.md) | Checking the threat model against the field's, and the standing questions that are the agenda |
|
||||
| [configuration.md](docs/configuration.md) | Per-project declaration, dependencies, config parity |
|
||||
| [providers.md](docs/providers.md) | Forge, workflow and harness axes, and writing your own |
|
||||
| [ci.md](docs/ci.md) | What push access grants on your CI host, and how to bound it |
|
||||
|
||||
+388
-37
@@ -30,26 +30,34 @@ Usage: dejima [options] [workspace] [-- args...]
|
||||
-- args... everything after is passed to the harness command untouched
|
||||
|
||||
Options (each overrides the config file for one launch only):
|
||||
--forge <name> which forge integration to use for this launch
|
||||
--harness <name> which harness to run
|
||||
--forge <name> which forge integration to use
|
||||
--workflow <name> what the agent is told to do with its work
|
||||
--cmd <command> run this instead of the harness's own command
|
||||
--ro, --extra-readonly <path> also mount this host path read-only
|
||||
--rw, --extra-read-write <path> also mount this host path read-write
|
||||
--allow-github-push open GitHub's push path (port 22) for this launch
|
||||
--identity <name> which [identity.<name>] supplies the credentials
|
||||
-i, --include <tool> add an optional tool to this launch (repeatable);
|
||||
see docs/tools.md for what dejima ships
|
||||
--model <id> the selected harness's model, where it has one;
|
||||
--base-url <url> its endpoint, and how much context it may use.
|
||||
--context-window <n> Refused for a harness with no such setting
|
||||
--ro <path> mount read-only; --rw read-write. Repeatable. Long
|
||||
forms --extra-readonly and --extra-read-write. Both
|
||||
refuse a path overlapping dejima's own stores
|
||||
--allow-github-push open GitHub's push path (port 22)
|
||||
--strict-audit refuse to start over unacknowledged CRITICAL findings
|
||||
--no-log ship nothing to the log endpoint this launch
|
||||
--no-conversation keep this session's transcript out of the log
|
||||
--no-epitaph keep nothing if this session compacts
|
||||
--no-firewall disable the egress firewall entirely (debugging only)
|
||||
--print-config print the resolved configuration and exit
|
||||
--print-briefing print the session briefing the agent will get, and exit
|
||||
--print-briefing print the briefing the agent will get, and exit
|
||||
-h, --help this message
|
||||
|
||||
--ro and --rw may be given more than once. Both refuse a path that overlaps
|
||||
dejima's own approval, audit or epitaph stores.
|
||||
Every --no-* flag only ever narrows. Nothing here turns a setting back on: a
|
||||
config that says off is a decision, not a default to override in passing.
|
||||
|
||||
Configuration lives in ~/.config/dejima/config and [core] harness must be set
|
||||
before a launch will start. --print-config shows what is actually in effect,
|
||||
including which flag overrode which key.
|
||||
|
||||
See docs/configuration.md for every key, docs/security.md for what the
|
||||
container can and cannot reach.
|
||||
Config lives in ~/.config/dejima/config and [core] harness must be set before
|
||||
a launch starts. --print-config prints every key as it resolves.
|
||||
DEJIMA_HELP
|
||||
exit 0 ;;
|
||||
esac
|
||||
@@ -111,10 +119,14 @@ fi
|
||||
FLAG_OVERRIDES=()
|
||||
_set_override() {
|
||||
local key="$1" value="$2" type entry
|
||||
# $3 is the flag to blame, for the flags whose spelling is not their key's:
|
||||
# --context-window sets context_window, and reporting the key back would
|
||||
# name an option the operator cannot type.
|
||||
local flag="${3:---${1##*.}}"
|
||||
local -a kept=()
|
||||
type="$(config_type "$key")" || { echo "unknown config key: $key" >&2; exit 1; }
|
||||
if ! _config_valid_value "$type" "$value"; then
|
||||
echo "invalid value for --${key##*.}: $value" >&2
|
||||
echo "invalid value for $flag: $value" >&2
|
||||
exit 1
|
||||
fi
|
||||
# A repeated flag takes the last value, same as a repeated key in the
|
||||
@@ -190,9 +202,26 @@ _mount_label() {
|
||||
esac
|
||||
}
|
||||
|
||||
# A flag naming one of the SELECTED harness's keys, deferred because which
|
||||
# harness is selected is not known until every flag has been read - --harness
|
||||
# may come after --model. Recorded here, resolved below the loop.
|
||||
#
|
||||
# Deferred rather than resolved eagerly so the error can name the harness:
|
||||
# "claude-code has no model setting" is actionable where "unknown config key"
|
||||
# is not.
|
||||
HARNESS_KEY_FLAGS=()
|
||||
_defer_harness_key() {
|
||||
HARNESS_KEY_FLAGS+=("$1=$2=$3")
|
||||
}
|
||||
|
||||
PRINT_CONFIG=0
|
||||
PRINT_BRIEFING=0
|
||||
ALLOW_GITHUB_PUSH_FLAG=0
|
||||
# Additive, like --ro and --rw and unlike every other flag here: an optional
|
||||
# tool asked for on the command line is one MORE than the config and the
|
||||
# project already agreed on, not a replacement for them. Repeatable.
|
||||
TOOL_FLAGS=()
|
||||
NO_LOG=0
|
||||
while [ $# -gt 0 ]; do
|
||||
case "$1" in
|
||||
--) shift; break ;;
|
||||
@@ -200,8 +229,27 @@ while [ $# -gt 0 ]; do
|
||||
--print-briefing) PRINT_BRIEFING=1; shift ;;
|
||||
--no-firewall) _set_override core.firewall off; shift ;;
|
||||
--allow-github-push) ALLOW_GITHUB_PUSH_FLAG=1; shift ;;
|
||||
# Narrowing flags. Each has no counterpart that turns the setting back
|
||||
# on: a config saying off is a decision, and a flag that could undo it
|
||||
# in passing would make the file's answer the weaker one.
|
||||
--strict-audit) _set_override audit.strict on; shift ;;
|
||||
--no-epitaph) _set_override epitaph.enabled off; shift ;;
|
||||
--no-conversation) _set_override logging.conversation off; shift ;;
|
||||
--no-log) _set_override logging.loki_url ""
|
||||
_set_override logging.conversation off
|
||||
NO_LOG=1; shift ;;
|
||||
--model) _need_value --model "${2:-}"
|
||||
_defer_harness_key --model model "$2"; shift 2 ;;
|
||||
--base-url) _need_value --base-url "${2:-}"
|
||||
_defer_harness_key --base-url base_url "$2"; shift 2 ;;
|
||||
--context-window) _need_value --context-window "${2:-}"
|
||||
_defer_harness_key --context-window context_window "$2"; shift 2 ;;
|
||||
--cmd) _need_value --cmd "${2:-}"; _set_override core.command "$2"; shift 2 ;;
|
||||
--harness) _need_value --harness "${2:-}"; _set_override core.harness "$2"; shift 2 ;;
|
||||
--identity) _need_value --identity "${2:-}"; _set_override core.identity "$2"; shift 2 ;;
|
||||
--include|-i)
|
||||
_need_value --include "${2:-}"
|
||||
TOOL_FLAGS+=("$2"); shift 2 ;;
|
||||
--forge) _need_value --forge "${2:-}"; _set_override core.forge "$2"; shift 2 ;;
|
||||
--workflow) _need_value --workflow "${2:-}"; _set_override core.workflow "$2"; shift 2 ;;
|
||||
--extra-readonly|--ro)
|
||||
@@ -219,15 +267,52 @@ done
|
||||
# Defined here rather than in the library because an override is a property
|
||||
# of one invocation of this launcher, not of the config file.
|
||||
config_get() {
|
||||
local key="$1.$2" entry
|
||||
local key="$1.$2" entry value
|
||||
for entry in ${FLAG_OVERRIDES[@]+"${FLAG_OVERRIDES[@]}"}; do
|
||||
[ "${entry%%=*}" = "$key" ] || continue
|
||||
printf '%s' "${entry#*=}"
|
||||
return 0
|
||||
done
|
||||
# The selected identity, for the handful of keys an identity owns: the
|
||||
# credentials and the ssh key a PERSON brings, which is the half a shared
|
||||
# project file cannot carry. Below a flag, because a flag is this launch
|
||||
# and an identity is this project; above the file, because the file is the
|
||||
# machine's default and naming an identity is how you say "not that one".
|
||||
#
|
||||
# Every consumer goes through config_get, including forge_env_exports in
|
||||
# the library, so this one wrapper is the whole insertion point.
|
||||
if value="$(identity_get "$1" "$2")"; then
|
||||
printf '%s' "$value"
|
||||
return 0
|
||||
fi
|
||||
_config_get_from_file "$1" "$2"
|
||||
}
|
||||
|
||||
# The deferred harness-key flags, now that --harness has been read and
|
||||
# config_get honours it. A key the selected harness does not declare is
|
||||
# refused by name rather than ignored: a --model that silently did nothing
|
||||
# because the harness has no such setting is the failure worth avoiding, and
|
||||
# it is the whole reason these are not resolved inside the loop above.
|
||||
if [ "${#HARNESS_KEY_FLAGS[@]}" -gt 0 ]; then
|
||||
_flag_harness="$(config_get core harness)"
|
||||
for _entry in "${HARNESS_KEY_FLAGS[@]}"; do
|
||||
_flag="${_entry%%=*}"
|
||||
_rest="${_entry#*=}"
|
||||
_key="${_rest%%=*}"
|
||||
_value="${_rest#*=}"
|
||||
if [ -z "$_flag_harness" ]; then
|
||||
echo "$_flag needs a harness: set [core] harness or pass --harness." >&2
|
||||
exit 1
|
||||
fi
|
||||
if ! config_type "harness.$_flag_harness.$_key" >/dev/null 2>&1; then
|
||||
echo "the $_flag_harness harness has no '$_key' setting, so $_flag does not apply to it." >&2
|
||||
exit 1
|
||||
fi
|
||||
_set_override "harness.$_flag_harness.$_key" "$_value" "$_flag"
|
||||
done
|
||||
unset _flag_harness _entry _flag _rest _key _value
|
||||
fi
|
||||
|
||||
# Retired environment variables. Named, never honoured: silently ignoring an
|
||||
# exported LOKI_URL means logs stop shipping with nothing saying why, and
|
||||
# silently ignoring SANDBOX_ANTHROPIC_TRANSPORT means a session quietly gets
|
||||
@@ -356,6 +441,18 @@ fi
|
||||
# testable without booting Docker.
|
||||
if [ "$PRINT_CONFIG" = 1 ]; then
|
||||
config_validate || exit 1
|
||||
# Before printing, not only before launching. Every value below resolves
|
||||
# THROUGH the identity, so printing them under a name that resolves to
|
||||
# nothing would show this machine's own credentials as though they were
|
||||
# the identity's - the exact confusion the refusal exists to prevent, in
|
||||
# the one command an operator runs to check what they configured.
|
||||
_identity=""
|
||||
config_exists && { _identity="$(config_get core identity)" || _identity=""; }
|
||||
if [ -n "$_identity" ] && ! identity_exists "$_identity"; then
|
||||
echo "[core] identity is '$_identity', and no [identity.$_identity] section sets" >&2
|
||||
echo "anything in $(config_path)." >&2
|
||||
exit 1
|
||||
fi
|
||||
while IFS= read -r _key; do
|
||||
_section="${_key%.*}"
|
||||
_leaf="${_key##*.}"
|
||||
@@ -457,6 +554,44 @@ case " $_corpus_approved " in
|
||||
esac
|
||||
unset _corpus_approved
|
||||
|
||||
# The optional tools this launch has: [core] tools, plus whatever the project
|
||||
# declared AND the operator approved, plus --include. A union rather than a
|
||||
# precedence chain, because each of the three answers a different question -
|
||||
# what this machine always wants, what this project needs, what this run is
|
||||
# for - and none of them is a correction of another.
|
||||
#
|
||||
# The project's half comes from the APPROVAL STORE and never from the
|
||||
# declaration in the workspace, for the reason the corpus block above gives:
|
||||
# that file is session-writable, and a session that could add a tool would be
|
||||
# choosing what the next session's image contains. This file may not name that
|
||||
# directory at all, and a static test holds it to that - which is why the path
|
||||
# is not spelled out here.
|
||||
#
|
||||
# Every name is checked against a manifest that exists before it reaches the
|
||||
# image build. approved_entries already refuses an entry its validator does
|
||||
# not accept, so the only unchecked source is the flag - which is the
|
||||
# operator's own typing, and gets the same answer.
|
||||
DEJIMA_TOOLS=""
|
||||
_tools_wanted="$(config_get core tools | tr ':' ' ')"
|
||||
_tools_wanted="$_tools_wanted $(approved_entries "$(config_root)" tools | tr '\n' ' ')"
|
||||
if [ -n "$PROJECT_STORE" ]; then
|
||||
_tools_wanted="$_tools_wanted $(approved_entries "$PROJECT_STORE" tools | tr '\n' ' ')"
|
||||
fi
|
||||
_tools_wanted="$_tools_wanted ${TOOL_FLAGS[*]-}"
|
||||
for _tool in $_tools_wanted; do
|
||||
[ -n "$_tool" ] || continue
|
||||
case " $DEJIMA_TOOLS " in *" $_tool "*) continue ;; esac
|
||||
if ! valid_tool_name "$_tool"; then
|
||||
echo "no optional tool named '$_tool'." >&2
|
||||
echo "Available: $(provider_list tool | tr '\n' ' ')" >&2
|
||||
echo "See docs/tools.md." >&2
|
||||
exit 1
|
||||
fi
|
||||
tool_validate "$_tool" || exit 1
|
||||
DEJIMA_TOOLS="${DEJIMA_TOOLS:+$DEJIMA_TOOLS }$_tool"
|
||||
done
|
||||
unset _tools_wanted _tool
|
||||
|
||||
|
||||
AUDIT_DIR="$(config_get audit dir)"
|
||||
BASELINE_DIR="$(config_get audit baselines_dir)"
|
||||
@@ -671,6 +806,41 @@ if [ -n "$_disclose_spec" ]; then
|
||||
IFS="$_old_ifs"
|
||||
fi
|
||||
|
||||
# How this forge's CLI can be aimed somewhere other than the repository the
|
||||
# session was launched against, and what that repository is (#187).
|
||||
#
|
||||
# A CLI that resolves the repo from origin and refuses another host cannot be
|
||||
# aimed anywhere and declares nothing here. One that takes the repository as
|
||||
# an option makes acting on an unrelated repository the same length of command
|
||||
# as acting on this one. Which is which is the forge's to declare; core only
|
||||
# resolves the repository the declaration is compared against, and
|
||||
# docker/forge-guard.sh does the comparing.
|
||||
#
|
||||
# The last two path components of origin's URL, which is the same
|
||||
# "<owner>/<name>" both forges use and covers ssh, scp-style and https
|
||||
# remotes without parsing any of them as a URL. No origin, or a workspace
|
||||
# that is not a checkout, leaves this empty - and the guard then refuses any
|
||||
# --repo or GH_REPO outright rather than waving it through. A workspace with
|
||||
# no origin has nothing such a flag could legitimately name, so "cannot
|
||||
# confirm" is not a reason to allow it.
|
||||
DEJIMA_FORGE_REPO_FLAGS="$(manifest_get forge "$DEJIMA_FORGE_NAME" repo_flags)"
|
||||
DEJIMA_FORGE_REPO_ENV="$(manifest_get forge "$DEJIMA_FORGE_NAME" repo_env)"
|
||||
DEJIMA_FORGE_REPO=""
|
||||
if [ -n "$DEJIMA_FORGE_REPO_FLAGS" ] || [ -n "$DEJIMA_FORGE_REPO_ENV" ]; then
|
||||
_origin_url="$(git -C "$WORKSPACE_DIR" remote get-url origin 2>/dev/null)" || _origin_url=""
|
||||
if [ -n "$_origin_url" ]; then
|
||||
_origin_url="${_origin_url%/}"
|
||||
_origin_url="${_origin_url%.git}"
|
||||
_origin_name="${_origin_url##*/}"
|
||||
_origin_rest="${_origin_url%/*}"
|
||||
_origin_owner="${_origin_rest##*[:/]}"
|
||||
if [ -n "$_origin_owner" ] && [ -n "$_origin_name" ] &&
|
||||
[ "$_origin_owner" != "$_origin_url" ]; then
|
||||
DEJIMA_FORGE_REPO="$_origin_owner/$_origin_name"
|
||||
fi
|
||||
fi
|
||||
fi
|
||||
|
||||
# WORKSPACE_DIR is resolved above, ahead of --print-briefing, since
|
||||
# briefing_compose needs DEJIMA_RW_MOUNTS (which needs WORKSPACE_DIR for its
|
||||
# own overlap guard) before that point.
|
||||
@@ -878,6 +1048,7 @@ SANDBOX_DERIVED_CONTEXT=""
|
||||
SANDBOX_CONVERSATION_SHIP_PID=""
|
||||
SANDBOX_TTY_SUSPEND_PID=""
|
||||
SANDBOX_TTY_MODES=""
|
||||
SANDBOX_CLIENT_PID=""
|
||||
|
||||
# Names each host-side task in cleanup() as it starts. Between the container
|
||||
# exiting and the operator's shell prompt returning, dejima audits every
|
||||
@@ -924,13 +1095,15 @@ cleanup() {
|
||||
# rather than dying with the batch. Reaped for the same reason the proxy
|
||||
# is: an unreaped child reparents to PID 1 and stays a zombie wherever
|
||||
# PID 1 does not reap.
|
||||
# The terminal first, and its settings before its watcher: the container
|
||||
# run restores what it saved when it attached, but a run that was killed
|
||||
# rather than exited restores nothing, and what it would leave behind is a
|
||||
# terminal where Ctrl-C is undefined. Cheap, and only does anything when
|
||||
# there was a terminal to save.
|
||||
# The terminal first, and its settings before their watcher: the
|
||||
# container run restores what it saved when it attached, but a run that
|
||||
# was killed rather than exited restores nothing, and what that leaves
|
||||
# behind is a terminal with no interrupt character.
|
||||
if [ -n "${SANDBOX_TTY_MODES:-}" ]; then
|
||||
stty "$SANDBOX_TTY_MODES" < /dev/tty 2>/dev/null || true
|
||||
# And the cursor, for the same reason the modes are restored here: a
|
||||
# run that was killed rather than exited put neither back.
|
||||
printf '\033[?25h' > /dev/tty 2>/dev/null || true
|
||||
fi
|
||||
if [ -n "${SANDBOX_TTY_SUSPEND_PID:-}" ]; then
|
||||
kill "$SANDBOX_TTY_SUSPEND_PID" 2>/dev/null || true
|
||||
@@ -984,7 +1157,20 @@ cleanup() {
|
||||
# Ahead of the audit rather than after it, so the audit keeps the last
|
||||
# word (see below): this prints a line of its own whenever it keeps
|
||||
# something, and that line was landing under the verdict.
|
||||
"$SCRIPT_DIR/dejima-epitaph" save "$WORKSPACE_DIR" || true
|
||||
# Gated here as well as inside the tool, because a flag override lives in
|
||||
# this process and the tool re-reads the config for itself - it is also
|
||||
# run by hand, where an environment this launcher happened to have would
|
||||
# be the wrong authority. Same reason the shipper is gated at its start.
|
||||
#
|
||||
# DEJIMA_EPITAPH_NO_SHIP carries the one part of --no-log that this
|
||||
# process cannot decide for the tool: whether to push what it kept. It
|
||||
# only ever suppresses, so a stale export makes epitaph quieter and never
|
||||
# louder, which is what makes it safe to honour from the environment at
|
||||
# all.
|
||||
if [ "$(config_get_bool epitaph enabled)" = "1" ]; then
|
||||
DEJIMA_EPITAPH_NO_SHIP="$NO_LOG" \
|
||||
"$SCRIPT_DIR/dejima-epitaph" save "$WORKSPACE_DIR" || true
|
||||
fi
|
||||
# Last writer, structurally: the operator reads bottom-up from their
|
||||
# shell prompt, so anything printed after the verdict pushes it out of
|
||||
# view. The marker-directory warning above is the one line a session can
|
||||
@@ -1019,6 +1205,23 @@ if [ -f "$HOME/.gitconfig" ]; then
|
||||
else
|
||||
touch "$SANDBOX_GITCONFIG_DIR/.gitconfig"
|
||||
fi
|
||||
# The selected identity's git name, appended to the COPY. Appended rather than
|
||||
# rewritten because git takes the last value for a key, so this needs no
|
||||
# knowledge of what the operator's own file already says - and because the
|
||||
# copy is the only thing being edited, the real ~/.gitconfig is untouched
|
||||
# whatever happens here.
|
||||
#
|
||||
# `git config -f` rather than a printf of "[user]\n\tname = ...": the value is
|
||||
# the operator's own text, and git quotes and escapes its own file format
|
||||
# correctly where a printf would produce something git reads differently the
|
||||
# moment a name contains a quote or a backslash.
|
||||
for _git_field in name email; do
|
||||
_git_value="$(identity_git_field "user_$_git_field")" || _git_value=""
|
||||
[ -n "$_git_value" ] || continue
|
||||
git config -f "$SANDBOX_GITCONFIG_DIR/.gitconfig" "user.$_git_field" "$_git_value" \
|
||||
|| { echo "could not set user.$_git_field from [identity] - is git installed?" >&2; exit 1; }
|
||||
done
|
||||
unset _git_field _git_value
|
||||
|
||||
export WORKSPACE_DIR
|
||||
# The image's user is built to match this uid/gid/username exactly (see
|
||||
@@ -1062,8 +1265,8 @@ export TZ="${TZ:-$(readlink -f /etc/localtime 2>/dev/null | sed 's#.*/zoneinfo/#
|
||||
|
||||
# core.command permits a leading "-" (it is validated as a generic identifier,
|
||||
# shared with other keys that have no such concern) but entrypoint.sh expands
|
||||
# it unquoted into `gosu "$SANDBOX_USER" ${SANDBOX_CMD:-claude} "$@"` - a
|
||||
# leading dash there would be parsed as an option to gosu, not as the command.
|
||||
# it unquoted into `gosu "$SANDBOX_USER" $SANDBOX_CMD "$@"` - a leading dash
|
||||
# there would be parsed as an option to gosu, not as the command.
|
||||
# Refuse here, at the point this value is wired in, rather than relax the
|
||||
# schema type for every other identifier-typed key.
|
||||
SANDBOX_CMD="$(config_get core command)"
|
||||
@@ -1169,8 +1372,26 @@ LOKI_URL="$(config_get logging loki_url)"; export LOKI_URL
|
||||
extra_mounts=()
|
||||
|
||||
# The forge's own env vars, generated from its manifest's env_export list
|
||||
# rather than hardcoded - see forge_env_exports. -e here: passed straight
|
||||
# through to `docker compose run`, which takes -e alongside -v.
|
||||
# rather than hardcoded - see forge_env_exports.
|
||||
#
|
||||
# `-e NAME`, never `-e NAME=value`, for the ones that carry a secret - which
|
||||
# is every `@` reference, since those resolve to a credential FILE'S CONTENTS
|
||||
# rather than its path. A value in the argument list lands in
|
||||
# /proc/<pid>/cmdline, which is world-readable: `ps` prints the token to any
|
||||
# process on the host, and from there into whatever captures ps output. That
|
||||
# is not a hypothetical - it is how #226 was found, in a paste an operator
|
||||
# made while debugging something unrelated.
|
||||
#
|
||||
# The bare form takes the value from THIS process's environment instead,
|
||||
# where it sits in /proc/<pid>/environ - mode 0400, owner only.
|
||||
#
|
||||
# This repository already made the argument one layer down: a forge's own CLI
|
||||
# feeds curl its auth header on stdin rather than as an argument, and says why
|
||||
# in almost these words. The reasoning was right and it had not reached here.
|
||||
#
|
||||
# Docker still shows the resolved value to anyone who can `docker inspect`
|
||||
# the container, which the bare form does not change and cannot. What it
|
||||
# changes is the audience: daemon access rather than any process at all.
|
||||
_forge_env_lines=""
|
||||
if ! _forge_env_lines="$(forge_env_exports "$DEJIMA_FORGE_NAME")"; then
|
||||
# forge_env_exports has already explained why on stderr. It can fail
|
||||
@@ -1180,8 +1401,15 @@ if ! _forge_env_lines="$(forge_env_exports "$DEJIMA_FORGE_NAME")"; then
|
||||
fi
|
||||
while IFS= read -r _forge_env; do
|
||||
[ -n "$_forge_env" ] || continue
|
||||
extra_mounts+=(-e "$_forge_env")
|
||||
# forge_env_exports emits nothing at all for a value that resolved empty,
|
||||
# deliberately - see its own comment on why an empty -e for a variable
|
||||
# compose already declares is not harmless. So every name reaching here
|
||||
# has a value, and exporting it is what makes the bare -e below carry one.
|
||||
_forge_env_name="${_forge_env%%=*}"
|
||||
export "${_forge_env_name}=${_forge_env#*=}"
|
||||
extra_mounts+=(-e "$_forge_env_name")
|
||||
done <<< "$_forge_env_lines"
|
||||
unset _forge_env_name
|
||||
|
||||
# The resolved combination, for the briefing and the hooks that read it
|
||||
# (git-push-guard.sh's host allowlist and no-direct-push branches,
|
||||
@@ -1195,6 +1423,9 @@ extra_mounts+=(-e "DEJIMA_PUSH_HOSTS=$DEJIMA_PUSH_HOSTS")
|
||||
extra_mounts+=(-e "DEJIMA_BLOCKED_BRANCHES=$DEJIMA_BLOCKED_BRANCHES")
|
||||
extra_mounts+=(-e "DEJIMA_MERGE_BLOCK=$DEJIMA_MERGE_BLOCK")
|
||||
extra_mounts+=(-e "DEJIMA_DISCLOSE=$DEJIMA_DISCLOSE")
|
||||
extra_mounts+=(-e "DEJIMA_FORGE_REPO=$DEJIMA_FORGE_REPO")
|
||||
extra_mounts+=(-e "DEJIMA_FORGE_REPO_FLAGS=$DEJIMA_FORGE_REPO_FLAGS")
|
||||
extra_mounts+=(-e "DEJIMA_FORGE_REPO_ENV=$DEJIMA_FORGE_REPO_ENV")
|
||||
|
||||
# The harness's own configuration, mounted at the mode it declared, and -
|
||||
# for the directories it marked scannable - the symlink targets that have to
|
||||
@@ -1663,6 +1894,12 @@ if ! _unwired="$(harness_guards_wired)"; then
|
||||
printf ' Run %s./install.sh%s to register them.\n' "$C_KEY" "$C_RESET" >&2
|
||||
fi
|
||||
|
||||
# Before the image build, which is the long part: an operator who wants the
|
||||
# newer dejima would rather know now than after waiting for a build of the one
|
||||
# they have. Advisory and best-effort - see bin/dejima-update-check for why it
|
||||
# never reaches the remote through this checkout's own git config.
|
||||
"$SCRIPT_DIR/dejima-update-check" || true
|
||||
|
||||
# Snapshot host-persistence surfaces so the post-run audit can report
|
||||
# anything that changed while this session ran (advisory - see bin/dejima-audit).
|
||||
"$SCRIPT_DIR/dejima-audit" snapshot "$WORKSPACE_DIR" "$SANDBOX_AUDIT_STATE" || true
|
||||
@@ -1729,6 +1966,7 @@ SANDBOX_HARNESS_IMAGE_FILES="$(manifest_get harness "$DEJIMA_HARNESS_NAME" image
|
||||
|
||||
if [ -n "$SANDBOX_HARNESS_INSTALL" ] || [ -n "$SANDBOX_HARNESS_IMAGE_DIRS" ] \
|
||||
|| [ -n "$SANDBOX_HARNESS_IMAGE_ENV" ] || [ -n "$SANDBOX_HARNESS_IMAGE_FILES" ] \
|
||||
|| [ -n "$DEJIMA_TOOLS" ] \
|
||||
|| [ -s "$(config_root)/dependencies" ] \
|
||||
|| { [ -n "$PROJECT_STORE" ] && [ -s "$PROJECT_STORE/dependencies" ]; }; then
|
||||
SANDBOX_DERIVED_DOCKERFILE="$(mktemp "${TMPDIR:-/tmp}/dejima-derived.XXXXXX")"
|
||||
@@ -1757,6 +1995,34 @@ if [ -n "$SANDBOX_HARNESS_INSTALL" ] || [ -n "$SANDBOX_HARNESS_IMAGE_DIRS" ] \
|
||||
SANDBOX_IMAGE="$tag"
|
||||
fi
|
||||
|
||||
# One layer per tool, above the harness and below the dependencies. Above the
|
||||
# harness because a tool is meant to be on PATH for it; below the operator's
|
||||
# own dependencies because those are the last word on what the image holds.
|
||||
#
|
||||
# Tagged by name and version-of-spec so two projects wanting the same tool
|
||||
# share a layer, and a manifest that changes what it installs gets a new one
|
||||
# rather than a stale cached hit.
|
||||
for _tool in $DEJIMA_TOOLS; do
|
||||
_tool_install="$(manifest_get tool "$_tool" install)"
|
||||
_tool_env="$(manifest_get tool "$_tool" image_env)"
|
||||
_tool_layout="$(manifest_get tool "$_tool" install_layout)"
|
||||
tag="dejima:${SANDBOX_USER}-tool-${_tool}-$(printf '%s' "$_tool_install" | sha256sum | cut -c1-12)"
|
||||
DEJIMA_TARBALL_STRIP="$_tool_layout" \
|
||||
generate_spec_dockerfile "$SANDBOX_IMAGE" "$_tool_install" "" "$_tool_env" "" \
|
||||
> "$SANDBOX_DERIVED_DOCKERFILE"
|
||||
echo "Building $tag ($_tool: $(manifest_get tool "$_tool" description))..."
|
||||
if ! docker build -t "$tag" -f "$SANDBOX_DERIVED_DOCKERFILE" "$SANDBOX_DERIVED_CONTEXT"; then
|
||||
# No fallback, for the reason the harness layer gives: a session told
|
||||
# it has a tool and given an image without one fails inside the
|
||||
# container, where it reads as dejima being broken.
|
||||
echo "Failed to build $tag." >&2
|
||||
echo "$_tool installs from: $_tool_install" >&2
|
||||
exit 1
|
||||
fi
|
||||
SANDBOX_IMAGE="$tag"
|
||||
done
|
||||
unset _tool _tool_install _tool_env _tool_layout
|
||||
|
||||
if [ -s "$(config_root)/dependencies" ]; then
|
||||
build_dep_layer "dejima:${SANDBOX_USER}-global" "$(config_root)"
|
||||
fi
|
||||
@@ -1854,23 +2120,108 @@ compose_status=0
|
||||
#
|
||||
# `|| true` and a backgrounded start: shipping is a bonus on top of the
|
||||
# session, so a shipper that cannot start must not stop the session running.
|
||||
"$SCRIPT_DIR/dejima-conversation-ship" "$WORKSPACE_DIR" &
|
||||
SANDBOX_CONVERSATION_SHIP_PID=$!
|
||||
#
|
||||
# Gated here as well as inside the shipper, which checks the same two keys for
|
||||
# itself: --no-conversation and --no-log are overrides held in this process,
|
||||
# and the shipper re-reads the config rather than inheriting them.
|
||||
if [ "$(config_get_bool logging conversation)" = "1" ] &&
|
||||
[ -n "$(config_get logging loki_url)" ]; then
|
||||
"$SCRIPT_DIR/dejima-conversation-ship" "$WORKSPACE_DIR" &
|
||||
SANDBOX_CONVERSATION_SHIP_PID=$!
|
||||
fi
|
||||
|
||||
# Ctrl-Z, which without this is not a signal at all: the container run puts
|
||||
# the terminal in raw mode, so 0x1a is delivered into the container, where a
|
||||
# harness that implements suspend stops itself with no job-control shell in
|
||||
# there to continue it. See bin/dejima-tty-suspend and #179. Started here so
|
||||
# that the terminal is only altered while a session is on it, and backgrounded
|
||||
# into this same process group so the kernel stops and continues it with
|
||||
# everything else.
|
||||
# Ctrl-Z (#179). Two things have to be true at once, and the second is the
|
||||
# one that took four rounds of measurement to find.
|
||||
#
|
||||
# The keystroke has to become a signal at all. Under a container run the
|
||||
# terminal is raw, ISIG is off, and Ctrl-Z is the byte 0x1a delivered into the
|
||||
# container - where a harness that implements suspend stops itself, with no
|
||||
# job-control shell in there to continue it. dejima-tty-suspend takes that one
|
||||
# character back for the host.
|
||||
#
|
||||
# And the container client must never receive SIGTSTP. Measured, holding
|
||||
# everything else equal: the client survives SIGSTOP and does not survive
|
||||
# SIGTSTP. A catchable stop signal interrupts the read it is blocked in, its
|
||||
# input forwarding never recovers, and the session comes back alive but deaf -
|
||||
# resumed, with nothing typed reaching the harness. That is what shipped once
|
||||
# and had to be taken out again.
|
||||
#
|
||||
# So the client is started with SIGTSTP ignored, which it inherits and keeps
|
||||
# across exec, and the launcher converts the keystroke into an explicit
|
||||
# SIGSTOP for it before stopping itself. The job still stops completely, so
|
||||
# the prompt comes back; the client is stopped by a signal that interrupts
|
||||
# nothing.
|
||||
#
|
||||
# < /dev/tty because a background command is given /dev/null for stdin, and a
|
||||
# container client with no terminal reads EOF and exits at once.
|
||||
SANDBOX_TTY_MODES="$(stty -g < /dev/tty 2>/dev/null)" || SANDBOX_TTY_MODES=""
|
||||
if [ -n "$SANDBOX_TTY_MODES" ]; then
|
||||
"$SCRIPT_DIR/dejima-tty-suspend" &
|
||||
SANDBOX_TTY_SUSPEND_PID=$!
|
||||
fi
|
||||
|
||||
docker compose -f "$COMPOSE_FILE" run --rm ${extra_mounts[@]+"${extra_mounts[@]}"} sandbox "$@" || compose_status=$?
|
||||
trap '' TSTP
|
||||
docker compose -f "$COMPOSE_FILE" run --rm ${extra_mounts[@]+"${extra_mounts[@]}"} sandbox "$@" < /dev/tty &
|
||||
SANDBOX_CLIENT_PID=$!
|
||||
trap - TSTP
|
||||
|
||||
# The pid $! names is the docker CLI; `docker compose run` then runs the
|
||||
# compose plugin as a child of it, and the child is what holds the
|
||||
# terminal. Stopping only the pid leaves that child in raw mode with the
|
||||
# shell also on the terminal - a cursorless prompt that resumes to
|
||||
# nothing, which is what the first version of this fix produced.
|
||||
#
|
||||
# Deepest first, so nothing is left running long enough to fork again;
|
||||
# shallowest first on the way back, so a parent is ready before its child
|
||||
# resumes.
|
||||
_stop_tree() {
|
||||
local p="$1" kid
|
||||
for kid in $(pgrep -P "$p" 2>/dev/null); do _stop_tree "$kid"; done
|
||||
kill -STOP "$p" 2>/dev/null || true
|
||||
}
|
||||
_cont_tree() {
|
||||
local p="$1" kid
|
||||
kill -CONT "$p" 2>/dev/null || true
|
||||
for kid in $(pgrep -P "$p" 2>/dev/null); do _cont_tree "$kid"; done
|
||||
}
|
||||
|
||||
_on_tstp() {
|
||||
_stop_tree "$SANDBOX_CLIENT_PID"
|
||||
# Show the cursor again. A full-screen harness hides it (DECTCEM,
|
||||
# \033[?25l) and puts it back when it exits - but a suspend is not an
|
||||
# exit, so the shell prompt inherits an invisible cursor and the
|
||||
# terminal looks like a connection that died. The harness hides it
|
||||
# again on resume, when the SIGWINCH below makes it repaint.
|
||||
printf '\033[?25h' > /dev/tty 2>/dev/null || true
|
||||
# Default disposition to actually stop, then put the handler back for
|
||||
# the next time. Everything after the re-raise runs on resume.
|
||||
trap - TSTP
|
||||
kill -TSTP $$
|
||||
trap _on_tstp TSTP
|
||||
_cont_tree "$SANDBOX_CLIENT_PID"
|
||||
}
|
||||
trap _on_tstp TSTP
|
||||
|
||||
# Looped because `wait` returns early when a trap runs, which is exactly
|
||||
# what happens on every suspend.
|
||||
while kill -0 "$SANDBOX_CLIENT_PID" 2>/dev/null; do
|
||||
if wait "$SANDBOX_CLIENT_PID"; then
|
||||
compose_status=0
|
||||
else
|
||||
compose_status=$?
|
||||
fi
|
||||
# 128+n means a signal interrupted the wait rather than the client
|
||||
# exiting; anything else is the client's own status.
|
||||
case "$compose_status" in
|
||||
146|148) continue ;;
|
||||
esac
|
||||
break
|
||||
done
|
||||
trap - TSTP
|
||||
else
|
||||
# No terminal - a CI job, or output redirected. Nothing to suspend, and
|
||||
# /dev/tty would not open.
|
||||
docker compose -f "$COMPOSE_FILE" run --rm ${extra_mounts[@]+"${extra_mounts[@]}"} sandbox "$@" || compose_status=$?
|
||||
fi
|
||||
if [ -n "${SANDBOX_ANTHROPIC_PROXY_PID:-}" ] && ! kill -0 "$SANDBOX_ANTHROPIC_PROXY_PID" 2>/dev/null; then
|
||||
echo "Warning: the credential proxy exited before the session ended - API calls in" >&2
|
||||
echo "the session may have been failing. Check for proxy errors in the output above." >&2
|
||||
|
||||
+41
-3
@@ -32,6 +32,8 @@ Scope, which decides who the grant is for and how long it lasts:
|
||||
if exactly one is running; refuses if none or several.
|
||||
--container <id> the same, for a named container. Use this when a session
|
||||
told you its own id rather than letting anything guess.
|
||||
With several running, they are listed by project and by
|
||||
the number the dejima-attach picker gives each one.
|
||||
--project [path] every future session in one project. Also writes the domain
|
||||
to that project's .dejima/allowed-domains, so it is shared
|
||||
with everyone working on it. Path defaults to $PWD.
|
||||
@@ -129,25 +131,61 @@ fi
|
||||
# This is the only thing that decides. Deliberately not an environment
|
||||
# variable as well: a firewall CLI with an environment-triggered no-op path
|
||||
# is one an env var can silently disarm.
|
||||
# A container list an operator can act on without asking the agent anything.
|
||||
#
|
||||
# The name alone is a run id, which is exactly what someone with three
|
||||
# sessions open does not know. What they do know is which project each one is
|
||||
# working on, and - where remote access is on - the number the dejima-attach
|
||||
# picker gives it, because that is the list they are already reading.
|
||||
#
|
||||
# The project comes from the container's own working directory rather than
|
||||
# from the session registry, so it is there for every session and not only a
|
||||
# remote-enabled one. The picker number comes from `dejima-attach --list`,
|
||||
# whose rows the picker numbers 1..N in the order they are printed; absent
|
||||
# where remote access is off, which is a column missing rather than a failure.
|
||||
#
|
||||
# Reads only. Nothing here decides which container is acted on - that is the
|
||||
# caller's --container, or the single running one.
|
||||
describe_containers() {
|
||||
local listing="$1" name id project row n=0 idx
|
||||
local -A attach_index=()
|
||||
while IFS=$'\t' read -r _ _ _ _ _ row; do
|
||||
[ -n "$row" ] || continue
|
||||
n=$((n + 1))
|
||||
attach_index["$row"]="$n"
|
||||
done < <(dejima-attach --list 2>/dev/null || true)
|
||||
while IFS=$'\t' read -r name id; do
|
||||
[ -n "$name" ] || continue
|
||||
project="$(docker inspect -f '{{.Config.WorkingDir}}' "$id" 2>/dev/null)" || project=""
|
||||
[ -n "$project" ] && project="$(basename "$project")"
|
||||
idx="${attach_index[${id:0:12}]:-}"
|
||||
printf ' %-28s %-24s %s\n' "$name" "${project:-?}" \
|
||||
"${idx:+(dejima-attach $idx)}"
|
||||
done <<< "$listing"
|
||||
}
|
||||
|
||||
session_wanted=1
|
||||
if [ -n "$project" ] || [ "$global" -eq 1 ]; then
|
||||
[ -n "$container" ] || session_wanted=0
|
||||
fi
|
||||
if [ "$session_wanted" -eq 1 ]; then
|
||||
if [ -z "$container" ]; then
|
||||
containers=$(docker ps --filter "label=com.docker.compose.project=dejima" --filter "status=running" --format '{{.Names}}')
|
||||
containers=$(docker ps --filter "label=com.docker.compose.project=dejima" \
|
||||
--filter "status=running" --format '{{.Names}} {{.ID}}')
|
||||
count=$(echo "$containers" | grep -c . || true)
|
||||
if [ "$count" -eq 0 ]; then
|
||||
echo "No running dejima container found." >&2
|
||||
exit 1
|
||||
elif [ "$count" -gt 1 ]; then
|
||||
echo "Multiple running dejima containers found; specify one with --container:" >&2
|
||||
echo "$containers" >&2
|
||||
echo "" >&2
|
||||
describe_containers "$containers" >&2
|
||||
echo "" >&2
|
||||
echo "(a sandboxed agent's own container ID is printed in its startup context," >&2
|
||||
echo "or by 'cat /etc/hostname' inside that sandbox - don't let it guess one)" >&2
|
||||
exit 1
|
||||
fi
|
||||
container="$containers"
|
||||
container="${containers%%$'\t'*}"
|
||||
fi
|
||||
|
||||
# The DNS proxy (dns-proxy.sh) NXDOMAINs anything not in its allowlist, so
|
||||
|
||||
+1
-1
@@ -263,7 +263,7 @@ list_sessions() {
|
||||
# ever race it. Removing it under a live session is not a leak
|
||||
# being tidied but a session being broken - Docker recreates the
|
||||
# bind source root-owned, hooks/dejima-notify.sh then fails on
|
||||
# every Notification and Stop for the rest of the run, and nothing
|
||||
# every notification for the rest of the run, and nothing
|
||||
# rewrites the registry entry to make the session visible again.
|
||||
continue
|
||||
elif [ "$rc" -ne 0 ]; then
|
||||
|
||||
+4
-11
@@ -23,6 +23,7 @@ Usage: dejima-audit <snapshot|compare|show|ack> [workspace] [state-file]
|
||||
show [--full] index of reports waiting to be read; --full prints one
|
||||
ack walk a report finding by finding and record a decision
|
||||
([o] at the prompt opens the file in $VISUAL/$EDITOR)
|
||||
--print-paths the resolved store paths, one per line, for scripts
|
||||
|
||||
workspace defaults to the enclosing git repository, else $PWD.
|
||||
|
||||
@@ -791,17 +792,9 @@ id_severity() {
|
||||
esac
|
||||
}
|
||||
|
||||
# Every finding interpolates workspace-controlled text (paths, config values)
|
||||
# into a terminal. A planted value containing C0 escapes can scroll, clear or
|
||||
# overwrite the report; C1 controls and Unicode bidi overrides/isolates
|
||||
# (U+202A-U+202E, U+2066-U+2069) can visually reverse or reorder the
|
||||
# displayed text without touching the bytes an operator would grep for - so
|
||||
# strip all of these at the display boundary, after all parsing and
|
||||
# TAB-splitting is done.
|
||||
sanitize() {
|
||||
printf '%s' "$1" | LC_ALL=C tr -d '\000-\037\177' \
|
||||
| LC_ALL=C sed $'s/\xc2[\x80-\x9f]//g; s/\xe2\x80[\xaa-\xae]//g; s/\xe2\x81[\xa6-\xa9]//g'
|
||||
}
|
||||
# sanitize() and sanitize_body() come from dejima-color-lib.sh - every finding
|
||||
# here interpolates workspace-controlled text (paths, config values) into a
|
||||
# terminal, and so does every epitaph, so the rule has one definition.
|
||||
|
||||
# sanitize() is lossy, so an ID must never pass through it. `ack` derives the
|
||||
# baseline id from the report text and the next `compare` matches it against
|
||||
|
||||
@@ -17,6 +17,33 @@
|
||||
#
|
||||
# The variables are always DEFINED, empty when colour is off, so callers
|
||||
# interpolate them unconditionally and no call site needs an if.
|
||||
# Session-authored text on its way to the operator's terminal. A planted value
|
||||
# containing C0 escapes can scroll, clear or overwrite what is being read; C1
|
||||
# controls and Unicode bidi overrides/isolates (U+202A-U+202E, U+2066-U+2069)
|
||||
# reverse or reorder the displayed text without touching the bytes an operator
|
||||
# would grep for. Stripped at the display boundary, after all parsing and
|
||||
# TAB-splitting is done.
|
||||
#
|
||||
# Two forms, because the rule differs. A field is one line, so every C0 byte
|
||||
# goes - including LF, which is what keeps a planted newline from forging a
|
||||
# second row. A body is many lines, and applying the field rule to one would
|
||||
# fold a whole epitaph onto a single line, so there LF and TAB survive and
|
||||
# nothing else does. CR goes either way: it is the overwrite-this-line trick.
|
||||
_sanitize_c1_bidi() {
|
||||
LC_ALL=C sed $'s/\xc2[\x80-\x9f]//g; s/\xe2\x80[\xaa-\xae]//g; s/\xe2\x81[\xa6-\xa9]//g'
|
||||
}
|
||||
|
||||
sanitize() {
|
||||
printf '%s' "$1" | LC_ALL=C tr -d '\000-\037\177' | _sanitize_c1_bidi
|
||||
}
|
||||
|
||||
# Reads the text on stdin rather than taking it as an argument: the callers
|
||||
# are whole files, and a body large enough to be worth keeping is not worth
|
||||
# passing through argv.
|
||||
sanitize_body() {
|
||||
LC_ALL=C tr -d '\000-\010\013-\037\177' | _sanitize_c1_bidi
|
||||
}
|
||||
|
||||
color_init() {
|
||||
local fd="${1:-1}"
|
||||
C_RESET=""; C_CRIT=""; C_WARN=""; C_INFO=""; C_PATH=""
|
||||
|
||||
@@ -42,7 +42,10 @@ core.harness provider:harness
|
||||
core.forge provider:forge none
|
||||
core.workflow provider:workflow local-only
|
||||
core.command ?identifier
|
||||
core.identity ?identifier
|
||||
core.tools ?list:identifier
|
||||
core.firewall bool on
|
||||
core.update_check bool on
|
||||
core.share_dir path ~/.local/share/dejima/shared
|
||||
core.ssh_key ?path
|
||||
core.known_hosts path ~/.ssh/known_hosts
|
||||
@@ -69,6 +72,7 @@ remote-access.ttyd_port int:1:65535 7681
|
||||
remote-access.ttyd_font_size ?int:8:72
|
||||
remote-access.ttyd_tmux_prefix ?chord
|
||||
remote-access.ttyd_focus_on_tap ?bool
|
||||
remote-access.ttyd_button_colors ?bool
|
||||
remote-access.debounce int:0:86400 60
|
||||
EOF
|
||||
}
|
||||
@@ -248,8 +252,23 @@ valid_tarball_spec() {
|
||||
# A declared domain has to survive being written into a dnsmasq
|
||||
# server=/domain/ line. Here rather than in dejima-project-lib.sh as well, so
|
||||
# there is one definition and no pair of them to drift apart.
|
||||
# A hostname, label by label. The matcher is a trust boundary: what it accepts
|
||||
# becomes a dnsmasq `server=` line and an ipset entry, so it should accept only
|
||||
# what it means to rather than only what it can see a use for.
|
||||
#
|
||||
# The previous form allowed an EMPTY label - `a..b.com` matched - because its
|
||||
# repeated group could consume a dot having matched no characters before it.
|
||||
# Harmless in practice, since nothing that shape resolves, and fixed on the
|
||||
# principle rather than on a known abuse: the published bypass in this space
|
||||
# came from a matcher accepting a string the resolver read differently.
|
||||
#
|
||||
# Per label: 1-63 characters, starting and ending alphanumeric, hyphens in
|
||||
# between. That also newly refuses a label with a leading or trailing hyphen,
|
||||
# which is not a hostname either. A single label with no dot stays legal - an
|
||||
# internal name resolved by the host's own resolver is a real case.
|
||||
valid_domain() {
|
||||
[[ "$1" =~ ^[a-zA-Z0-9]([a-zA-Z0-9-]{0,62}\.)*[a-zA-Z0-9-]{1,63}$ ]]
|
||||
local label='[a-zA-Z0-9]([a-zA-Z0-9-]{0,61}[a-zA-Z0-9])?'
|
||||
[[ "$1" =~ ^$label(\.$label)*$ ]]
|
||||
}
|
||||
|
||||
# Extension point for types this layer cannot judge on its own. A stub here,
|
||||
@@ -351,6 +370,20 @@ _config_valid_value() {
|
||||
identifier)
|
||||
[[ "$value" =~ ^[A-Za-z0-9._-]+$ ]]
|
||||
;;
|
||||
text)
|
||||
# A sentence rather than a token - a person's name, an email
|
||||
# address, a one-line description. An identifier has no room for a
|
||||
# space and a path refuses a colon, and all of those are legal
|
||||
# here. Refuses only what cannot survive the trip: a newline splits
|
||||
# the value where every consumer expects one line, and a control
|
||||
# character reaching a terminal is the escape-sequence hazard
|
||||
# docs/security.md names. Everything else is the operator's
|
||||
# business, the same reading `path` takes of a space.
|
||||
case "$value" in
|
||||
*[$'\n\r\t']*) return 1 ;;
|
||||
esac
|
||||
[[ ! "$value" =~ [[:cntrl:]] ]]
|
||||
;;
|
||||
chord)
|
||||
# A tmux control chord, as the remote terminal page's PREFIX,
|
||||
# window and ZOOM buttons send. Narrower than tmux's own prefix
|
||||
|
||||
+323
-22
@@ -21,7 +21,20 @@
|
||||
# file it came from. This preserves what was recorded, it does not attest to
|
||||
# it.
|
||||
#
|
||||
# Usage: dejima-epitaph save <workspace>
|
||||
# Usage: dejima-epitaph save <workspace>
|
||||
# dejima-epitaph list [--all] [workspace]
|
||||
# dejima-epitaph search [--all] <pattern> [workspace]
|
||||
# dejima-epitaph show [n | name] [workspace]
|
||||
#
|
||||
# `save` is what bin/dejima's exit trap runs. The other three are the
|
||||
# operator's, and they only ever read from the host: nothing here gives a
|
||||
# container a path to the store, and nothing here hands an epitaph back to a
|
||||
# session. That second one is the load-bearing half. A session can write its
|
||||
# own transcript, so it can author what its own epitaph says - delivering
|
||||
# that to a later session automatically would plant instructions in its
|
||||
# premises, which is the channel the never-mounted store exists to close
|
||||
# (#104). Printing to the operator's terminal keeps a person in the middle,
|
||||
# and that is the whole design rather than a missing feature.
|
||||
set -uo pipefail
|
||||
|
||||
# --help before anything else runs: no libraries sourced, no config read. The
|
||||
@@ -32,24 +45,28 @@ case "${1:-}" in
|
||||
cat <<'DEJIMA_EPITAPH_HELP'
|
||||
dejima-epitaph - keep what a session worked out before its context was compacted
|
||||
|
||||
Usage: dejima-epitaph save <workspace>
|
||||
Usage: dejima-epitaph save <workspace>
|
||||
dejima-epitaph list [--all] [workspace]
|
||||
dejima-epitaph search [--all] <pattern> [workspace]
|
||||
dejima-epitaph show [n | name] [workspace]
|
||||
|
||||
save <workspace> extract any compaction summaries from that workspace's
|
||||
transcripts and keep them
|
||||
|
||||
Run by bin/dejima when a session exits, not usually by hand.
|
||||
save extract any compaction summaries from that workspace's transcripts
|
||||
and keep them. Run by bin/dejima when a session exits, not by hand
|
||||
list what is kept, oldest first, and whether the session behind each is
|
||||
still resumable - where it is, resuming beats reading a summary
|
||||
search case-insensitive regex over the bodies, reporting each hit's
|
||||
position in the listing list prints
|
||||
show open one in $VISUAL or $EDITOR, or print it where there is no
|
||||
terminal to open an editor on
|
||||
--all widen list and search to every project rather than this one
|
||||
|
||||
A harness that compacts a long session writes a summary of what it is about to
|
||||
forget. For some harnesses that summary is the only durable account of a long
|
||||
session's reasoning, and it goes away with the container. This keeps it.
|
||||
forget, and it goes away with the container. This keeps it, host-side, in a
|
||||
store nothing mounts - so one session cannot read what an earlier one concluded
|
||||
or edit what this one is about to record.
|
||||
|
||||
What a compaction looks like in a transcript is the harness's business, so the
|
||||
selected harness's plugin does the extracting; everything else here is dejima's:
|
||||
where the store is, that nothing mounts it, and that a directory appears only
|
||||
once something has been written into it.
|
||||
|
||||
The store is host-side and never mounted, so one session cannot read what an
|
||||
earlier one concluded or edit what this one is about to record.
|
||||
Reading works with [epitaph] enabled off: turning the feature off is when
|
||||
reviewing and clearing the store is most likely.
|
||||
|
||||
Nothing is kept when the selected harness does not lose anything to compaction,
|
||||
which is not a failure - it means the transcript already holds it all.
|
||||
@@ -65,13 +82,293 @@ source "$(dirname "$(readlink -f "$0")")/dejima-provider-lib.sh"
|
||||
source "$(dirname "$(readlink -f "$0")")/dejima-slug-lib.sh"
|
||||
# shellcheck source=dejima-harness-lib.sh
|
||||
source "$(dirname "$(readlink -f "$0")")/dejima-harness-lib.sh"
|
||||
# shellcheck source=dejima-color-lib.sh
|
||||
source "$(dirname "$(readlink -f "$0")")/dejima-color-lib.sh"
|
||||
config_validate || exit 1
|
||||
color_init 1
|
||||
|
||||
cmd="${1:-}"; ws_arg="${2:-}"
|
||||
usage() {
|
||||
cat >&2 <<'EOF'
|
||||
usage: dejima-epitaph save <workspace>
|
||||
dejima-epitaph list [--all] [workspace]
|
||||
dejima-epitaph search [--all] <pattern> [workspace]
|
||||
dejima-epitaph show [n | name] [workspace]
|
||||
|
||||
n is a position in the listing `list` and `search` print, so it means what
|
||||
those just showed - including under --all, which numbers every project's
|
||||
epitaphs in one sequence.
|
||||
EOF
|
||||
exit 2
|
||||
}
|
||||
|
||||
cmd="${1:-}"
|
||||
shift 2>/dev/null || true
|
||||
# --all anywhere, so it reads naturally either side of a search pattern.
|
||||
ALL=0; args=()
|
||||
for a in ${@+"$@"}; do
|
||||
case "$a" in
|
||||
--all) ALL=1 ;;
|
||||
-h|--help) usage ;;
|
||||
*) args+=("$a") ;;
|
||||
esac
|
||||
done
|
||||
set -- ${args[@]+"${args[@]}"}
|
||||
|
||||
[ "$(config_get epitaph enabled)" = "on" ] || exit 0
|
||||
STORE="$(config_get epitaph dir)"
|
||||
|
||||
# `enabled` gates writing, not reading. Turning epitaph off must not strand
|
||||
# what it already kept behind a config key: an operator who switches it off
|
||||
# is the one most likely to want to look at, and get rid of, the existing
|
||||
# store.
|
||||
case "$cmd" in
|
||||
save) [ "$(config_get epitaph enabled)" = "on" ] || exit 0 ;;
|
||||
list|search|show) ;;
|
||||
*) usage ;;
|
||||
esac
|
||||
|
||||
# Every epitaph belonging to $1, oldest first. The sort key is the basename,
|
||||
# not the path: names begin with the timestamp, so this is chronological
|
||||
# across a workspace's several slugs rather than grouped by whichever slug
|
||||
# directory each file happens to sit in.
|
||||
_epitaphs_in() {
|
||||
local f
|
||||
[ -d "$1" ] || return 0
|
||||
for f in "$1"/*.md; do
|
||||
[ -f "$f" ] || continue
|
||||
printf '%s\t%s\n' "$(basename "$f")" "$f"
|
||||
done
|
||||
}
|
||||
epitaph_files() {
|
||||
local ws="$1" slug d
|
||||
{
|
||||
if [ "$ALL" = 1 ]; then
|
||||
for d in "$STORE"/*/; do _epitaphs_in "${d%/}"; done
|
||||
else
|
||||
while IFS= read -r slug; do
|
||||
[ -n "$slug" ] || continue
|
||||
_epitaphs_in "$STORE/$slug"
|
||||
done < <(workspace_slugs_sorted "$ws")
|
||||
fi
|
||||
} | sort | cut -f2-
|
||||
}
|
||||
|
||||
# The workspace to read from: the one given, else this checkout. Tries the
|
||||
# worktree top and then the main checkout that worktree belongs to, taking
|
||||
# the first that actually has epitaphs - the same shape as dejima-audit's
|
||||
# resolve_ws, and it matters more here. A worktree only has epitaphs of its
|
||||
# own if dejima was launched against the worktree itself; run from one after
|
||||
# working in the main checkout, the answer is the main checkout.
|
||||
resolve_ws() {
|
||||
local given="$1" top common main c
|
||||
if [ -n "$given" ]; then
|
||||
( cd "$given" 2>/dev/null && pwd ) || printf '%s' "$given"
|
||||
return
|
||||
fi
|
||||
top="$(git rev-parse --show-toplevel 2>/dev/null)" || top=""
|
||||
common="$(git rev-parse --git-common-dir 2>/dev/null)" || common=""
|
||||
main=""
|
||||
if [ -n "$common" ]; then
|
||||
common="$(readlink -f "$common" 2>/dev/null)" || common=""
|
||||
[ -n "$common" ] && main="$(dirname "$common")"
|
||||
fi
|
||||
for c in "$top" "$main" "$PWD"; do
|
||||
[ -n "$c" ] || continue
|
||||
[ -n "$(epitaph_files "$c")" ] || continue
|
||||
printf '%s' "$c"
|
||||
return
|
||||
done
|
||||
printf '%s' "$PWD"
|
||||
}
|
||||
|
||||
case "$cmd" in
|
||||
list)
|
||||
ws="$(resolve_ws "${1:-}")"
|
||||
mapfile -t FILES < <(epitaph_files "$ws")
|
||||
if [ "${#FILES[@]}" -eq 0 ]; then
|
||||
if [ "$ALL" = 1 ]; then echo "dejima epitaph: nothing kept yet." >&2
|
||||
else echo "dejima epitaph: nothing kept for $ws." >&2; fi
|
||||
exit 0
|
||||
fi
|
||||
if [ "$ALL" = 1 ]; then printf '%s epitaph(s), all projects\n\n' "${#FILES[@]}"
|
||||
else printf '%s epitaph(s) for %s%s%s\n\n' "${#FILES[@]}" "$C_PATH" "$ws" "$C_RESET"; fi
|
||||
# One python pass rather than one per file, and python rather than three
|
||||
# greps and a stat because this reads the header of every epitaph in the
|
||||
# store under --all.
|
||||
#
|
||||
# Deliberately no topic column. Every Claude Code summary opens on the
|
||||
# same boilerplate, the "Primary Request" section that follows is written
|
||||
# four different ways across the summaries here, and what it opens on is
|
||||
# usually scene-setting rather than the request. Nothing extractable
|
||||
# tells the reader which session this was, and a column repeating the
|
||||
# same sentence down eight rows reads as a broken tool while leaving
|
||||
# discoverability exactly where it was. `search` is the answer to "which
|
||||
# one was it"; this is the answer to "what is here".
|
||||
#
|
||||
# Which sessions still have a transcript is the harness's answer, not
|
||||
# something to work out from a filename: the id is in the name for one
|
||||
# harness and is the directory for the next. Under --all the workspace is
|
||||
# not passed, because a store key is a slug and a slug does not resolve
|
||||
# back to a path - the plugin answers for every key it holds instead. A
|
||||
# harness that does not implement the hook returns nothing, and every row
|
||||
# then says so rather than claiming the transcript is gone.
|
||||
harness_plugin_load "$(config_get core harness)"
|
||||
live=""
|
||||
if [ "$ALL" = 1 ]; then live="$(harness_hook harness_live_sessions)"
|
||||
else live="$(harness_hook harness_live_sessions "$ws")"; fi
|
||||
C_KEY="$C_KEY" C_DIM="$C_DIM" C_OK="$C_OK" C_RESET="$C_RESET" \
|
||||
DEJIMA_LIVE_SESSIONS="$live" DEJIMA_HAS_LIVE="$(declare -F harness_live_sessions >/dev/null && echo 1)" \
|
||||
python3 - "$ALL" ${FILES[@]+"${FILES[@]}"} <<'PY'
|
||||
import os, re, sys
|
||||
|
||||
show_slug = sys.argv[1] == "1"
|
||||
# "<key>\t<session-id>" per live transcript. The distinction that matters is
|
||||
# an empty set from a harness that answered versus no answer at all: the
|
||||
# first means aged out, the second means unknown.
|
||||
known = os.environ.get("DEJIMA_HAS_LIVE") == "1"
|
||||
live = set(os.environ.get("DEJIMA_LIVE_SESSIONS", "").splitlines())
|
||||
KEY, DIM, OK, RESET = (os.environ.get(k, "") for k in ("C_KEY", "C_DIM", "C_OK", "C_RESET"))
|
||||
|
||||
# The index is padded before it is coloured: a width in the format string
|
||||
# counts the escape sequence's bytes and knocks every row out of line the
|
||||
# moment colour is on.
|
||||
ROW = "%s %-16s %-6s %6s %5s %s"
|
||||
print(DIM + ROW % ("%4s" % "#", "when", "how", "ctx", "size", "transcript") + RESET)
|
||||
|
||||
# The bash side's sanitize(), stated again because this renderer parses the
|
||||
# fields itself and there is nothing to hand it a cleaned string. The classes
|
||||
# are pinned equal to that one by a test rather than by this comment.
|
||||
_BAD = re.compile(
|
||||
"[\u0000-\u001f\u007f-\u009f\u202a-\u202e\u2066-\u2069]")
|
||||
|
||||
def clean(s):
|
||||
return _BAD.sub("", s)
|
||||
|
||||
for i, path in enumerate(sys.argv[2:], 1):
|
||||
try:
|
||||
with open(path, errors="replace") as fh:
|
||||
head = [next(fh, "") for _ in range(12)]
|
||||
except OSError:
|
||||
continue
|
||||
h = {}
|
||||
for l in head:
|
||||
m = re.match(r"- (session|at|trigger|tokens): (.*)", l)
|
||||
if m:
|
||||
h[m.group(1)] = m.group(2).strip()
|
||||
sid = h.get("session", "")
|
||||
# How much context the session had accumulated by the time it compacted:
|
||||
# the one field here that separates a long session from a short one, and
|
||||
# it is recorded rather than guessed at.
|
||||
m = re.match(r"(\d+) before", h.get("tokens", ""))
|
||||
ctx = "%dk" % (int(m.group(1)) / 1000) if m else "?"
|
||||
# The store key is the directory this epitaph sits in, which is dejima's
|
||||
# own arrangement; pairing it with the session id is what makes the answer
|
||||
# unambiguous under --all, where two projects can hold the same id.
|
||||
if not known:
|
||||
state = DIM + "?" + RESET
|
||||
elif "%s\t%s" % (os.path.basename(os.path.dirname(path)), sid) in live:
|
||||
state = OK + "resumable" + RESET
|
||||
else:
|
||||
state = DIM + "aged out" + RESET
|
||||
row = ROW % (KEY + "%4d" % i + RESET,
|
||||
clean(h.get("at", ""))[:16].replace("T", " ") or "?",
|
||||
clean(h.get("trigger", "?"))[:6], ctx,
|
||||
"%dK" % ((os.path.getsize(path) + 1023) // 1024), state)
|
||||
if show_slug:
|
||||
row += " " + DIM + clean(os.path.basename(os.path.dirname(path)))[:30] + RESET
|
||||
print(row)
|
||||
PY
|
||||
printf '\n %sdejima-epitaph show <n>%s opens one; %sdejima-epitaph search <pattern>%s finds one.\n' \
|
||||
"$C_KEY" "$C_RESET" "$C_KEY" "$C_RESET"
|
||||
# `resumable` means the transcript this was distilled from is still on
|
||||
# disk, so `claude --resume <session>` gives the real session rather than
|
||||
# a summary of it. That is the better recovery whenever it is available;
|
||||
# the epitaph is what remains once the harness has aged the transcript out.
|
||||
exit 0
|
||||
;;
|
||||
search)
|
||||
pattern="${1:-}"; [ -n "$pattern" ] || usage
|
||||
ws="$(resolve_ws "${2:-}")"
|
||||
mapfile -t FILES < <(epitaph_files "$ws")
|
||||
[ "${#FILES[@]}" -gt 0 ] || { echo "dejima epitaph: nothing kept for $ws." >&2; exit 0; }
|
||||
# Case-insensitive extended regex, so a bare word works and a pattern is
|
||||
# available without a second flag to remember.
|
||||
gcolor=never; [ -n "$C_RESET" ] && gcolor=always
|
||||
i=0; hits=0
|
||||
for f in ${FILES[@]+"${FILES[@]}"}; do
|
||||
i=$((i + 1))
|
||||
grep -qiE -- "$pattern" "$f" 2>/dev/null || continue
|
||||
hits=$((hits + 1))
|
||||
# The index is this file's position in the SAME listing `list`
|
||||
# prints, so `show <n>` after a search means what the search showed.
|
||||
# The name is built from the transcript's own timestamp and uuid
|
||||
# fields, so it is session-authored too - not just the body under it.
|
||||
printf '\n%s%4d%s %s%s%s\n' "$C_KEY" "$i" "$C_RESET" \
|
||||
"$C_DIM" "$(sanitize "$(basename "$f")")" "$C_RESET"
|
||||
# Sanitized BEFORE grep, not after: grep adds its own colour when the
|
||||
# output is a terminal, and cleaning afterwards would strip the
|
||||
# highlight along with the planted bytes.
|
||||
sanitize_body < "$f" \
|
||||
| grep -inE --color=$gcolor -- "$pattern" 2>/dev/null \
|
||||
| head -3 | sed 's/^/ /' | cut -c1-100
|
||||
done
|
||||
if [ "$hits" -eq 0 ]; then
|
||||
printf 'dejima epitaph: no epitaph matches %s (searched %s).\n' "$pattern" "$i" >&2
|
||||
else
|
||||
printf '\n%s of %s epitaph(s) match. %sdejima-epitaph show <n>%s opens one.\n' \
|
||||
"$hits" "$i" "$C_KEY" "$C_RESET"
|
||||
fi
|
||||
exit 0
|
||||
;;
|
||||
show)
|
||||
sel="${1:-}"; ws_arg="${2:-}"
|
||||
# A lone argument that names a directory is the workspace, not a
|
||||
# selector: `dejima-epitaph show ~/workspace/thing` is the obvious thing
|
||||
# to type and would otherwise be read as a name to match.
|
||||
if [ -n "$sel" ] && [ -z "$ws_arg" ] && [ -d "$sel" ]; then ws_arg="$sel"; sel=""; fi
|
||||
ws="$(resolve_ws "$ws_arg")"
|
||||
mapfile -t FILES < <(epitaph_files "$ws")
|
||||
[ "${#FILES[@]}" -gt 0 ] || { echo "dejima epitaph: nothing kept for $ws." >&2; exit 0; }
|
||||
file=""
|
||||
case "$sel" in
|
||||
"") file="${FILES[-1]}" ;;
|
||||
*[!0-9]*)
|
||||
for f in ${FILES[@]+"${FILES[@]}"}; do
|
||||
case "$(basename "$f")" in "$sel"*) file="$f"; break ;; esac
|
||||
done ;;
|
||||
*)
|
||||
[ "$sel" -ge 1 ] 2>/dev/null && [ "$sel" -le "${#FILES[@]}" ] \
|
||||
&& file="${FILES[$((sel - 1))]}" ;;
|
||||
esac
|
||||
[ -n "$file" ] || { echo "dejima epitaph: no epitaph '$sel' in ${#FILES[@]} kept for $ws." >&2; exit 1; }
|
||||
# Piped or redirected, print it: `show | grep` must not try to open an
|
||||
# editor, and neither must a test.
|
||||
ed="${VISUAL:-${EDITOR:-}}"
|
||||
if [ -z "$ed" ] || [ ! -t 1 ] || [ ! -t 0 ]; then
|
||||
# The body is what a session wrote, and printing it IS this tool's
|
||||
# purpose - so it is the one place the operator's terminal meets those
|
||||
# bytes directly. sanitize_body rather than sanitize: the field rule
|
||||
# takes LF too, and an epitaph is not one line.
|
||||
sanitize_body < "$file"
|
||||
exit 0
|
||||
fi
|
||||
# Through `sh -c` so $EDITOR may carry flags (`code -w`, `emacsclient
|
||||
# -nw`), with the path passed as an argument rather than interpolated so
|
||||
# a space in it stays one word.
|
||||
sh -c "$ed \"\$1\"" sh "$file"
|
||||
# An editor writes through a temp file and renames it into place, which
|
||||
# leaves the result at the umask's mode rather than the 0600 `save`
|
||||
# wrote. The 0700 directory means nothing else could read it either way;
|
||||
# the mode is restated because it is what this store promises, not
|
||||
# because the directory needs the help.
|
||||
chmod 600 "$file" 2>/dev/null || true
|
||||
exit 0
|
||||
;;
|
||||
esac
|
||||
|
||||
# Everything below is `save`. Reading the store is dejima's own business and
|
||||
# needs the plugin only to label a row (see `list` above, which tolerates its
|
||||
# absence); extracting an epitaph is entirely the plugin's, so from here a
|
||||
# missing one is fatal rather than a blank column.
|
||||
harness_plugin_load "$(config_get core harness)"
|
||||
|
||||
# With no harness selected nothing knows what a compaction looks like, so
|
||||
@@ -87,15 +384,12 @@ if [ -z "$(config_get core harness)" ]; then
|
||||
exit 0
|
||||
fi
|
||||
|
||||
ws_arg="${1:-}"
|
||||
|
||||
ws="$ws_arg"
|
||||
[ -n "$ws" ] || ws="$(pwd)"
|
||||
ws="$(cd "$ws" 2>/dev/null && pwd)" || exit 0
|
||||
|
||||
case "$cmd" in
|
||||
save) ;;
|
||||
*) echo "usage: dejima-epitaph save <workspace>" >&2; exit 2 ;;
|
||||
esac
|
||||
|
||||
# One file per summary, named for the moment it was written, so a directory
|
||||
# listing is a timeline. Keyed on the summary record's own uuid: `save` runs
|
||||
# on every exit, and a session compacted three times has three epitaphs, two
|
||||
@@ -161,6 +455,13 @@ echo "dejima: wrote $saved epitaph(s) to $STORE" >&2
|
||||
# operators who already centralise session logs. Host-side rather than
|
||||
# through the container's log-shipper, so the same "never in the session's
|
||||
# reach" property holds for the shipping path too.
|
||||
#
|
||||
# DEJIMA_EPITAPH_NO_SHIP is bin/dejima's --no-log reaching the one decision it
|
||||
# cannot make on this tool's behalf. Honoured from the environment, which
|
||||
# nothing else here is, because it can only ever suppress: a stale export
|
||||
# keeps an epitaph off the wire and never puts one on it. The epitaph is still
|
||||
# written either way - the store is the durable copy, and this is the bonus.
|
||||
[ "${DEJIMA_EPITAPH_NO_SHIP:-0}" != 1 ] || exit 0
|
||||
[ "$(config_get epitaph loki)" = "on" ] || exit 0
|
||||
loki="$(config_get logging loki_url)"
|
||||
[ -n "$loki" ] || exit 0
|
||||
|
||||
@@ -40,7 +40,7 @@
|
||||
# The hooks core will call. A plugin defines the ones its harness needs and
|
||||
# omits the rest; anything else it defines is a name core does not call, and
|
||||
# the static test refuses it rather than letting it look wired up.
|
||||
DEJIMA_HARNESS_HOOKS="harness_prepare_config harness_state_mounts harness_register_notify harness_register_guards harness_host_exec_surfaces harness_config_dirs harness_staged_config harness_extract_epitaphs harness_transform_transcript harness_guards_registered harness_briefing_state_dir harness_transcript_files harness_seed"
|
||||
DEJIMA_HARNESS_HOOKS="harness_prepare_config harness_state_mounts harness_register_notify harness_register_guards harness_host_exec_surfaces harness_config_dirs harness_staged_config harness_extract_epitaphs harness_transform_transcript harness_guards_registered harness_briefing_state_dir harness_transcript_files harness_live_sessions harness_seed"
|
||||
|
||||
# What an operator loses when a harness cannot host a given guard. The set
|
||||
# itself is DEJIMA_KNOWN_GUARDS in dejima-provider-lib.sh, next to the
|
||||
|
||||
+28
-2
@@ -29,6 +29,7 @@ A project declares its requirements in files inside its own checkout:
|
||||
.dejima/dependencies packages its image should carry
|
||||
.dejima/allowed-domains hosts its sessions may reach
|
||||
.dejima/corpus rules about how its history is recorded
|
||||
.dejima/tools optional tools its sessions should have
|
||||
|
||||
Those are declarations, not grants. They live in the workspace, which a session
|
||||
can write, so nothing they contain takes effect until it is approved here and
|
||||
@@ -164,12 +165,15 @@ case "$action" in
|
||||
report allowed-domains valid_domain
|
||||
echo "corpus:"
|
||||
report corpus valid_corpus_rule
|
||||
echo "tools:"
|
||||
report tools valid_tool_name
|
||||
;;
|
||||
approve)
|
||||
pending_deps=$(classify dependencies valid_dep_spec | sed -n 's/^pending //p')
|
||||
pending_doms=$(classify allowed-domains valid_domain | sed -n 's/^pending //p')
|
||||
pending_corpus=$(classify corpus valid_corpus_rule | sed -n 's/^pending //p')
|
||||
rejected=$( { classify dependencies valid_dep_spec; classify allowed-domains valid_domain; classify corpus valid_corpus_rule; } | sed -n 's/^rejected //p')
|
||||
pending_tools=$(classify tools valid_tool_name | sed -n 's/^pending //p')
|
||||
rejected=$( { classify dependencies valid_dep_spec; classify allowed-domains valid_domain; classify corpus valid_corpus_rule; classify tools valid_tool_name; } | sed -n 's/^rejected //p')
|
||||
trunc_deps=$(classify dependencies valid_dep_spec | sed -n 's/^truncated //p')
|
||||
trunc_doms=$(classify allowed-domains valid_domain | sed -n 's/^truncated //p')
|
||||
if [ -n "$trunc_deps" ]; then
|
||||
@@ -183,7 +187,8 @@ case "$action" in
|
||||
sed 's/^/ /' <<< "$rejected" >&2
|
||||
echo >&2
|
||||
fi
|
||||
if [ -z "$pending_deps" ] && [ -z "$pending_doms" ] && [ -z "$pending_corpus" ]; then
|
||||
if [ -z "$pending_deps" ] && [ -z "$pending_doms" ] && [ -z "$pending_corpus" ] \
|
||||
&& [ -z "$pending_tools" ]; then
|
||||
echo "Nothing pending approval for $project."
|
||||
exit 0
|
||||
fi
|
||||
@@ -191,6 +196,12 @@ case "$action" in
|
||||
[ -n "$pending_deps" ] && printf ' dependency: %s\n' $pending_deps
|
||||
[ -n "$pending_doms" ] && printf ' domain: %s\n' $pending_doms
|
||||
[ -n "$pending_corpus" ] && printf ' corpus: %s\n' $pending_corpus
|
||||
# Named as what it is rather than as a package: approving one adds a
|
||||
# program to the image every session on this project then has on
|
||||
# PATH. dejima hardens what it ships (docs/tools.md), which is what
|
||||
# makes this a shorter conversation than a dependency - but it is
|
||||
# still a change to what the sandbox contains.
|
||||
[ -n "$pending_tools" ] && printf ' tool: %s (installed into the image)\n' $pending_tools
|
||||
echo
|
||||
printf 'Approve all of the above? [y/N] '
|
||||
read -r reply || reply=n
|
||||
@@ -233,6 +244,15 @@ case "$action" in
|
||||
# RUNNING container's firewall or image; a corpus rule changes what the
|
||||
# next session is told and nothing about a live one, so there is
|
||||
# nothing to patch and no CLI to route through.
|
||||
tool_failed=""
|
||||
tool_approved=0
|
||||
for tool in $pending_tools; do
|
||||
if approve_entry "$(ensure_project_store "$project")" tools "$tool"; then
|
||||
tool_approved=1
|
||||
else
|
||||
tool_failed="$tool_failed $tool"
|
||||
fi
|
||||
done
|
||||
corpus_failed=""
|
||||
corpus_approved=0
|
||||
for rule in $pending_corpus; do
|
||||
@@ -249,6 +269,12 @@ case "$action" in
|
||||
if [ "$corpus_approved" = 1 ]; then
|
||||
echo "Approved corpus rules for $project. They take effect at the next launch."
|
||||
fi
|
||||
if [ -n "$tool_failed" ]; then
|
||||
echo "NOT approved for $project (could not record):$tool_failed" >&2
|
||||
fi
|
||||
if [ "$tool_approved" = 1 ]; then
|
||||
echo "Approved tools for $project. The image rebuilds on the next launch."
|
||||
fi
|
||||
if [ -n "$dep_failed" ]; then
|
||||
echo "NOT approved for $project (dejima-dep failed):$dep_failed" >&2
|
||||
echo "Fix the cause and re-run; nothing was recorded for those." >&2
|
||||
|
||||
@@ -236,6 +236,7 @@ _approved_validator() {
|
||||
allowed-domains) printf 'valid_domain' ;;
|
||||
dependencies) printf 'valid_dep_spec' ;;
|
||||
corpus) printf 'valid_corpus_rule' ;;
|
||||
tools) printf 'valid_tool_name' ;;
|
||||
*) return 1 ;;
|
||||
esac
|
||||
}
|
||||
@@ -249,6 +250,18 @@ _approved_validator() {
|
||||
# not. There is one today.
|
||||
DEJIMA_CORPUS_RULES="commit-per-step"
|
||||
|
||||
# An optional tool a project asks for. A name dejima ships a manifest for and
|
||||
# nothing else: an entry naming a tool that does not exist would approve
|
||||
# cleanly, sit in the store and install nothing, which reads as the tool being
|
||||
# in force when it is not - the same reasoning as the corpus rules above.
|
||||
#
|
||||
# Refusing at declaration time also means the approval prompt cannot offer an
|
||||
# operator a name that would silently do nothing.
|
||||
valid_tool_name() {
|
||||
valid_provider_name "$1" || return 1
|
||||
provider_dir tool "$1" >/dev/null 2>&1
|
||||
}
|
||||
|
||||
valid_corpus_rule() {
|
||||
case " $DEJIMA_CORPUS_RULES " in
|
||||
*" $1 "*) return 0 ;;
|
||||
@@ -423,8 +436,22 @@ unapprove_entry() {
|
||||
#
|
||||
# -xaf rather than -xzf: compression is detected from the archive, so xz and
|
||||
# zstd releases work without the spec having to say which it is.
|
||||
# DEJIMA_TARBALL_STRIP picks between the two archive shapes. "prefix" is the
|
||||
# default and the one every dependency uses: everything under a single
|
||||
# directory, stripped so bin/ lands in the same place whatever the release
|
||||
# called its top level. "binary" is an archive that IS the executable, with no
|
||||
# enclosing directory at all - stripping a component there strips the binary
|
||||
# and extracts nothing, silently, leaving a layer that built fine and contains
|
||||
# no tool.
|
||||
#
|
||||
# A parameter rather than a second emitter, because the digest-before-unpack
|
||||
# below is the part that must not exist twice.
|
||||
_emit_tarball_layers() {
|
||||
local spec rest name sha url
|
||||
local spec rest name sha url dest strip
|
||||
case "${DEJIMA_TARBALL_STRIP:-prefix}" in
|
||||
binary) strip="" ;;
|
||||
*) strip="--strip-components=1 " ;;
|
||||
esac
|
||||
for spec in "$@"; do
|
||||
[ -n "$spec" ] || continue
|
||||
rest="${spec#tarball:}"
|
||||
@@ -436,7 +463,12 @@ _emit_tarball_layers() {
|
||||
printf ' wget --tries=3 --timeout=30 --waitretry=5 --retry-connrefused \\\n'
|
||||
printf ' -O /tmp/%s.tar "%s" && \\\n' "$name" "$url"
|
||||
printf ' echo "%s /tmp/%s.tar" | sha256sum -c - && \\\n' "$sha" "$name"
|
||||
printf ' tar -C /opt/dejima/%s --strip-components=1 -xaf /tmp/%s.tar && \\\n' "$name" "$name"
|
||||
# A bare binary goes straight into the bin/ a prefix archive would
|
||||
# have brought with it, so the PATH line below is the same either way.
|
||||
dest="/opt/dejima/$name"
|
||||
[ -n "$strip" ] || dest="$dest/bin"
|
||||
printf ' mkdir -p %s && \\\n' "$dest"
|
||||
printf ' tar -C %s %s-xaf /tmp/%s.tar && \\\n' "$dest" "$strip" "$name"
|
||||
printf ' rm /tmp/%s.tar\n' "$name"
|
||||
printf 'ENV PATH=$PATH:/opt/dejima/%s/bin\n' "$name"
|
||||
done
|
||||
@@ -629,6 +661,14 @@ remote_ttyd_font_size() {
|
||||
# useful default and is deliberately NOT a bool default of off: the page
|
||||
# decides per client from the pointer type, which a host-wide setting cannot
|
||||
# see. Only a value the operator actually wrote is passed on.
|
||||
# Whether the terminal page colour-codes its toolbar. Unset means on, which
|
||||
# the page decides for itself - so, like the tap setting above, only a value
|
||||
# the operator actually wrote is passed on.
|
||||
remote_ttyd_button_colors() {
|
||||
config_is_set remote-access ttyd_button_colors || return 0
|
||||
config_get remote-access ttyd_button_colors
|
||||
}
|
||||
|
||||
remote_ttyd_focus_on_tap() {
|
||||
config_is_set remote-access ttyd_focus_on_tap || return 0
|
||||
config_get remote-access ttyd_focus_on_tap
|
||||
|
||||
+266
-3
@@ -44,6 +44,11 @@ _provider_axis_dir() {
|
||||
forge) printf 'forges' ;;
|
||||
workflow) printf 'workflows' ;;
|
||||
harness) printf 'harnesses' ;;
|
||||
# Not an axis in the select-one sense the other three are: a launch
|
||||
# enables zero or more tools, and none is the default. It is here
|
||||
# because everything else about it is the same - a manifest that is
|
||||
# data, validated by the same schema machinery, never sourced.
|
||||
tool) printf 'tools' ;;
|
||||
*) echo "unknown provider axis: $1" >&2; return 1 ;;
|
||||
esac
|
||||
}
|
||||
@@ -53,6 +58,7 @@ _provider_manifest_name() {
|
||||
forge) printf 'forge.conf' ;;
|
||||
workflow) printf 'workflow.conf' ;;
|
||||
harness) printf 'harness.conf' ;;
|
||||
tool) printf 'tool.conf' ;;
|
||||
*) return 1 ;;
|
||||
esac
|
||||
}
|
||||
@@ -143,6 +149,9 @@ capabilities ?list:identifier
|
||||
pr_command ?command
|
||||
issue_command ?command
|
||||
merge_block ?command
|
||||
repo_flags ?list:flag
|
||||
repo_env ?identifier
|
||||
identity_keys ?list:identifier
|
||||
disclose ?disclosures
|
||||
keys ?list:keyspec
|
||||
requires ?list:identifier
|
||||
@@ -152,6 +161,22 @@ fixed_hosts ?list:hostname
|
||||
hosts_allowlisted_by_core bool off
|
||||
install ?list:installspec
|
||||
env_export ?list:export
|
||||
EOF
|
||||
;;
|
||||
# An optional tool. Deliberately small: a tool declares what it is,
|
||||
# what installs it, what its environment needs and what the session
|
||||
# should be told about it - and nothing that could change what dejima
|
||||
# permits. There is no key here for a hook, a mount, a domain or a
|
||||
# guard, because a tool that needed one of those would be a change to
|
||||
# the boundary rather than a program on PATH, and would have to be
|
||||
# argued for rather than declared.
|
||||
tool) cat <<'EOF'
|
||||
description text
|
||||
install depspec
|
||||
install_layout enum:prefix|binary prefix
|
||||
image_env ?list:envpair
|
||||
command identifier
|
||||
instructions ?relpath
|
||||
EOF
|
||||
;;
|
||||
workflow) cat <<'EOF'
|
||||
@@ -271,6 +296,13 @@ _provider_valid_value() {
|
||||
# and nothing shell-active does.
|
||||
[[ "$value" =~ ^[A-Za-z0-9][A-Za-z0-9._-]*( [A-Za-z0-9][A-Za-z0-9._-]*)*$ ]]
|
||||
;;
|
||||
flag)
|
||||
# A command-line option name, compared against argv by
|
||||
# docker/forge-guard.sh. The leading dash is required: without it
|
||||
# the guard would be comparing a word that could just as well be a
|
||||
# subcommand or a value.
|
||||
[[ "$value" =~ ^--?[A-Za-z0-9][A-Za-z0-9-]*$ ]]
|
||||
;;
|
||||
relpath)
|
||||
# Joined to a provider directory, so no absolute paths and no
|
||||
# traversal - a manifest may only name a file it ships.
|
||||
@@ -600,11 +632,54 @@ _config_extra_section_known() {
|
||||
case "$section" in
|
||||
forge.*) axis=forge; name="${section#forge.}" ;;
|
||||
harness.*) axis=harness; name="${section#harness.}" ;;
|
||||
# An identity is the operator's own name for a set of credentials, so
|
||||
# there is no directory to check it against - only that it is a name
|
||||
# at all. Unlike a provider, an unused one is not a misconfiguration:
|
||||
# having [identity.oss] on a machine that never selects it is the
|
||||
# normal state of a second account.
|
||||
identity.*)
|
||||
name="${section#identity.}"
|
||||
valid_provider_name "$name"
|
||||
return
|
||||
;;
|
||||
*) return 1 ;;
|
||||
esac
|
||||
provider_dir "$axis" "$name" >/dev/null 2>&1
|
||||
}
|
||||
|
||||
# The keys an [identity.<name>] section may carry, as "<key>\t<type>" lines.
|
||||
#
|
||||
# ssh_key and the git identity are core's, because every forge needs the same
|
||||
# two answers to "who is pushing". Everything else is declared by a forge's
|
||||
# identity_keys and typed by that forge's own keys entry, so the identity
|
||||
# inherits the validation the forge already wrote rather than a second copy of
|
||||
# it that could disagree.
|
||||
#
|
||||
# A key name declared by two forges resolves to one type here, which is why a
|
||||
# static test refuses that collision rather than this function guessing.
|
||||
_identity_key_specs() {
|
||||
printf 'ssh_key ?path
|
||||
'
|
||||
printf 'user_name ?text
|
||||
'
|
||||
printf 'user_email ?text
|
||||
'
|
||||
local forge key spec
|
||||
for forge in $(provider_list forge); do
|
||||
for key in $(manifest_get forge "$forge" identity_keys); do
|
||||
for spec in $(_provider_keys_field forge "$forge"); do
|
||||
[ "${spec%%:*}" = "$key" ] || continue
|
||||
# The forge's own type, with its default deliberately dropped:
|
||||
# a default belongs to the forge's section, and repeating it
|
||||
# here would make an identity that names no token look like one
|
||||
# that named the default path.
|
||||
printf '%s\t?%s\n' "$key" \
|
||||
"$(cut -f2 <<< "$(_provider_keyspec_parse "$spec")" | sed 's/^?//')"
|
||||
done
|
||||
done
|
||||
done
|
||||
}
|
||||
|
||||
# Looks up one [forge.<name>]/[harness.<name>] key's TYPE<TAB>DEFAULT in that
|
||||
# provider's `keys` manifest entry instead of a row hardcoded in core.
|
||||
_config_extra_spec() {
|
||||
@@ -612,6 +687,17 @@ _config_extra_spec() {
|
||||
case "$want" in
|
||||
forge.*) axis=forge ;;
|
||||
harness.*) axis=harness ;;
|
||||
identity.*)
|
||||
rest="${want#identity.}"
|
||||
key="${rest#*.}"
|
||||
[ "$key" != "$rest" ] || return 1
|
||||
while IFS=$'\t' read -r pname ptype; do
|
||||
[ "$pname" = "$key" ] || continue
|
||||
printf '%s\t' "$ptype"
|
||||
return 0
|
||||
done < <(_identity_key_specs)
|
||||
return 1
|
||||
;;
|
||||
*) return 1 ;;
|
||||
esac
|
||||
rest="${want#*.}"
|
||||
@@ -632,6 +718,75 @@ _config_extra_spec() {
|
||||
return 1
|
||||
}
|
||||
|
||||
# What the selected identity says about one key, if anything.
|
||||
#
|
||||
# An identity answers for the credentials and the git name a PERSON brings to
|
||||
# a project, which is the half a project cannot declare: .dejima/ is committed
|
||||
# and shared, and a key path is per-user and per-machine. The project (or the
|
||||
# operator) names an identity; the identity supplies the paths.
|
||||
#
|
||||
# Returns 1 for a key no identity owns, which is most of them - the caller
|
||||
# then reads the config file as before. Deliberately narrow: an identity that
|
||||
# could set any key would be a second config file with different rules about
|
||||
# what may be in it.
|
||||
#
|
||||
# core.identity itself is excluded, and not merely by convention: the caller
|
||||
# that consults this is bin/dejima's config_get wrapper, so answering for the
|
||||
# key that names the identity would recurse into itself.
|
||||
# Whether the named identity exists in the config at all - any of its keys
|
||||
# being present is enough, because a section with no keys is not a section
|
||||
# the parser records.
|
||||
#
|
||||
# The check that matters: [core] identity naming a section nobody wrote is a
|
||||
# silent fall-through to the machine's defaults, which is the wrong direction
|
||||
# to be wrong in. Pushing under the wrong key fails loudly; pushing under the
|
||||
# default key when you asked for another one does not fail at all.
|
||||
identity_exists() {
|
||||
local name="$1" key
|
||||
[ -n "$name" ] || return 1
|
||||
valid_provider_name "$name" || return 1
|
||||
while IFS=$'\t' read -r key _; do
|
||||
config_is_set "identity.$name" "$key" && return 0
|
||||
done < <(_identity_key_specs)
|
||||
return 1
|
||||
}
|
||||
|
||||
identity_get() {
|
||||
local section="$1" key="$2" name value pname
|
||||
[ "$section.$key" != "core.identity" ] || return 1
|
||||
name="$(config_get core identity)" || return 1
|
||||
[ -n "$name" ] || return 1
|
||||
case "$section" in
|
||||
core) [ "$key" = ssh_key ] || return 1 ;;
|
||||
forge.*) _forge_owns_identity_key "${section#forge.}" "$key" || return 1 ;;
|
||||
identity.*) return 1 ;;
|
||||
*) return 1 ;;
|
||||
esac
|
||||
value="$(config_get "identity.$name" "$key")" || return 1
|
||||
[ -n "$value" ] || return 1
|
||||
printf '%s' "$value"
|
||||
}
|
||||
|
||||
# Whether one forge declared this key as a person's rather than a project's.
|
||||
_forge_owns_identity_key() {
|
||||
local forge="$1" key="$2" k
|
||||
for k in $(manifest_get forge "$forge" identity_keys); do
|
||||
[ "$k" = "$key" ] && return 0
|
||||
done
|
||||
return 1
|
||||
}
|
||||
|
||||
# The git name and address the identity carries, for the gitconfig copy the
|
||||
# container gets. Not core config keys: the host's own ~/.gitconfig is where
|
||||
# they come from without an identity, and adding a second place to set them
|
||||
# globally would be a new way to get the same answer.
|
||||
identity_git_field() {
|
||||
local field="$1" name
|
||||
name="$(config_get core identity)" || return 1
|
||||
[ -n "$name" ] || return 1
|
||||
config_get "identity.$name" "$field"
|
||||
}
|
||||
|
||||
# One key of the SELECTED harness, rather than of a harness named literally
|
||||
# at the call site.
|
||||
#
|
||||
@@ -707,6 +862,23 @@ provider_validate_selection() {
|
||||
# quietly absent, because an operator who has them everywhere else would
|
||||
# otherwise have to read a manifest to find out they are gone here.
|
||||
#
|
||||
# An identity that names nothing is refused rather than ignored. Falling
|
||||
# through to the machine's own credentials would mean pushing under the
|
||||
# wrong account with nothing saying so, which is the failure this feature
|
||||
# exists to remove rather than one it may introduce.
|
||||
# Guarded on the config existing rather than swallowing config_get's
|
||||
# stderr: with no file at all it says so, and a selection validated
|
||||
# without one is a legitimate case this must stay silent for.
|
||||
local _identity=""
|
||||
config_exists && { _identity="$(config_get core identity)" || _identity=""; }
|
||||
if [ -n "$_identity" ] && ! identity_exists "$_identity"; then
|
||||
echo "[core] identity is '$_identity', and no [identity.$_identity] section sets" >&2
|
||||
echo "anything in $(config_path). An identity that resolves to nothing would" >&2
|
||||
echo "quietly use this machine's own credentials instead - refusing rather than" >&2
|
||||
echo "doing that. See docs/configuration.md, \"Identities\"." >&2
|
||||
return 1
|
||||
fi
|
||||
|
||||
# A name outside this set is a hard error rather than an unknown guard
|
||||
# treated as absent: a typo would otherwise silently turn a guard off,
|
||||
# which is the failure this whole declaration exists to prevent.
|
||||
@@ -951,6 +1123,10 @@ What this means:
|
||||
briefing.{{writable_mounts}} Everything else is disposable: installed system
|
||||
packages, anything outside the mounted paths, and the container itself go
|
||||
away when this run ends.
|
||||
- A headless browser is installed: playwright, with chromium, importable
|
||||
from any directory in either module system. If you change something with a
|
||||
user interface, look at it rather than describing what it should look like,
|
||||
and leave the screenshot in ~/shared.
|
||||
- Outbound network is restricted to an allowlist (Anthropic's API, the npm
|
||||
registry, {{network_allowlist}}, plus anything
|
||||
approved via dejima-allow). Requests to anything else will simply
|
||||
@@ -963,9 +1139,9 @@ What this means:
|
||||
it appears to. If a task needs one more domain and nothing else, that's
|
||||
a quick fix, not a reason to stop. Tell the user to run, from a terminal
|
||||
outside the sandbox, whichever of these matches why the domain is needed:
|
||||
bin/dejima-allow --container {{container_id}} <domain> # just this session
|
||||
bin/dejima-allow --project <path> <domain> # this project, always
|
||||
bin/dejima-allow --global <domain> # every project
|
||||
dejima-allow --container {{container_id}} <domain> # just this session
|
||||
dejima-allow --project <path> <domain> # this project, always
|
||||
dejima-allow --global <domain> # every project
|
||||
Pick deliberately rather than asking for all three: a domain this project
|
||||
needs is --project, not --global - a global grant widens every other
|
||||
project's firewall too, which is rarely what one project's dependency
|
||||
@@ -1333,6 +1509,77 @@ _briefing_substitute() {
|
||||
# the resume command) - in that reading order. Every {{key}} is substituted
|
||||
# except {{session_id}}/{{container_id}}, deferred as @@SESSION_ID@@ and
|
||||
# @@CONTAINER_ID@@ for the hook that mounts this at session start.
|
||||
# A tool's manifest, plus the one rule its schema cannot express.
|
||||
#
|
||||
# image_env becomes a Dockerfile ENV, which every process in the container
|
||||
# inherits - not just the tool that declared it. A harness may set a bare name
|
||||
# there because a harness IS the container's main process; a tool is one
|
||||
# program among many and may not.
|
||||
#
|
||||
# This is not hypothetical. rtk shipped with NO_COLOR=1, reasoning that its
|
||||
# output lands in a model's context where an escape sequence is noise. The
|
||||
# reasoning was fine, the scope was wrong, and a launch with that tool enabled
|
||||
# lost colour in the harness, git, ls and everything else. The rule that would
|
||||
# have caught it is that a tool's variables must be namespaced to the tool.
|
||||
#
|
||||
# Uppercased, with anything that is not alphanumeric folded to an underscore,
|
||||
# so a tool named `my-tool` claims `MY_TOOL_*`.
|
||||
tool_validate() {
|
||||
local name="$1" prefix pair varname
|
||||
manifest_validate tool "$name" || return 1
|
||||
prefix="$(printf '%s' "$name" | tr '[:lower:]' '[:upper:]' | tr -c '[:alnum:]' '_')_"
|
||||
for pair in $(manifest_get tool "$name" image_env); do
|
||||
varname="${pair%%=*}"
|
||||
case "$varname" in
|
||||
"$prefix"*) continue ;;
|
||||
esac
|
||||
echo "tool '$name' declares image_env $varname, which is not its own." >&2
|
||||
echo "A tool's image_env reaches every process in the container, so a bare" >&2
|
||||
echo "name like NO_COLOR or DO_NOT_TRACK changes the harness and everything" >&2
|
||||
echo "else too. Name it ${prefix}something, or do not set it." >&2
|
||||
return 1
|
||||
done
|
||||
}
|
||||
|
||||
# That the authorship marker is added for the session, so it does not add one.
|
||||
#
|
||||
# Every issue and pull request on a project worked on this way opens with that
|
||||
# line, so an agent reading the existing ones concludes it is the house style
|
||||
# and writes it into the body - and the shadow then added a second. Each
|
||||
# doubled artifact taught the next agent to do the same. docker/forge-guard.sh
|
||||
# refuses to add a second now, which holds whatever the session does; this is
|
||||
# the other half, which stops it being written in the first place.
|
||||
_briefing_core_disclosure() {
|
||||
printf '%s' "Bodies you write for the forge - pull requests, issues, comments - are
|
||||
marked as agent-written before they are sent. Do not write that line
|
||||
yourself: it is added for you, and one is what the artifact should carry.
|
||||
The existing issues on a project all open with it for this reason, not
|
||||
because it was typed."
|
||||
}
|
||||
|
||||
# What the session is told about the optional tools this launch enabled.
|
||||
#
|
||||
# The heading is core's and the body is each tool's own instructions.md, so a
|
||||
# tool describes itself once and every harness gets the same words. Nothing
|
||||
# here can change what the session may do - a tool's manifest has no key for
|
||||
# that - which is what makes rendering a project-selectable fragment into the
|
||||
# briefing safe at all.
|
||||
_briefing_core_tools() {
|
||||
local tools="$1" tool frag dir out=""
|
||||
out="Extra tools this session has, beyond the usual shell:"
|
||||
for tool in $tools; do
|
||||
dir="$(provider_dir tool "$tool")" || continue
|
||||
frag="$(manifest_get tool "$tool" instructions)" || frag=""
|
||||
out+=$'\n\n'
|
||||
out+="- **$tool** - $(manifest_get tool "$tool" description)"
|
||||
if [ -n "$frag" ] && [ -f "$dir/$frag" ]; then
|
||||
out+=$'\n\n'
|
||||
out+="$(sed 's/^/ /' "$dir/$frag")"
|
||||
fi
|
||||
done
|
||||
printf '%s' "$out"
|
||||
}
|
||||
|
||||
briefing_compose() {
|
||||
local forge="$1" workflow="$2" harness="$3"
|
||||
local caps autonomy workflow_frag harness_frag text
|
||||
@@ -1362,6 +1609,22 @@ briefing_compose() {
|
||||
text+="$(_briefing_core_corpus)"
|
||||
text+=$'\n\n'
|
||||
fi
|
||||
# Optional tools, from DEJIMA_TOOLS. A tool the session is not told about
|
||||
# is one it will not use, so the manifest's instructions fragment is the
|
||||
# whole of the wiring for a harness: dejima renders it rather than letting
|
||||
# the tool's own installer patch a config, which is the difference
|
||||
# docs/tools.md draws between a hardened tool and a bare install.
|
||||
if [ -n "${DEJIMA_TOOLS:-}" ]; then
|
||||
text+="$(_briefing_core_tools "${DEJIMA_TOOLS}")"
|
||||
text+=$'\n\n'
|
||||
fi
|
||||
# Only when something actually discloses. A session told about a marker
|
||||
# nothing adds would be told a falsehood, and would then reasonably write
|
||||
# one itself - which is the failure this paragraph exists to stop.
|
||||
if [ -n "${DEJIMA_DISCLOSE:-}" ]; then
|
||||
text+="$(_briefing_core_disclosure)"
|
||||
text+=$'\n\n'
|
||||
fi
|
||||
# The harness fragment closes the briefing: it supplies both the resume
|
||||
# command closing_a has just promised and the sentence about where the
|
||||
# session history it resumes from actually lives. Both are the harness's
|
||||
|
||||
+64
-5
@@ -23,10 +23,28 @@
|
||||
# when it takes the terminal at the prompt, and puts those same modes back on
|
||||
# `fg` rather than the ones the job was using - measured on both bash and zsh -
|
||||
# so without this the session comes back line-buffered and echoing. The SIGCONT
|
||||
# trap re-applies the modes the container run was using, then pokes the group
|
||||
# with SIGWINCH: the container client answers a resize by resizing the
|
||||
# container's TTY, which is what makes a full-screen harness repaint over
|
||||
# whatever the shell printed while the session was away.
|
||||
# trap re-applies the modes the container run was using.
|
||||
#
|
||||
# It then has to make the harness redraw, over whatever the shell printed while
|
||||
# the session was away. That used to be `kill -WINCH`, on the reasoning that a
|
||||
# resize is what makes a full-screen program repaint. The reasoning was right
|
||||
# and the signal was not enough: a program that answers SIGWINCH by re-reading
|
||||
# the size, seeing the same numbers and doing nothing gets a poke that costs it
|
||||
# nothing to ignore.
|
||||
#
|
||||
# Measured against the real programs rather than a stand-in, on a pty, counting
|
||||
# the bytes each wrote in a fixed window after each kind of poke:
|
||||
#
|
||||
# idle same-size SIGWINCH size changed and back
|
||||
# Claude Code 0 0 3337
|
||||
# Cline 0 0 17810
|
||||
# nvim (control) 0 3356 6724
|
||||
#
|
||||
# Both shipped harnesses ignore the signal outright. So the size is changed
|
||||
# and changed straight back, which is a genuine resize twice over: TIOCSWINSZ
|
||||
# raises SIGWINCH on the foreground process group by itself, the container
|
||||
# client answers a resize by resizing the container's TTY, and the harness
|
||||
# inside sees dimensions that actually moved.
|
||||
set -u
|
||||
|
||||
usage() {
|
||||
@@ -85,7 +103,48 @@ session_modes="$(stty -g < /dev/tty 2>/dev/null)" || exit 0
|
||||
|
||||
on_cont() {
|
||||
stty "$session_modes" < /dev/tty 2>/dev/null || true
|
||||
# The whole process group, since this script does not know the container
|
||||
|
||||
# One row shorter, held, and back. Only the kernel's idea of the size
|
||||
# changes - the terminal emulator is not told and does not need to be,
|
||||
# because what a program reads is the kernel's value. It ends where it
|
||||
# started, so a failure partway leaves the size wrong rather than the
|
||||
# session unusable, which is why the restore is unconditional.
|
||||
#
|
||||
# The hold is the whole of it, and the first version of this did not have
|
||||
# one. Two ioctls back to back are not a resize a program can see: the
|
||||
# signal arrives, the handler reads the size as it is NOW, and by then it
|
||||
# is back where it started. Measured on a pty, bytes written after the
|
||||
# poke:
|
||||
#
|
||||
# no hold 0.1s 0.2s
|
||||
# Cline 0 0 17810
|
||||
# Claude Code 0 3328 3328
|
||||
#
|
||||
# Cline sets the floor at something between 0.1 and 0.2 seconds. This uses
|
||||
# half a second, which is 2.5x that - headroom for the hop this could not
|
||||
# measure, since a real session's resize has to travel from the host tty
|
||||
# through the container client and the daemon to the container's own tty
|
||||
# before the harness sees it at all.
|
||||
#
|
||||
# The cost is that the terminal is one row short for half a second during
|
||||
# a resume, while the harness is redrawing anyway.
|
||||
local size rows
|
||||
size="$(stty size < /dev/tty 2>/dev/null)" || size=""
|
||||
rows="${size%% *}"
|
||||
case "$rows" in
|
||||
''|*[!0-9]*) rows="" ;;
|
||||
*) [ "$rows" -gt 1 ] || rows="" ;;
|
||||
esac
|
||||
if [ -n "$rows" ]; then
|
||||
stty rows "$((rows - 1))" < /dev/tty 2>/dev/null || true
|
||||
sleep 0.5
|
||||
stty rows "$rows" < /dev/tty 2>/dev/null || true
|
||||
fi
|
||||
|
||||
# Kept as well as the resize, and not redundant: nvim is the measured
|
||||
# example of a program that repaints on the bare signal, and a session
|
||||
# running one under `--cmd` should not be worse off than a harness. The
|
||||
# whole process group, since this script does not know the container
|
||||
# client's pid and SIGWINCH is ignored by default everywhere else in it.
|
||||
kill -WINCH 0 2>/dev/null || true
|
||||
}
|
||||
|
||||
@@ -97,6 +97,10 @@ tmux_prefix="$(remote_ttyd_tmux_prefix)"
|
||||
# cannot see. See docs/remote-access.md.
|
||||
focus_on_tap="$(remote_ttyd_focus_on_tap)"
|
||||
|
||||
# Whether the toolbar is colour-coded. Passed on only when set, for the same
|
||||
# reason as the line above: the page has a default and it is the right one.
|
||||
button_colors="$(remote_ttyd_button_colors)"
|
||||
|
||||
# Checked rather than left to exec, whose failure is bash's "ttyd: not found"
|
||||
# on a line number - true, and useless to an operator who needs to know that
|
||||
# the missing piece is a package.
|
||||
@@ -171,10 +175,13 @@ prefix_opt=()
|
||||
[ -z "$tmux_prefix" ] || prefix_opt=(-t "tmuxPrefix=$tmux_prefix")
|
||||
focus_opt=()
|
||||
[ -z "$focus_on_tap" ] || focus_opt=(-t "focusOnTap=$focus_on_tap")
|
||||
colors_opt=()
|
||||
[ -z "$button_colors" ] || colors_opt=(-t "buttonColors=$button_colors")
|
||||
|
||||
exec ttyd --interface 127.0.0.1 --port "$port" --check-origin --url-arg --writable \
|
||||
--index "$index_html" \
|
||||
${font_opt[@]+"${font_opt[@]}"} \
|
||||
${prefix_opt[@]+"${prefix_opt[@]}"} \
|
||||
${focus_opt[@]+"${focus_opt[@]}"} \
|
||||
${colors_opt[@]+"${colors_opt[@]}"} \
|
||||
"$SCRIPT_DIR/dejima-attach"
|
||||
|
||||
Executable
+184
@@ -0,0 +1,184 @@
|
||||
#!/bin/bash
|
||||
# Says when the dejima checkout a launch is running from is behind the branch
|
||||
# it tracks. Advisory: it prints and returns, and the session starts either
|
||||
# way. dejima updates by `git pull`, so "a newer version" means commits on the
|
||||
# branch this checkout already follows - there is no release channel to ask.
|
||||
#
|
||||
# The remote is contacted by URL, from outside the repository, and never by
|
||||
# remote name. `git ls-remote origin` reads the checkout's own config for how
|
||||
# to reach that remote, and core.sshCommand, credential.helper and
|
||||
# url.<base>.insteadOf each name a command git then runs on the host - which
|
||||
# is measurable, not theoretical. dejima mounts its own checkout writable when
|
||||
# it is the workspace (bin/dejima warns about this), so a session that wrote
|
||||
# .git/config there would get host execution out of the *next* launch. That is
|
||||
# the same class as the core.hooksPath route docs/security.md describes, with
|
||||
# one difference that matters: this one would fire on its own, where hooksPath
|
||||
# waits for the operator to run a git command. Reading the URL here and handing
|
||||
# it to a git started outside the repository leaves none of that config in the
|
||||
# path, and protocol.allow keeps the transports to the two that cannot name a
|
||||
# command.
|
||||
#
|
||||
# What still crosses that line is the URL itself, which a session with the same
|
||||
# write can point elsewhere. That costs one outbound request to a host of its
|
||||
# choosing, and no execution; dejima-audit reports the config change it took.
|
||||
#
|
||||
# Runs on the host, before the container exists.
|
||||
set -uo pipefail
|
||||
|
||||
case "${1:-}" in
|
||||
-h|--help)
|
||||
cat <<'DEJIMA_UPDATE_CHECK_HELP'
|
||||
dejima-update-check - say when this dejima checkout is behind its remote
|
||||
|
||||
Usage: dejima-update-check
|
||||
|
||||
Compares the checkout bin/dejima runs from against the branch it tracks and
|
||||
prints one line when the remote has commits this checkout does not. Run at
|
||||
startup by bin/dejima; safe to run by hand.
|
||||
|
||||
Silent when the checkout is current or ahead, when [core] update_check is off,
|
||||
when HEAD is detached or the branch has no counterpart on the remote, and
|
||||
whenever the remote cannot be reached. A version check that cannot answer is
|
||||
not a reason to interrupt a launch.
|
||||
|
||||
The remote is asked at most once an hour. In between, the answer it last gave
|
||||
is compared against the current HEAD, so the notice goes away as soon as you
|
||||
pull rather than an hour later. Nothing is fetched either way - this reads one
|
||||
branch tip and no objects.
|
||||
|
||||
See docs/configuration.md.
|
||||
DEJIMA_UPDATE_CHECK_HELP
|
||||
exit 0 ;;
|
||||
esac
|
||||
|
||||
# provider-lib rather than config-lib alone: an unknown key in the config file
|
||||
# is fatal, and [forge.<name>]/[harness.<name>] keys are only known once the
|
||||
# manifests are loaded.
|
||||
# shellcheck source=dejima-provider-lib.sh
|
||||
source "$(dirname "$(readlink -f "$0")")/dejima-provider-lib.sh"
|
||||
# shellcheck source=dejima-color-lib.sh
|
||||
source "$(dirname "$(readlink -f "$0")")/dejima-color-lib.sh"
|
||||
|
||||
REPO_ROOT="$(cd "$(dirname "$(readlink -f "$0")")/.." && pwd)"
|
||||
|
||||
# How long the remote's answer stands before it is asked again. Every launch
|
||||
# reads the cached tip and compares it to HEAD; only the network call is
|
||||
# throttled, so this is a bound on staleness of the remote half, not on how
|
||||
# often the operator is told.
|
||||
CHECK_INTERVAL=3600
|
||||
|
||||
# Not ~/.local/share/dejima, where the audit store and the epitaphs live: those
|
||||
# are the operator's records, each with a config key pointing at it. This is a
|
||||
# timestamp and a hash that can be deleted at any moment with no loss, which is
|
||||
# what XDG's state directory is for.
|
||||
_cache_file() {
|
||||
printf '%s/dejima/update-check' "${XDG_STATE_HOME:-$HOME/.local/state}"
|
||||
}
|
||||
|
||||
# Only the transports that cannot name a command to run. `ext::` is refused by
|
||||
# git itself, but the check is written against the shape of the URL rather than
|
||||
# against one scheme's current default, and a leading dash would be read as an
|
||||
# option by whatever eventually splits this.
|
||||
_usable_url() {
|
||||
case "$1" in
|
||||
-*|*'::'*) return 1 ;;
|
||||
https://*|ssh://*|file://*|/*) return 0 ;;
|
||||
*@*:*) return 0 ;; # scp-like, which is ssh
|
||||
*) return 1 ;;
|
||||
esac
|
||||
}
|
||||
|
||||
# The remote's tip for one branch, or nothing. GIT_DIR and GIT_WORK_TREE are
|
||||
# dropped so an inherited one cannot put a repository's config back in the path
|
||||
# that -C '/' takes it out of.
|
||||
_remote_tip() {
|
||||
local url="$1" ref="$2" out timeout=()
|
||||
command -v timeout >/dev/null 2>&1 && timeout=(timeout 5)
|
||||
out="$(env -u GIT_DIR -u GIT_WORK_TREE "${timeout[@]}" \
|
||||
git -C / \
|
||||
-c protocol.allow=never \
|
||||
-c protocol.https.allow=always \
|
||||
-c protocol.ssh.allow=always \
|
||||
-c protocol.file.allow=always \
|
||||
ls-remote --heads "$url" "$ref" 2>/dev/null)" || return 1
|
||||
printf '%s' "${out%%$'\t'*}"
|
||||
}
|
||||
|
||||
# stderr dropped rather than shown: a config this cannot read is one bin/dejima
|
||||
# has already refused to start on, and a version check is not the place anyone
|
||||
# should first hear about it.
|
||||
[ "$(config_get core update_check 2>/dev/null)" = "on" ] || exit 0
|
||||
|
||||
git -C "$REPO_ROOT" rev-parse --git-dir >/dev/null 2>&1 || exit 0
|
||||
# --quiet so a detached HEAD is silence rather than an error on the terminal.
|
||||
branch="$(git -C "$REPO_ROOT" symbolic-ref --quiet --short HEAD)" || exit 0
|
||||
head_sha="$(git -C "$REPO_ROOT" rev-parse HEAD 2>/dev/null)" || exit 0
|
||||
|
||||
# The branch's own remote, falling back to origin: a branch created locally has
|
||||
# no branch.<name>.remote until it is pushed, and comparing it against origin's
|
||||
# branch of the same name is the right answer when there is one and silence
|
||||
# when there is not.
|
||||
remote="$(git -C "$REPO_ROOT" config --get "branch.$branch.remote" 2>/dev/null)"
|
||||
[ -n "$remote" ] || remote=origin
|
||||
# The ref it tracks, which is not always its own name - `git worktree add -b x
|
||||
# origin/development` leaves a branch called x tracking refs/heads/development.
|
||||
# Asking for refs/heads/x there gets an empty answer and reports nothing, which
|
||||
# looks exactly like being up to date.
|
||||
upstream="$(git -C "$REPO_ROOT" config --get "branch.$branch.merge" 2>/dev/null)"
|
||||
case "$upstream" in refs/heads/*) ;; *) upstream="refs/heads/$branch" ;; esac
|
||||
url="$(git -C "$REPO_ROOT" config --get "remote.$remote.url" 2>/dev/null)" || exit 0
|
||||
[ -n "$url" ] || exit 0
|
||||
_usable_url "$url" || exit 0
|
||||
|
||||
cache="$(_cache_file)"
|
||||
tip=""
|
||||
if [ -f "$cache" ]; then
|
||||
read -r c_branch c_tip < "$cache" 2>/dev/null || true
|
||||
c_age=$(( $(date +%s) - $(stat -c %Y "$cache" 2>/dev/null || echo 0) ))
|
||||
if [ "${c_branch:-}" = "$upstream" ] && [ "$c_age" -lt "$CHECK_INTERVAL" ]; then
|
||||
tip="${c_tip:-}"
|
||||
cached=1
|
||||
fi
|
||||
fi
|
||||
|
||||
if [ -z "${cached:-}" ]; then
|
||||
# A failed lookup is recorded, not just skipped. Without that, a checkout
|
||||
# with no route to its remote pays the timeout on every single launch.
|
||||
tip="$(_remote_tip "$url" "$upstream")" || tip=""
|
||||
mkdir -p "$(dirname "$cache")" 2>/dev/null \
|
||||
&& printf '%s %s\n' "$upstream" "${tip:--}" > "$cache" 2>/dev/null
|
||||
fi
|
||||
|
||||
# "-" is a recorded failure; empty is a branch the remote does not have.
|
||||
case "${tip:-}" in ""|"-") exit 0 ;; esac
|
||||
[ "$tip" = "$head_sha" ] && exit 0
|
||||
|
||||
# Ahead, or on a branch that has since been rewritten: having the commit and
|
||||
# it being an ancestor of HEAD are two different questions, and only the second
|
||||
# means there is nothing to report.
|
||||
count=""
|
||||
if git -C "$REPO_ROOT" cat-file -e "$tip^{commit}" 2>/dev/null; then
|
||||
git -C "$REPO_ROOT" merge-base --is-ancestor "$tip" HEAD 2>/dev/null && exit 0
|
||||
count="$(git -C "$REPO_ROOT" rev-list --count "HEAD..$tip" 2>/dev/null)"
|
||||
fi
|
||||
|
||||
color_init
|
||||
# Both come out of the checkout's .git/config, which is session-writable when
|
||||
# dejima's own checkout is the workspace - the same reason the remote is
|
||||
# reached by URL rather than by name. A name carrying escape sequences would
|
||||
# fire on the terminal of the operator this is trying to inform.
|
||||
_remote_shown="$(sanitize "$remote")"
|
||||
_branch_shown="$(sanitize "${upstream#refs/heads/}")"
|
||||
# The count only when it is known. It is not, whenever the remote's tip is a
|
||||
# commit this checkout has never fetched, which is the common case - and a
|
||||
# number invented for those would be the number of commits it can see, not the
|
||||
# number there are.
|
||||
if [ -n "$count" ] && [ "$count" != "0" ]; then
|
||||
if [ "$count" = "1" ]; then noun="commit"; else noun="commits"; fi
|
||||
printf '%sdejima%s: %s/%s has %s %s this checkout does not.\n' \
|
||||
"$C_KEY" "$C_RESET" "$_remote_shown" "$_branch_shown" "$C_INFO$count$C_RESET" "$noun" >&2
|
||||
else
|
||||
printf '%sdejima%s: %s/%s has commits this checkout does not.\n' \
|
||||
"$C_KEY" "$C_RESET" "$_remote_shown" "$_branch_shown" >&2
|
||||
fi
|
||||
printf ' Update with %sgit -C %s pull%s\n' "$C_KEY" "$REPO_ROOT" "$C_RESET" >&2
|
||||
@@ -10,8 +10,17 @@
|
||||
# reason this is code is the pairing in the second block, which resolves one
|
||||
# directory tree through the filenames of another.
|
||||
|
||||
# Registers the waiting/done notification handlers into dejima's settings
|
||||
# layer, in the shape Claude Code reads them.
|
||||
# Registers the `done` notification handler into dejima's settings layer, in
|
||||
# the shape Claude Code reads them.
|
||||
#
|
||||
# Stop only, though the hook and the host-side watcher both understand
|
||||
# `waiting` as well. Claude Code raises Notification when it needs permission
|
||||
# to run something and when the prompt has sat idle, and a dejima session runs
|
||||
# with permission prompts off - so the first never happens, and what is left
|
||||
# is a timer that expires shortly after the Stop it follows. Registering both
|
||||
# put two pushes on the operator's phone for one event, a minute apart, the
|
||||
# second saying nothing the first had not. `waiting` stays in the enum for a
|
||||
# harness that can say it without having stopped first.
|
||||
#
|
||||
# Claude Code merges hook entries across settings layers rather than letting
|
||||
# the higher one replace the lower, so these are added to whatever the
|
||||
@@ -25,8 +34,7 @@
|
||||
harness_register_notify() {
|
||||
local settings="$1" tmp
|
||||
tmp="$(mktemp "${TMPDIR:-/tmp}/dejima-settings-remote.XXXXXX.json")"
|
||||
if jq '.hooks.Notification = ((.hooks.Notification // []) + [{"matcher": "", "hooks": [{"type": "command", "command": "$HOME/.claude/hooks/dejima-notify.sh waiting"}]}])
|
||||
| .hooks.Stop = ((.hooks.Stop // []) + [{"matcher": "", "hooks": [{"type": "command", "command": "$HOME/.claude/hooks/dejima-notify.sh done"}]}])' \
|
||||
if jq '.hooks.Stop = ((.hooks.Stop // []) + [{"matcher": "", "hooks": [{"type": "command", "command": "$HOME/.claude/hooks/dejima-notify.sh done"}]}])' \
|
||||
"$settings" > "$tmp"; then
|
||||
mv "$tmp" "$settings"
|
||||
else
|
||||
@@ -444,6 +452,36 @@ harness_transcript_files() {
|
||||
done < <(workspace_slugs_sorted "$ws")
|
||||
}
|
||||
|
||||
# Which sessions still have a transcript on disk, as "<key>\t<session-id>"
|
||||
# lines. `dejima-epitaph list` matches an epitaph's own session id against
|
||||
# this to say whether resuming the real session is still on offer, and it has
|
||||
# no way to work that out for itself: the id is in the filename here and is
|
||||
# the directory name for the next harness.
|
||||
#
|
||||
# $1 is a workspace, or absent for every key this harness holds transcripts
|
||||
# under - which is what `list --all` needs, since a store key is a slug and a
|
||||
# slug does not resolve back to a path.
|
||||
harness_live_sessions() {
|
||||
local ws="${1:-}" projects key f d
|
||||
projects="$(harness_config_get projects_dir)"
|
||||
[ -n "$projects" ] || return 0
|
||||
if [ -n "$ws" ]; then
|
||||
while IFS=$'\t' read -r key f; do
|
||||
[ -n "$f" ] || continue
|
||||
printf '%s\t%s\n' "$key" "$(basename "$f" .jsonl)"
|
||||
done < <(harness_transcript_files "$ws")
|
||||
return 0
|
||||
fi
|
||||
for d in "$projects"/*/; do
|
||||
[ -d "$d" ] || continue
|
||||
key="$(basename "$d")"
|
||||
for f in "$d"/*.jsonl; do
|
||||
[ -f "$f" ] || continue
|
||||
printf '%s\t%s\n' "$key" "$(basename "$f" .jsonl)"
|
||||
done
|
||||
done
|
||||
}
|
||||
|
||||
# Compaction summaries out of this harness's transcripts.
|
||||
#
|
||||
# Claude Code writes line-delimited JSON, one record per line, with the
|
||||
|
||||
@@ -218,7 +218,7 @@ harness_prepare_config() {
|
||||
echo "yourself, which needs no key. That means a loopback or RFC 1918" >&2
|
||||
echo "address, or a host you have allowlisted:" >&2
|
||||
echo "" >&2
|
||||
echo " bin/dejima-allow --project <path> <host>" >&2
|
||||
echo " dejima-allow --project <path> <host>" >&2
|
||||
echo "" >&2
|
||||
echo "The allowlist is what decides whether the container can reach it" >&2
|
||||
echo "at all, so an endpoint that fails this check is one the session" >&2
|
||||
|
||||
@@ -301,6 +301,17 @@ COPY docker/install-forge-bins.sh /tmp/install-forge-bins.sh
|
||||
RUN bash /tmp/install-forge-bins.sh /tmp/forges /usr/local/lib/dejima/forge /usr/local/bin \
|
||||
&& rm -rf /tmp/forges /tmp/install-forge-bins.sh
|
||||
|
||||
# The other half of NODE_PATH, which only ever applied to require(): ESM
|
||||
# resolution ignores it entirely and walks up from the importing file looking
|
||||
# for node_modules, so `import { chromium } from "playwright"` fails from
|
||||
# every directory a script is likely to be written in while require() of the
|
||||
# same package succeeds. At the root, that walk always ends here.
|
||||
#
|
||||
# It is worth a line because of how the failure reads. An agent writing the
|
||||
# modern form gets ERR_MODULE_NOT_FOUND, concludes the image has no browser,
|
||||
# and describes what a page should look like instead of going and seeing.
|
||||
RUN ln -s /usr/local/share/npm-global/lib/node_modules /node_modules
|
||||
|
||||
RUN chmod +x /usr/local/bin/dns-proxy.sh /usr/local/bin/init-firewall.sh /usr/local/bin/log-shipper.sh /usr/local/bin/entrypoint.sh /usr/local/bin/dejima-harness-wrapper /usr/local/lib/dejima/git-guard.sh /usr/local/lib/dejima/forge-guard.sh /usr/local/lib/dejima/dejima-briefing-render.sh && \
|
||||
echo 'export PATH="$PATH:/usr/local/share/npm-global/bin"' > /etc/profile.d/npm-global-path.sh
|
||||
|
||||
|
||||
@@ -42,9 +42,50 @@ services:
|
||||
# ten per run - becomes a permanent zombie, and a long session eventually
|
||||
# exhausts the cgroup pids limit and can no longer fork at all.
|
||||
init: true
|
||||
# An explicit floor rather than Docker's default set plus two. The default
|
||||
# carries about fourteen capabilities and this container uses seven: it
|
||||
# writes and chowns files, runs the firewall, drops privilege twice (gosu
|
||||
# for the session, `ulogd -u` for the log daemon), and signals dnsmasq.
|
||||
# FSETID, MKNOD, SETFCAP, SETPCAP, SYS_CHROOT, AUDIT_WRITE and
|
||||
# NET_BIND_SERVICE are used by nothing here - the last one because the
|
||||
# sysctl below is what lets the TLS terminator bind :443 unprivileged.
|
||||
#
|
||||
# KILL is the one worth explaining, because it is not obvious from reading
|
||||
# entrypoint.sh and was missing from the first version of this list. It is
|
||||
# not for anything the entrypoint does. `dejima-allow --container` adds a
|
||||
# domain to a RUNNING session by appending a server= line and sending
|
||||
# dnsmasq a SIGHUP, from outside via docker exec - and dnsmasq drops to its
|
||||
# own user (`user=dnsmasq`), so root in this container cannot signal it
|
||||
# without CAP_KILL. Without this line, adding a domain mid-session fails
|
||||
# with "Operation not permitted", which is a documented feature every
|
||||
# session briefing tells the agent to ask for.
|
||||
#
|
||||
# The general lesson, since the next capability will be the same shape:
|
||||
# what the container needs is not only what its entrypoint does. Things
|
||||
# reach into it later.
|
||||
#
|
||||
# This narrows the ROOT phase. The session user's capabilities were already
|
||||
# empty: they are cleared on the gosu drop, which runtime.bats asserts by
|
||||
# reading CapEff of the running process. What this adds is that the set was
|
||||
# never there to be regained.
|
||||
cap_drop:
|
||||
- ALL
|
||||
cap_add:
|
||||
- NET_ADMIN
|
||||
- NET_RAW
|
||||
- CHOWN
|
||||
- DAC_OVERRIDE
|
||||
- FOWNER
|
||||
- SETUID
|
||||
- SETGID
|
||||
- KILL
|
||||
# No path back up. gosu drops privilege rather than gaining it, so this
|
||||
# does not interfere with it - what it forbids is a setuid binary or a file
|
||||
# capability raising privileges on exec, which is the shape any escalation
|
||||
# from the session user would have to take. The gosu claim becomes
|
||||
# structural instead of only observed.
|
||||
security_opt:
|
||||
- no-new-privileges:true
|
||||
# The credential-proxy TLS terminator binds :443 as the unprivileged
|
||||
# sandbox user (see entrypoint.sh). Docker already defaults this to 0, but
|
||||
# pinning it makes the dependency explicit: a future default change then
|
||||
|
||||
+118
-13
@@ -1,7 +1,7 @@
|
||||
#!/bin/bash
|
||||
# Shadows a forge CLI on PATH, so that two rules hold whatever ran it: the one
|
||||
# subcommand a workflow blocks is refused, and a body the session authored says
|
||||
# so.
|
||||
# Shadows a forge CLI on PATH, so that three rules hold whatever ran it: the
|
||||
# one subcommand a workflow blocks is refused, a command aimed at another
|
||||
# repository is refused, and a body the session authored says so.
|
||||
#
|
||||
# The first rule is the one hooks/merge-guard.sh applies - a merge is the
|
||||
# operator's decision, so the sandbox opens a PR and stops - moved off the
|
||||
@@ -26,6 +26,10 @@
|
||||
# "pr gitea-pr create". Both are resolved host-side by
|
||||
# bin/dejima from the forge's manifest, never hardcoded
|
||||
# to a forge here.
|
||||
# DEJIMA_FORGE_REPO the "<owner>/<name>" of the repository the session
|
||||
# was launched against, and DEJIMA_FORGE_REPO_FLAGS /
|
||||
# DEJIMA_FORGE_REPO_ENV the spellings this forge's CLI
|
||||
# accepts for naming a different one.
|
||||
# DEJIMA_FORGE_REAL_DIR where the real CLIs live, behind the shadow.
|
||||
set -u
|
||||
|
||||
@@ -39,7 +43,8 @@ fi
|
||||
|
||||
# Outside a dejima container, or with nothing to do, this is a pass-through.
|
||||
if [ -z "${DEJIMA:-}" ] ||
|
||||
{ [ -z "${DEJIMA_MERGE_BLOCK:-}" ] && [ -z "${DEJIMA_DISCLOSE:-}" ]; }; then
|
||||
{ [ -z "${DEJIMA_MERGE_BLOCK:-}" ] && [ -z "${DEJIMA_DISCLOSE:-}" ] &&
|
||||
[ -z "${DEJIMA_FORGE_REPO_FLAGS:-}" ] && [ -z "${DEJIMA_FORGE_REPO_ENV:-}" ]; }; then
|
||||
exec "$real" "$@"
|
||||
fi
|
||||
|
||||
@@ -100,6 +105,73 @@ if [ -n "${DEJIMA_MERGE_BLOCK:-}" ]; then
|
||||
fi
|
||||
fi
|
||||
|
||||
# --- the repository the session was launched against ------------------------
|
||||
#
|
||||
# A forge whose CLI can be aimed elsewhere declares how (repo_flags,
|
||||
# repo_env). The gitea CLIs declare neither, because they resolve the repo
|
||||
# from origin and refuse another host; `gh` declares both, so on that path the
|
||||
# most ordinary way to name a PR from outside its checkout is also the way to
|
||||
# file an issue on a repository the session has nothing to do with (#187).
|
||||
#
|
||||
# Fast-fail, not a boundary, for the same reason the merge block is not one:
|
||||
# the session holds the token and could call the API directly. What bounds
|
||||
# this is the scope of push_token_file.
|
||||
#
|
||||
# Refused rather than skipped when the launch resolved no repository at all: a
|
||||
# workspace with no origin has nothing for --repo to legitimately name, and
|
||||
# "cannot confirm" is not a reason to let it through.
|
||||
if [ -n "${DEJIMA_FORGE_REPO_FLAGS:-}" ] || [ -n "${DEJIMA_FORGE_REPO_ENV:-}" ]; then
|
||||
refuse_repo() {
|
||||
echo "Blocked by dejima's forge guard: this session was launched against ${DEJIMA_FORGE_REPO:-no repository}, and $1 names '$2'. Act on the repository the sandbox mounts." >&2
|
||||
exit 1
|
||||
}
|
||||
# Case-insensitively: forges treat an owner and a repository name as
|
||||
# case-preserving but not case-sensitive, and a refusal over capitalisation
|
||||
# would be a false one.
|
||||
same_repo() {
|
||||
[ -n "${DEJIMA_FORGE_REPO:-}" ] && [ "${1,,}" = "${DEJIMA_FORGE_REPO,,}" ]
|
||||
}
|
||||
if [ -n "${DEJIMA_FORGE_REPO_ENV:-}" ]; then
|
||||
env_value="${!DEJIMA_FORGE_REPO_ENV:-}"
|
||||
if [ -n "$env_value" ] && ! same_repo "$env_value"; then
|
||||
refuse_repo "$DEJIMA_FORGE_REPO_ENV" "$env_value"
|
||||
fi
|
||||
fi
|
||||
if [ -n "${DEJIMA_FORGE_REPO_FLAGS:-}" ]; then
|
||||
read -ra repo_flags <<< "$DEJIMA_FORGE_REPO_FLAGS"
|
||||
args_left=("$@")
|
||||
while [ "${#args_left[@]}" -gt 0 ]; do
|
||||
arg="${args_left[0]}"
|
||||
args_left=("${args_left[@]:1}")
|
||||
for flag in "${repo_flags[@]}"; do
|
||||
value=""
|
||||
case "$arg" in
|
||||
"$flag")
|
||||
# The value is the next argument, and its absence is
|
||||
# the CLI's error to report rather than this one's.
|
||||
[ "${#args_left[@]}" -gt 0 ] || continue
|
||||
value="${args_left[0]}"
|
||||
;;
|
||||
"$flag"=*) value="${arg#*=}" ;;
|
||||
*)
|
||||
# A one-dash flag may carry its value with no
|
||||
# separator - `-Rowner/name` - which two-dash flags do
|
||||
# not do.
|
||||
case "$flag" in
|
||||
--*) continue ;;
|
||||
-?) ;;
|
||||
*) continue ;;
|
||||
esac
|
||||
case "$arg" in "$flag"?*) value="${arg#"$flag"}" ;; *) continue ;; esac
|
||||
;;
|
||||
esac
|
||||
[ -n "$value" ] || continue
|
||||
same_repo "$value" || refuse_repo "$flag" "$value"
|
||||
done
|
||||
done
|
||||
fi
|
||||
fi
|
||||
|
||||
# --- the authorship disclosure ---------------------------------------------
|
||||
|
||||
[ -n "${DEJIMA_DISCLOSE:-}" ] || exec "$real" "$@"
|
||||
@@ -163,12 +235,49 @@ read_body_or_die() {
|
||||
body="$(cat -- "$1")" || exit 1
|
||||
}
|
||||
|
||||
# The path to a temp file holding the marker and the body. Set outside the
|
||||
# command substitution as well, so the caller can delete it afterwards.
|
||||
# The body with the marker on it, whichever way the body arrived.
|
||||
#
|
||||
# One function for all four spellings, because there were two: --body-file
|
||||
# went through here and --body prepended the marker inline at its own call
|
||||
# site, so a rule added in one place was not in force in the other. That is
|
||||
# the whole reason this exists as a function rather than as a printf repeated
|
||||
# four times.
|
||||
#
|
||||
# Idempotent, which is the rule that was missing. An agent that has read the
|
||||
# project's existing issues has seen every one of them open with this line,
|
||||
# and writes it into the body itself - at which point a second was added and
|
||||
# the artifact said it twice. Each doubled issue then taught the next agent to
|
||||
# do the same, so it spread rather than settling.
|
||||
#
|
||||
# Skipping is safe because the marker is a statement, not a count: a body that
|
||||
# already opens by saying an agent wrote it has disclosed exactly what this
|
||||
# exists to disclose. Anchored at the start, after leading whitespace - the
|
||||
# same words further down are prose ABOUT disclosure rather than the
|
||||
# disclosure, and still get one prepended.
|
||||
#
|
||||
# The whole first LINE has to be the marker, not just begin with it. A prefix
|
||||
# test let a body open `**Filed by LLM agent** - reviewed and confirmed by a
|
||||
# person` and skip, which makes the marker line itself agent-authorable: the
|
||||
# one line here exists to write is the one the session gets to finish. Trailing
|
||||
# whitespace is allowed because it is invisible and changes nothing.
|
||||
with_marker() {
|
||||
local head first
|
||||
head="${1#"${1%%[![:space:]]*}"}"
|
||||
first="${head%%$'\n'*}"
|
||||
first="${first%"${first##*[![:space:]]}"}"
|
||||
if [ "$first" = "$marker" ]; then
|
||||
printf '%s' "$1"
|
||||
return 0
|
||||
fi
|
||||
printf '%s\n\n%s' "$marker" "$1"
|
||||
}
|
||||
|
||||
# The path to a temp file holding the disclosed body. Set outside the command
|
||||
# substitution as well, so the caller can delete it afterwards.
|
||||
tmp=""
|
||||
disclosed() {
|
||||
tmp="$(mktemp)" || exit 1
|
||||
printf '%s\n\n%s' "$marker" "$1" > "$tmp" || exit 1
|
||||
with_marker "$1" > "$tmp" || exit 1
|
||||
}
|
||||
|
||||
# Only the first body argument is rewritten. A second would mean the CLI is
|
||||
@@ -200,18 +309,14 @@ while [ "$#" -gt 0 ]; do
|
||||
;;
|
||||
--body)
|
||||
if [ "$#" -ge 2 ]; then
|
||||
args+=(--body "$marker
|
||||
|
||||
$2")
|
||||
args+=(--body "$(with_marker "$2")")
|
||||
rewrote=1
|
||||
shift 2
|
||||
continue
|
||||
fi
|
||||
;;
|
||||
--body=*)
|
||||
args+=("--body=$marker
|
||||
|
||||
${1#--body=}")
|
||||
args+=("--body=$(with_marker "${1#--body=}")")
|
||||
rewrote=1
|
||||
shift
|
||||
continue
|
||||
|
||||
+46
-1
@@ -49,14 +49,59 @@ ipset destroy github-domains 2>/dev/null || true
|
||||
# level, e.g. no ip6_tables module) - once it's confirmed to work at all, a
|
||||
# failure partway through must fail the whole script (set -e, no more
|
||||
# blanket `|| true`) rather than silently leaving IPv6 wide open.
|
||||
#
|
||||
# The `else` below used to log that the family was presumably off at the
|
||||
# kernel level, and continue. That inferred a fact about the WORLD from a fact
|
||||
# about a TOOL, and the two are not the same condition: a container whose kernel
|
||||
# lacks ip6_tables, on a host with IPv6 enabled, took that branch, logged a
|
||||
# reassuring line, and ran with IPv6 live and unfiltered. Nothing failed,
|
||||
# because the only thing that had happened was a check that could not tell.
|
||||
#
|
||||
# So the branch asks the kernel instead. /proc/net/if_inet6 lists every IPv6
|
||||
# address on every interface, and it is the netns's own view - present with
|
||||
# `::1` alone when the stack is up and nothing is reachable, absent entirely
|
||||
# when IPv6 is compiled out.
|
||||
#
|
||||
# Loopback does not count. Refusing to start over `::1` would refuse every
|
||||
# container that has no IPv6 connectivity at all, which is a false refusal
|
||||
# for the common case. What matters is an address on an interface that leaves
|
||||
# the box.
|
||||
_ipv6_off_box() {
|
||||
[ -e /proc/net/if_inet6 ] || return 1
|
||||
# address ifindex prefixlen scope flags devname
|
||||
awk '$6 != "lo" { found = 1 } END { exit !found }' /proc/net/if_inet6
|
||||
}
|
||||
|
||||
if ip6tables -L >/dev/null 2>&1; then
|
||||
ip6tables -F
|
||||
ip6tables -X
|
||||
ip6tables -P INPUT DROP
|
||||
ip6tables -P OUTPUT DROP
|
||||
ip6tables -P FORWARD DROP
|
||||
elif _ipv6_off_box; then
|
||||
echo "ip6tables is unusable here, and IPv6 is live on an interface that" >&2
|
||||
echo "leaves this container. Turning the family off in this network" >&2
|
||||
echo "namespace, since it cannot be filtered." >&2
|
||||
# Written to /proc directly rather than through sysctl(8), which is one
|
||||
# more thing that has to be in the image for the firewall to hold. Per
|
||||
# interface as well as `all`, because which of those flushes existing
|
||||
# addresses has varied across kernels.
|
||||
for _conf in /proc/sys/net/ipv6/conf/*/disable_ipv6; do
|
||||
[ -w "$_conf" ] || continue
|
||||
echo 1 > "$_conf" 2>/dev/null || true
|
||||
done
|
||||
if _ipv6_off_box; then
|
||||
echo "" >&2
|
||||
echo "IPv6 is still up and there is no way to filter it from here, so" >&2
|
||||
echo "every rule below would be bypassable by an AAAA-resolved address." >&2
|
||||
echo "Refusing to start rather than reporting a boundary that is not" >&2
|
||||
echo "there. Either give the container a usable ip6tables (the" >&2
|
||||
echo "ip6_tables module on the host), or disable IPv6 for its network." >&2
|
||||
exit 1
|
||||
fi
|
||||
echo "IPv6 is off in this namespace."
|
||||
else
|
||||
echo "ip6tables unusable - assuming IPv6 is unavailable at the kernel level"
|
||||
echo "ip6tables unusable, and no IPv6 address outside loopback - nothing to filter"
|
||||
fi
|
||||
|
||||
# Reinsert just the rules captured above - nothing else Docker had set up in
|
||||
|
||||
+113
-9
@@ -23,9 +23,12 @@ config file behind them.
|
||||
| Key | Default | Purpose |
|
||||
| --- | --- | --- |
|
||||
| `[core] harness` | *(none - must be set)* | agent harness the container runs; refused if unset, so a later default cannot change your selection. Also settable per launch with `--harness`, which is how a host keeps one harness as its default and reaches another when it wants to |
|
||||
| `[core] forge` | `none` | forge integration: `gitea` (`gitea-pr`/`gitea-issue`), `github` (`gh`, opens `ssh.github.com:22` for push), or `none` (no forge at all) |
|
||||
| `[core] forge` | `none` | forge integration: `gitea` (`gitea-pr`/`gitea-issue`), `github` (`gh`/`github-pr`, opens `ssh.github.com:22` for push), or `none` (no forge at all) |
|
||||
| `[core] workflow` | `local-only` | workflow `sandbox-context.sh` tells the agent to follow: `worktree-pr` (push + open a PR), `branch-push` (push, stop at the branch), or `local-only` (commit locally, push nothing) |
|
||||
| `[core] command` | `claude` | container's main process (e.g. `nvim`), also settable per launch with `--cmd` |
|
||||
| `[core] command` | *(the selected harness's own `command`)* | container's main process (e.g. `nvim`), also settable per launch with `--cmd`. Overriding it changes what dejima launches, not which harness is wrapped |
|
||||
| `[core] identity` | unset | which `[identity.<name>]` section supplies this project's credentials and git name; also settable per launch with `--identity`. A name with no section is refused rather than falling back |
|
||||
| `[core] tools` | unset | optional tools to put in the image, colon-separated; also `.dejima/tools` in a project (approved first) and `--include` per launch. None by default. See [docs/tools.md](tools.md) |
|
||||
| `[core] update_check` | `on` | at startup, say when this checkout is behind the branch it tracks. One `ls-remote` to your own remote, at most hourly, never fetching; `off` makes dejima contact nothing of its own accord |
|
||||
| `[core] firewall` | `on` | egress firewall; `off` disables it (debugging only), also settable per launch with `--no-firewall` |
|
||||
| `[core] share_dir` | `~/.local/share/dejima/shared` | host-visible read/write scratch dir, mounted at `~/shared` |
|
||||
| `[core] ssh_key` | unset | dedicated deploy key for headless/unattended git push |
|
||||
@@ -33,9 +36,9 @@ config file behind them.
|
||||
| `[harness.claude-code] projects_dir` | `~/.claude/projects` | where Claude Code session transcripts live |
|
||||
| `[harness.claude-code] file_history_dir` | `~/.claude/file-history` | Claude Code's edit-undo record, mounted per session rather than whole |
|
||||
| `[harness.claude-code] statusline_path` | `~/.claude/statusline.sh` | statusline script path |
|
||||
| `[harness.cline] model` | *(none - must be set)* | model id the endpoint serves; no default, because any shipped one goes stale with the next Cline release |
|
||||
| `[harness.cline] base_url` | unset | OpenAI-compatible endpoint. Unset means Anthropic through dejima's credential proxy. Accepts a loopback or RFC 1918 address, or a host you have allowlisted |
|
||||
| `[harness.cline] context_window` | unset | tokens Cline may use before compacting. Needed for a model it has no catalogue entry for, which is every self-served one |
|
||||
| `[harness.cline] model` | *(none - must be set)* | model id the endpoint serves; no default, because any shipped one goes stale with the next Cline release. Also settable per launch with `--model` |
|
||||
| `[harness.cline] base_url` | unset | OpenAI-compatible endpoint. Unset means Anthropic through dejima's credential proxy. Accepts a loopback or RFC 1918 address, or a host you have allowlisted. Also settable per launch with `--base-url` |
|
||||
| `[harness.cline] context_window` | unset | tokens Cline may use before compacting. Needed for a model it has no catalogue entry for, which is every self-served one. Also settable per launch with `--context-window` |
|
||||
| `[harness.cline] state_dir` | `~/.local/share/dejima/cline` | per-project Cline state; one directory per workspace |
|
||||
| `[forge.gitea] ssh_host` | unset | Gitea/Forgejo SSH hostname: skip if you only push to GitHub |
|
||||
| `[forge.gitea] api` | unset | `https://<gitea host>/api/v1`: skip if you only push to GitHub |
|
||||
@@ -47,20 +50,24 @@ config file behind them.
|
||||
| `[mounts] nvim_config` | unset | nvim config dir, used when `[core] command = nvim` |
|
||||
| `[credentials] proxy` | `on` | host-side credential proxy; `off` mounts the real OAuth credential into the container directly |
|
||||
| `[credentials] transport` | `tls` | set to `loopback` to fall back to a plaintext forwarder with an explicit `ANTHROPIC_BASE_URL`, keeping the credential out of the container but reinstating the base-URL fingerprint: for when certificate pinning breaks the default TLS path (see [security notes](docs/security.md)) |
|
||||
| `[logging] loki_url` | unset | ship DNS/firewall logs to a Loki endpoint |
|
||||
| `[epitaph] enabled` | `on` | keep the summary Claude Code writes when a session compacts |
|
||||
| `[logging] loki_url` | unset | ship DNS/firewall logs to a Loki endpoint; `--no-log` clears it for one launch, which silences everything downstream of it |
|
||||
| `[epitaph] enabled` | `on` | keep the summary a harness writes when a session compacts; `--no-epitaph` skips it for one launch |
|
||||
| `[epitaph] dir` | `~/.local/share/dejima/epitaphs` | where they are kept; never mounted into a container |
|
||||
| `[epitaph] loki` | `off` | also push each epitaph to `[logging] loki_url`, host-side |
|
||||
| `[logging] conversation` | `off` | opt-in: also ship session transcripts to Loki (needs `loki_url`); see "Conversation logging (opt-in)" in docs/security.md |
|
||||
| `[logging] conversation` | `off` | opt-in: also ship session transcripts to Loki (needs `loki_url`); see "Conversation logging (opt-in)" in docs/security.md. `--no-conversation` turns it off for one launch, and `--no-log` implies it |
|
||||
| `[audit] dir` | `~/.local/share/dejima/audit` | where exit-time audit findings are stored |
|
||||
| `[audit] baselines_dir` | `~/.local/share/dejima/baselines` | where audit baselines are stored |
|
||||
| `[audit] keep` | `10` | how many past findings/baselines to retain |
|
||||
| `[audit] strict` | `off` | refuse a headless (non-tty) launch over unacknowledged CRITICAL findings |
|
||||
| `[audit] diffs` | `on` | keep the diff of what changed alongside each finding; `off` records that something changed without retaining the content |
|
||||
| `[audit] strict` | `off` | refuse a headless (non-tty) launch over unacknowledged CRITICAL findings; also settable per launch with `--strict-audit` |
|
||||
| `[remote-access] enabled` | `off` | the switch: nothing in "Remote access" below runs until this is `on` |
|
||||
| `[remote-access] ntfy_url` | unset | ntfy topic URL for session notifications |
|
||||
| `[remote-access] base_url` | unset | public URL of the web front door, for notification links |
|
||||
| `[remote-access] ttyd_port` | `7681` | port `ttyd` listens on |
|
||||
| `[remote-access] ttyd_font_size` | unset | `ttyd` terminal font size |
|
||||
| `[remote-access] ttyd_tmux_prefix` | unset | the tmux prefix the page's buttons send; the page assumes stock `C-b` without it |
|
||||
| `[remote-access] ttyd_focus_on_tap` | unset | `on` lets a tap on the terminal raise the phone keyboard; unset means only the KBD button does |
|
||||
| `[remote-access] ttyd_button_colors` | unset | `off` returns the toolbar to monochrome |
|
||||
| `[remote-access] debounce` | `60` | seconds between repeat notifications for the same session |
|
||||
|
||||
**No forge is the default**: `[core] forge = none` with
|
||||
@@ -418,6 +425,55 @@ editing the base `Dockerfile`: a dependency added that way is declared,
|
||||
approved and layered like any other, and it survives a rebuild. Editing the
|
||||
Dockerfile directly puts it outside that record.
|
||||
|
||||
## Identities
|
||||
|
||||
One machine, several accounts. A `[identity.<name>]` section groups the things
|
||||
that belong to a **person** rather than to a project - the SSH key, the forge
|
||||
token, the name on the commits - so that selecting an account is one word
|
||||
rather than four edits.
|
||||
|
||||
```ini
|
||||
[identity.work]
|
||||
ssh_key = ~/.ssh/id_work
|
||||
user_name = A Name
|
||||
user_email = name@work.example
|
||||
token_file = ~/.config/gitea/work-token
|
||||
|
||||
[identity.oss]
|
||||
ssh_key = ~/.ssh/id_oss
|
||||
user_email = name@personal.example
|
||||
push_token_file = ~/.config/gh/oss-push
|
||||
```
|
||||
|
||||
Select one with `[core] identity = work`, or per launch with
|
||||
`--identity oss`.
|
||||
|
||||
**What an identity may set** is deliberately narrow: `ssh_key`, `user_name`,
|
||||
`user_email`, and whichever keys the forges declare as a person's. A forge
|
||||
says which of its own keys those are (`identity_keys` in its manifest), so
|
||||
`token_file` belongs to an identity on the gitea path and `push_token_file`
|
||||
does on the GitHub one, and neither is a list core keeps its own copy of.
|
||||
|
||||
**A key an identity does not set falls through to the file.** The `oss`
|
||||
identity above names no `token_file`, so `[forge.gitea] token_file` answers
|
||||
for it. An identity is an override for what it names, not a replacement for
|
||||
the section.
|
||||
|
||||
**A name with no section is refused.** `[core] identity = wrok` does not
|
||||
quietly use this machine's own credentials - it stops the launch and says so.
|
||||
Pushing under the wrong key fails loudly; pushing under your default key when
|
||||
you asked for another one does not fail at all, which is the direction worth
|
||||
being careful about.
|
||||
|
||||
**`user_name` and `user_email` reach the container's git config**, appended to
|
||||
the copy dejima already makes of your `~/.gitconfig`. Your real one is not
|
||||
touched, which was already true and is what the copy exists for.
|
||||
|
||||
This is the half of per-project configuration that a project cannot carry: a
|
||||
project's `.dejima/` is committed and shared with everyone working on it, and
|
||||
a key path is yours and your machine's. A project can say which identity it
|
||||
wants; only you can say where that identity's key lives.
|
||||
|
||||
## Headless git push without agent forwarding
|
||||
|
||||
**The reason to do this is identity, not uptime.** A forwarded agent
|
||||
@@ -581,6 +637,54 @@ means anything you left in it is readable by every session after the one you
|
||||
left it for. A credential dropped in there to get one job done, and then
|
||||
forgotten, is a credential you have handed to every session since.
|
||||
|
||||
## Reading what a session left behind
|
||||
|
||||
When a session compacts, the summary it writes is the only durable account of
|
||||
what a long session worked out - and it goes with the container. dejima keeps
|
||||
a copy host-side, in `[epitaph] dir`, from `bin/dejima`'s exit trap. That
|
||||
directory is never mounted into a container.
|
||||
|
||||
Three commands read it, all defaulting to the repository you are standing in:
|
||||
|
||||
```sh
|
||||
dejima-epitaph list # what is kept, oldest first
|
||||
dejima-epitaph search "dns proxy" # which one was it
|
||||
dejima-epitaph show 12 # open it in $VISUAL or $EDITOR
|
||||
```
|
||||
|
||||
`show` takes a position from the listing that `list` and `search` print, or
|
||||
an epitaph's filename, and defaults to the newest. It opens an editor when
|
||||
there is a terminal to open one on and writes to stdout when there is not, so
|
||||
`dejima-epitaph show | grep` behaves. `--all` widens `list` and `search` to
|
||||
every project on the machine, which is also how to see everything the store
|
||||
holds.
|
||||
|
||||
**`list` says whether each session is still resumable.** Where it is, the
|
||||
transcript the summary came from is still on disk, and `claude --resume
|
||||
<session>` gives you the session itself rather than a summary of it. The
|
||||
epitaph is what remains after the harness ages that transcript out.
|
||||
|
||||
**Nothing here hands an epitaph back to a session, and that is deliberate.**
|
||||
A session can write its own transcript, so it can author what its own epitaph
|
||||
says. Delivering that to a later session automatically would plant text in
|
||||
its premises as established background, which is the channel the
|
||||
never-mounted store exists to close. Reading one and deciding what to do with
|
||||
it is the operator's, which is why `show` opens an editor rather than
|
||||
injecting anything: the header it opens on records that this preserves what
|
||||
was written rather than vouching for it.
|
||||
|
||||
**Kept until you delete them.** There is no rotation. Epitaphs are an
|
||||
archive, and a count-based cap would delete oldest-first - the entries most
|
||||
likely to hold reasoning nobody remembers. They are small (tens of KB each,
|
||||
against transcripts a hundred times that), so the store is a housekeeping
|
||||
question rather than a disk one: `[epitaph] dir` is a plain directory of
|
||||
plain markdown, and `rm` is the current answer.
|
||||
|
||||
Setting `[epitaph] enabled = off` stops new ones being kept. It does not hide
|
||||
what is already there: `list`, `search` and `show` keep working, because
|
||||
turning the feature off is the point at which wanting to review and clear the
|
||||
store is most likely.
|
||||
|
||||
## Testing frontend changes
|
||||
|
||||
Playwright (Chromium) is pre-installed at image build time, browser
|
||||
|
||||
+7
-2
@@ -25,20 +25,23 @@ run them.
|
||||
| `hooks/git-push-guard.sh` | `PreToolUse` hook: blocks pushes outside the allowed host(s)/branches |
|
||||
| `hooks/deny-dangerous-bash.sh` | `PreToolUse` hook: blocks obviously destructive Bash commands |
|
||||
| `hooks/merge-guard.sh` | `PreToolUse` hook: blocks the configured forge's merge command (`DEJIMA_MERGE_BLOCK`) in the sandbox: merging is a human decision |
|
||||
| `hooks/dejima-notify.sh` | `Notification`/`Stop` hook: drops an empty `waiting`/`done` marker for a remote-enabled session - see [docs/remote-access.md](remote-access.md) |
|
||||
| `hooks/dejima-notify.sh` | Drops an empty `waiting`/`done` marker for a remote-enabled session. Registered as a `Stop` hook only; `waiting` is there for a harness that can say it without having stopped - see [docs/remote-access.md](remote-access.md) |
|
||||
| `bin/dejima-attach` | Lists live sessions and attaches to one; the shared core behind both remote front doors |
|
||||
| `bin/dejima-audit` | Advisory exit-time diff of host-persistence surfaces (git config, `.claude/`, etc.). `dejima-audit show` / `dejima-audit ack` default to the enclosing repo |
|
||||
| `bin/dejima-dep` | Review and approve project dependencies declared in `.dejima/dependencies` |
|
||||
| `bin/dejima-config-lib.sh` | The config file's schema, parser and value validators, plus the dependency-spec grammar. The base layer: it sources nothing, so everything else can source it. Not on PATH |
|
||||
| `bin/dejima-provider-lib.sh` | Parses forge/workflow/harness manifests and composes the session briefing; not on PATH: see [docs/providers.md](providers.md) |
|
||||
| `forges/`, `workflows/`, `harnesses/` | Provider directories for the three axes selected by `[core] forge`/`workflow`/`harness` (data, never sourced or executed); see [docs/providers.md](providers.md) |
|
||||
| `tools/` | Optional tools a launch can add to its image - not an axis, since a launch enables zero or more. Same manifest rules, and a bar for what may be added: see [docs/tools.md](tools.md) |
|
||||
| `docs/release.md` | The pass a `development` -> `main` release goes through, and why each part of it is not a test |
|
||||
| `forges/gitea/bin/` | The gitea forge's own CLIs, baked into the image so the sandbox can act on them: `gitea-pr` (create a PR, read its comments, merge it), `gitea-issue` (list, view, create, comment on, close and reopen issues) and `gitea-actions` (read CI runs and job logs) |
|
||||
| `forges/github/bin/` | The github forge's one CLI: `github-pr comments`, which shows unresolved review threads. `gh` covers everything else, but thread resolution lives only in GitHub's GraphQL API, so `gh pr view --comments` cannot tell a closed thread from an open one |
|
||||
| `bin/dejima-notify-watch` | Host-side watcher: turns markers into ntfy pushes composed entirely from host data |
|
||||
| `bin/dejima-project` | Review and approve project domains and dependencies from the host |
|
||||
| `bin/dejima-project-lib.sh` | Shared library sourced by `bin/dejima-dep`, `bin/dejima-project`, `bin/dejima` and the remote-access scripts; not on PATH |
|
||||
| `bin/dejima-conversation-ship` | Host-side: ships session transcripts to Loki when `[logging] conversation` is on. Reads them where they already are, so the session is not in the path of its own oversight log |
|
||||
| `bin/dejima-epitaph` | Host-side: keeps the summary a session leaves when its context is compacted away, in a store nothing mounts. Run from `bin/dejima`'s exit trap |
|
||||
| `bin/dejima-update-check` | Host-side: says at startup when this checkout is behind the branch it tracks. Reaches the remote by URL from outside the repository, so the checkout's own git config never names a command it runs |
|
||||
| `bin/dejima-epitaph` | Host-side: keeps the summary a session leaves when its context is compacted away, in a store nothing mounts. `save` runs from `bin/dejima`'s exit trap; `list`/`search`/`show` are the operator's, and only ever read |
|
||||
| `bin/dejima-harness-lib.sh` | Loads the selected harness's plugin and provides the `emit_*` functions it declares through; the guarded-store refusal runs in `emit_mount`. Not on PATH |
|
||||
| `bin/harness/<name>.sh` | One per supported harness: what dejima does for that harness that no manifest value could state. Trusted computing base, sourced by `bin/dejima` |
|
||||
| `bin/dejima-color-lib.sh` | The colour and terminal-detection helpers the CLIs share. Not on PATH |
|
||||
@@ -48,6 +51,7 @@ run them.
|
||||
| `docs/providers.md` | The manifest contract for the forge/workflow/harness axes, key by key, with the shipped manifests as worked examples |
|
||||
| `docs/ci.md` | What push access grants a session on your CI host, and how to bound it - runner hardening, and an egress allowlist read from `main` |
|
||||
| `docs/threat-model.md` | What is assumed hostile, and where each layer's compromise stops. Carries the blast-radius table `docs/security.md` also shows; a static test keeps the two identical |
|
||||
| `docs/research-review.md` | When to check dejima's reasoning against the field's, the standing questions that are the agenda, and the queue of bypasses not yet run against this implementation |
|
||||
| `docs/nginx-dejima.conf.example` | Reverse-proxy template for the web front door; deliberately not loadable as written |
|
||||
|
||||
`bin/dejima` is the entry point: it resolves the project path,
|
||||
@@ -495,6 +499,7 @@ harness-specific path resolving to nothing is the honest answer.
|
||||
| State layout | the project key - cwd with every non-alphanumeric replaced by `-` - is Claude Code's scheme, and dejima reproduces it in four places | `bin/dejima-slug-lib.sh`, `bin/dejima-project-lib.sh`, `docker/log-shipper.sh` |
|
||||
| Per-project scoping | `projects/` is mounted one slug at a time and `file-history/` one session at a time, the second resolved by pairing `projects/<slug>/<id>.jsonl` with `file-history/<id>` (#104). In the plugin | `bin/harness/claude-code.sh` |
|
||||
| Transcript discovery | where this workspace's transcripts are, what they are called and how they are nested. `harness_transcript_files` in the plugin, answering one `<key>\t<path>` line per file; core takes the key as the store it files under and refuses one that is not a slug this workspace owns. Both `dejima-epitaph` and `dejima-conversation-ship` used to carry Claude Code's layout directly | `bin/harness/<name>.sh`, `bin/dejima-epitaph`, `bin/dejima-conversation-ship` |
|
||||
| Live sessions | which sessions still have a transcript, as `<key>\t<session-id>` lines. `harness_live_sessions` in the plugin, because the id is in the filename for one harness and is the directory name for the next; `dejima-epitaph list` matches an epitaph's own session id against the answer to say whether resuming the real session is still on offer. Optional: a plugin that does not implement it leaves the column unknown rather than claiming a transcript is gone | `bin/harness/<name>.sh`, `bin/dejima-epitaph` |
|
||||
| Transcript update model | whether a transcript is appended to or replaced wholesale. The manifest's `transcript_update`; the shipper implements both and neither is guessed | `harnesses/<name>/harness.conf` |
|
||||
| Transcript format | the transform from transcript bytes to log lines. In the plugin; the discovery, shipping, batching and Loki labels stay core's | `bin/harness/<name>.sh` |
|
||||
| Compaction format | what a compaction looks like in a transcript, given one file at a time. In the plugin; the store, which keys are legitimate, its modes and the provenance note stay core's | `bin/harness/<name>.sh` |
|
||||
|
||||
+62
-12
@@ -123,6 +123,9 @@ operator can set, resolved the same way as any other config key
|
||||
| `pr_command` | `?command` | (empty) | The PR-management command name the forge's briefing prose and `env_export`/`merge_block` refer to. |
|
||||
| `issue_command` | `?command` | (empty) | The issue-management command name, same idea. |
|
||||
| `merge_block` | `?command` | (empty) | The command prefix refused inside the sandbox - only when the workflow's `block_merge = on`. Enforced by `docker/forge-guard.sh`, which shadows the named CLI on PATH and compares argv, so it holds for a harness that cannot intercept a tool call; `hooks/merge-guard.sh` applies the same rule to a command string, for the harnesses that can. Matched as a run of consecutive non-flag arguments, so a flag before the subcommand does not slip past it. |
|
||||
| `repo_flags` | `?list:flag` | (empty) | The option names this forge's CLI accepts for naming a repository other than the one the session was launched against - `--repo -R` for `gh`. `docker/forge-guard.sh` refuses a value that is not that repository, in every spelling (`--repo x`, `--repo=x`, and a one-dash flag with its value attached). Fast-fail, not a boundary, for the same reason `merge_block` is not one: the session holds the token. Leave it empty for a CLI that resolves the repo itself and refuses another host, as the gitea ones do - a forge is not required to be aimable. |
|
||||
| `identity_keys` | `?list:identifier` | (empty) | Which of this forge's own `keys` belong to a **person** rather than to the project - the credential paths. One declaration, two rules: a key named here is one an `[identity.<name>]` section may set, and one a project may not declare in its own `.dejima/`. Core keeps no list of its own, so a forge whose credential is spelled differently needs no change here. The identity inherits the type from this forge's `keys` entry, not a second copy of it. |
|
||||
| `repo_env` | `?identifier` | (empty) | The environment variable this forge's CLI reads for the same thing - `GH_REPO`. Declared separately because it takes no argument and would otherwise be the way around every flag above. |
|
||||
| `disclose` | `?disclosures` | (empty) | Which of this forge's commands send a body the session authored, as comma-separated `kind:command prefix` entries - `pr:gh pr create, issue:gh issue create, ...`. `docker/forge-guard.sh` prepends a marker to the body of a matching command, so a PR, issue or comment an agent wrote says so. The three kinds are `pr`, `issue` and `comment`; the wording of each marker is core's, not the manifest's, so that dejima says one thing about agent authorship whichever forge is selected. Unlike `merge_block` this does not depend on the workflow: what a workflow permits is a policy, who wrote the text is a fact. |
|
||||
| `keys` | `?list:keyspec` | (empty) | This forge's own `[forge.<name>]` config schema - see above. |
|
||||
| `requires` | `?list:identifier` | (empty) | Which of this forge's own config keys an operator is expected to set for it to actually work - checked at launch by two refusal rules (partly-configured, and none-configured-with-a-fixed-host) when the workflow pushes; see [Validation](#validation). A key with a non-empty schema default never counts as missing for either check. |
|
||||
@@ -257,6 +260,26 @@ resuming the session on the host is `claude --resume <session id>`, with
|
||||
`{{session_id}}` filled in at composition time; and its briefing fragment is
|
||||
`briefing.md`.
|
||||
|
||||
## Tool
|
||||
|
||||
Not an axis: a launch selects one forge, one workflow and one harness, and
|
||||
enables zero or more tools. Everything else about it is the same - a manifest
|
||||
that is data, validated by the same schema machinery, never sourced.
|
||||
|
||||
The keys are deliberately few. A tool declares what it is, what installs it,
|
||||
what its environment needs and what the session should be told about it. There
|
||||
is no key for a hook, a mount, a domain or a guard, because a tool that needed
|
||||
one of those would be a change to the boundary rather than a program on PATH.
|
||||
|
||||
| Key | Type | Default | Meaning |
|
||||
| --- | --- | --- | --- |
|
||||
| `description` | `text` | *(required)* | One line, shown when the layer builds and in the session briefing. |
|
||||
| `install` | `depspec` | *(required)* | The same grammar a dependency uses. In practice a `tarball:` spec, because a tool has to be pinned by digest - see [docs/tools.md](tools.md) for why that is a rule rather than a preference. |
|
||||
| `install_layout` | `enum:prefix\|binary` | `prefix` | The archive's shape. `prefix` is one enclosing directory, stripped so `bin/` lands in the same place whatever the release called its top level. `binary` is an archive that IS the executable: stripping a component there would strip the binary and extract nothing, silently. |
|
||||
| `image_env` | `?list:envpair` | (empty) | `NAME=VALUE` pairs the layer sets. **Every name must be namespaced to the tool** - `RTK_*` for `rtk` - and a launch refuses one that is not. This becomes a Dockerfile `ENV`, which every process in the container inherits, so a bare `NO_COLOR` or `DO_NOT_TRACK` changes the harness and everything else too. A harness manifest may use bare names there because a harness is the container's main process; a tool is one program among many. |
|
||||
| `command` | `identifier` | *(required)* | What it puts on PATH. |
|
||||
| `instructions` | `?relpath` | (empty) | A markdown fragment appended to the session briefing under a core-owned heading, so a tool describes itself once and every harness gets the same words. This is the whole of the per-harness wiring: dejima renders it rather than letting the tool's installer patch a harness config. |
|
||||
|
||||
## Session briefing composition
|
||||
|
||||
The text a `SessionStart` hook injects into the agent is assembled
|
||||
@@ -346,6 +369,12 @@ itself:
|
||||
- `DEJIMA_BLOCKED_BRANCHES` - the workflow's `blocked_branches`.
|
||||
- `DEJIMA_MERGE_BLOCK` - the forge's `merge_block`, but only when the
|
||||
workflow's `block_merge = on`; otherwise empty.
|
||||
- `DEJIMA_FORGE_REPO_FLAGS` and `DEJIMA_FORGE_REPO_ENV` - the forge's
|
||||
`repo_flags` and `repo_env`, with `DEJIMA_FORGE_REPO` holding the
|
||||
`<owner>/<name>` of the workspace's `origin` remote. Empty when the forge
|
||||
declares neither, and also when the workspace has no origin to read - in
|
||||
which case a command naming any repository is refused, since there is
|
||||
nothing it could legitimately be naming.
|
||||
- Whatever the forge's own `env_export` names (e.g. `GITEA_API`,
|
||||
`GITEA_SSH_HOST`, `GITEA_TOKEN`).
|
||||
|
||||
@@ -466,18 +495,26 @@ that immediately turned up a second thing, that `gh --repo owner/name pr merge
|
||||
N` walked straight past the merge block. Neither was a hard bug to find once
|
||||
anyone looked.
|
||||
|
||||
Two known differences remain, both filed rather than fixed:
|
||||
Two differences from the gitea path remain, both now closed in code and worth
|
||||
knowing about because they are what a second forge costs:
|
||||
|
||||
- **Review feedback is thinner.** `gitea-pr comments` shows unresolved review
|
||||
threads and hides the rest; GitHub does not expose thread resolution through
|
||||
the REST API `gh` uses for this, so working through PR feedback there
|
||||
re-reads threads already dealt with, with no signal that it is doing so.
|
||||
- **`gh --repo` reaches past the sandboxed repository.** The gitea CLIs refuse
|
||||
an origin that is not on the configured host, so they can only act on the
|
||||
repo the sandbox was launched against. `gh` takes `--repo` on nearly every
|
||||
subcommand, and `forge = github` supplies a deliberately write-capable
|
||||
token. A per-repository fine-grained PAT is the shape of `push_token_file`
|
||||
that makes this moot.
|
||||
- **Review feedback needs its own tool.** `gh pr view --comments` prints
|
||||
reviews and comments with no resolution state anywhere in the output,
|
||||
because the REST API it uses does not carry any - `isResolved` exists only
|
||||
on `reviewThreads` in GraphQL. So this forge ships `github-pr comments`,
|
||||
which does that one query and otherwise matches `gitea-pr comments`:
|
||||
unresolved threads by default, `--all` to include the resolved ones marked
|
||||
as such, and a count of what was hidden. Everything else `gitea-pr` does has
|
||||
a `gh` subcommand already.
|
||||
- **`gh` can be aimed past the sandboxed repository, and is stopped.** The
|
||||
gitea CLIs refuse an origin that is not on the configured host, so they can
|
||||
only act on the repo the sandbox was launched against. `gh` takes `--repo`
|
||||
on nearly every subcommand and reads `GH_REPO`, so this forge declares both
|
||||
(`repo_flags`, `repo_env`) and `docker/forge-guard.sh` refuses a value that
|
||||
is not the launched-against repository. Fast-fail, not a boundary, exactly
|
||||
as `merge_block` is: the session holds the token and could call the API
|
||||
directly. What actually bounds it is the token's scope, so a per-repository
|
||||
fine-grained PAT is the expected shape of `push_token_file`.
|
||||
|
||||
So: if you have a choice, `gitea` is the better-worn path. Choose `github`
|
||||
because that is where your repositories are, which is a good reason - and
|
||||
@@ -509,6 +546,16 @@ Two things it does not cover. A command that sends no body has none added -
|
||||
would be worse than leaving it. And running a forge CLI on the host, outside
|
||||
a sandbox, marks nothing: there the person running it wrote the body.
|
||||
|
||||
**Once, whatever the body already says.** A body that already opens with the
|
||||
marker gets no second one - the marker is a statement rather than a count, and
|
||||
a body saying an agent wrote it has disclosed what this exists to disclose.
|
||||
That matters because agents write it themselves: every issue on a project
|
||||
worked on this way opens with that line, so one reading the existing issues
|
||||
concludes it is the house style. The same words further down the body are
|
||||
prose about disclosure rather than the disclosure, and still get one
|
||||
prepended. The session is also told the marker is added for it, which is the
|
||||
half that stops it being written at all.
|
||||
|
||||
**Selecting `forge = github` is a real posture change, not just a config
|
||||
choice.** It opens `ssh.github.com:22` for push - the read-only GitHub access
|
||||
every session gets regardless (clone, fetch, `gh` API calls over port 443)
|
||||
@@ -516,7 +563,10 @@ never needs port 22 at all. It opens it through core's existing GitHub push
|
||||
grant (`ALLOW_GITHUB_PUSH`, the same one `--allow-github-push` uses), which
|
||||
its `hosts_allowlisted_by_core = on` is what asks for: port 22 to GitHub's
|
||||
published ranges and nothing else, logged like every other allowed
|
||||
connection and verified by the firewall's own startup self-check. Only when
|
||||
connection and verified by the firewall's own startup self-check. The
|
||||
port restriction is an IPv4 statement; what makes port 22 shut *at all*
|
||||
without this grant is that the container blocks IPv6 as well, so an
|
||||
allowlist naming one address family is not the whole of it. Only when
|
||||
the selected workflow actually pushes - `forge = github` with
|
||||
`workflow = local-only` leaves port 22 shut. And `[forge.github] push_token_file` is
|
||||
deliberately a *separate*, write-capable token from `[github] token_file`
|
||||
|
||||
+34
-5
@@ -8,6 +8,25 @@ consists of.
|
||||
`test/release-pass.sh` runs the parts that can be run and prints the parts that
|
||||
cannot, chosen from what the release actually changes. Start there.
|
||||
|
||||
## What is actually required, at this size
|
||||
|
||||
This project has one maintainer and few users, and a release gate nobody has
|
||||
the bandwidth to complete is a gate that gets skipped rather than met. So the
|
||||
bar is deliberately two things:
|
||||
|
||||
1. **An agentic security review of the whole diff**, against the invariants in
|
||||
section 2. This is the gate. It is cheap, it is repeatable, and it is the
|
||||
one thing that catches the class of mistake this project cannot afford.
|
||||
2. **The maintainer runs the build.** Normal usage for a while, and a launch on
|
||||
the other configured harness to confirm it starts. That is the smoke test,
|
||||
and it is stated as what it is rather than dressed up as coverage.
|
||||
|
||||
Everything in section 4 is what a mature version of this project would verify
|
||||
and this one does not. It is printed by `release-pass.sh` and kept in this
|
||||
document because knowing what is unverified is worth more than pretending
|
||||
otherwise - not because a release is blocked on it. When there are more users
|
||||
than one person can apologise to, that changes.
|
||||
|
||||
## Why a pass at all
|
||||
|
||||
Every check below exists because something got through without it. The pattern
|
||||
@@ -66,23 +85,33 @@ what this repository is defending.
|
||||
case, say so where a reader will meet it - the forge and harness maturity
|
||||
sections in [providers.md](providers.md) are what this looks like.
|
||||
|
||||
## 4. Manual testing
|
||||
## 4. Manual testing, which is mostly not done
|
||||
|
||||
`test/release-pass.sh` prints the list for the paths this release touches. The
|
||||
standing entries, and why each is not a test:
|
||||
`test/release-pass.sh` prints the list for the paths this release touches. It
|
||||
is an inventory of what nothing has checked, not a checklist that must be
|
||||
completed - see "What is actually required" above. The standing entries, and
|
||||
why each is not a test:
|
||||
|
||||
| Touched | What to do, and why no test does it |
|
||||
| --- | --- |
|
||||
| `bin/dejima`, the entrypoint, compose | Launch a real session: mounts, proxy and exit audit only meet each other here |
|
||||
| `forges/`, the forge guard | Open a pull request through each forge and read the body that arrived |
|
||||
| any guard | Try the refused thing by the route an agent would take, not by the route the test takes |
|
||||
| `bin/dejima-tty-suspend` | Ctrl-Z a real session and `fg` it: the tests use a stand-in for the container run |
|
||||
| `bin/dejima-tty-suspend`, the launch | Ctrl-Z a real session and `fg` it: the tests use a stand-in for the container run |
|
||||
| `web/` | Load it on a phone; nothing here can see a soft keyboard |
|
||||
| `harnesses/` | Launch the harness against a real model |
|
||||
|
||||
## 5. The release pull request
|
||||
|
||||
Say what was run and what was not, in the body. A queued privileged job, a
|
||||
Say what was run and what was not, in the body. At this size that will mostly
|
||||
be "not", and writing it down is the whole point: an unverified path that is
|
||||
named is one somebody can reach for when a bug turns up, and an unverified
|
||||
path that is implied to be tested costs a day of looking in the wrong place.
|
||||
|
||||
Worth its own line: **whether the release can be rolled back.** A config key
|
||||
added in a release makes the previous `main` refuse to start once an operator
|
||||
adopts it, because an unknown key fails validation - so the rollback that
|
||||
looks like the safety net is not one. Name the keys. A queued privileged job, a
|
||||
manual check that was skipped, a forge that has still never been launched -
|
||||
those are the things a reader of `main` is entitled to know, and the release
|
||||
PR is where they are still true and still remembered.
|
||||
|
||||
+78
-20
@@ -63,9 +63,22 @@ approvals):
|
||||
| `base_url` | unset | public base URL of the web front door, used to build the notification's deep link. Absent, pushes still go out - just with no link on them |
|
||||
| `ttyd_port` | `7681` | loopback port `ttyd` listens on. The reverse proxy has to `proxy_pass` to the same one |
|
||||
| `ttyd_font_size` | unset | terminal font size in px, 8-72. Applies to *every* client, phone and desktop alike - see "Reading it on a phone". Unset passes no option at all and leaves `ttyd` on its own default |
|
||||
| `ttyd_button_colors` | unset | whether the toolbar is colour-coded by what each button does, in the same gruvbox palette the session picker uses. Unset means yes; `off` restores the grey every key had before. See "Reading it on a phone" |
|
||||
| `ttyd_focus_on_tap` | unset | whether tapping the terminal raises the soft keyboard. Unset means no on a touch device and yes on a desktop, which is almost always what you want; `on` or `off` forces it. Overridable per client with `?focus=1` / `?focus=0` |
|
||||
| `ttyd_tmux_prefix` | unset | the tmux prefix the terminal page's `PREFIX`, `◀W`, `W▶` and `ZOOM` buttons send, written as a control chord: `C-a`, `C-b`, `C-Space`, `C-@`, `C-_`, `C-?`. Unset leaves the page on stock tmux's `C-b`. See "Reading it on a phone" |
|
||||
|
||||
**If this host sits behind a firewall it does not control**, the push has to
|
||||
be permitted outbound before any of this works. `dejima-notify-watch` runs on
|
||||
the host, not in the container, so the container's own allowlist has nothing
|
||||
to do with whether it can reach your ntfy server - and a self-hosted one on a
|
||||
private address is exactly the case a host-level egress filter drops.
|
||||
|
||||
That failure is the quiet kind. Nothing errors, the config is correct,
|
||||
`systemctl --user status dejima-notify-watch` looks healthy, and the phone
|
||||
simply never buzzes. If you administer that filter, the rule is yours to add;
|
||||
if someone else does, this is the thing to ask them about before re-reading
|
||||
your config a third time.
|
||||
|
||||
`ntfy_url` and `base_url` must carry an explicit `http://` or `https://`
|
||||
scheme; a value without one is refused rather than guessed at, because
|
||||
`curl` reads a leading `-K/path` as an *option* that takes the request's URL
|
||||
@@ -128,14 +141,14 @@ afterwards, runs on the host as your own user.
|
||||
|
||||
```
|
||||
┌─ the sandbox container ────────────────────────────────────────────┐
|
||||
│ claude code, at a Notification or Stop hook │
|
||||
│ claude code, at a Stop hook │
|
||||
│ │ │
|
||||
│ │ hooks/dejima-notify.sh writes an empty file named │
|
||||
│ ▼ `waiting` or `done` - no content, no stdin, no network │
|
||||
│ ▼ `done` - no content, no stdin, no network │
|
||||
└───────┼────────────────────────────────────────────────────────────┘
|
||||
════════╪═══ container boundary - one bind-mounted directory ═════════
|
||||
┌───────▼─── your machine, as your user ─────────────────────────────┐
|
||||
│ ${XDG_RUNTIME_DIR}/dejima/notify/<run-id>/waiting │
|
||||
│ ${XDG_RUNTIME_DIR}/dejima/notify/<run-id>/done │
|
||||
│ │ │
|
||||
│ │ inotify, or a ~6s poll where inotify-tools is absent │
|
||||
│ ▼ │
|
||||
@@ -148,13 +161,13 @@ afterwards, runs on the host as your own user.
|
||||
│ curl
|
||||
▼
|
||||
your ntfy topic ──── push ────► your phone
|
||||
"dejima: <project> needs input"
|
||||
"dejima: <project> finished"
|
||||
link: <base_url>/?arg=<run-id>
|
||||
```
|
||||
|
||||
The marker directory is the sandbox's entire surface here, and it is
|
||||
one-way: a name, out. Nothing the session writes reaches the push, which is
|
||||
why the notification says a project needs input and never what it is asking.
|
||||
why the notification says a project has stopped and never what it is asking.
|
||||
[Notifications](#notifications) has the detail, including where that
|
||||
guarantee actually lives.
|
||||
|
||||
@@ -524,6 +537,23 @@ PREFIX ◀W W▶ SESS ZOOM DRAG PASTE KBD
|
||||
- `KBD` raises the soft keyboard, which is otherwise awkward to get back once
|
||||
it has been dismissed.
|
||||
|
||||
**The buttons are colour-coded by what they are for**, in the same gruvbox
|
||||
palette `dejima-attach` uses for the session picker - the two sit either side
|
||||
of one attach and should not look like different programs.
|
||||
|
||||
The colours are a hierarchy, not decoration. `KBD` is filled orange because on
|
||||
a phone it is how you type at all, and it is the one key that has to be
|
||||
findable without looking for it. `⏎` is filled green, being the key a session
|
||||
asks for most. The window and arrow keys are outlined in blue: reached for
|
||||
constantly, but never the thing you are hunting for. Everything else is
|
||||
furniture and stays grey. A latched `CTRL` or `DRAG` still overrides whichever
|
||||
tier its button is in, because the state a key is in matters more than the job
|
||||
it does.
|
||||
|
||||
Set `ttyd_button_colors = off` for the grey every key had before - for a
|
||||
terminal colour scheme this clashes with, or if you would rather it were
|
||||
quiet.
|
||||
|
||||
**Tapping the terminal does not raise the keyboard.** On a phone, tapping is
|
||||
also how you scroll and select, so every one of those taps used to summon the
|
||||
keyboard and cost a second tap to put it away. `KBD` is the deliberate way to
|
||||
@@ -728,14 +758,24 @@ what the outer proxy sends.
|
||||
|
||||
## Notifications
|
||||
|
||||
`dejima` registers `hooks/dejima-notify.sh` as a `Notification` and `Stop`
|
||||
hook for a remote-enabled session, into the throwaway settings override layer
|
||||
it already generates - never into your real `~/.claude/settings.json`. Your
|
||||
own hooks keep running alongside it, since Claude Code merges hooks across
|
||||
layers rather than replacing. The layer is mounted read-only, so a session
|
||||
cannot unregister its own hook. The hook writes one empty file named
|
||||
`waiting` or `done` into this run's marker directory: no content, no stdin,
|
||||
no network.
|
||||
`dejima` registers `hooks/dejima-notify.sh` as a `Stop` hook for a
|
||||
remote-enabled session, into the throwaway settings override layer it already
|
||||
generates - never into your real `~/.claude/settings.json`. Your own hooks
|
||||
keep running alongside it, since Claude Code merges hooks across layers rather
|
||||
than replacing. The layer is mounted read-only, so a session cannot
|
||||
unregister its own hook. The hook writes one empty file named `done` into
|
||||
this run's marker directory: no content, no stdin, no network.
|
||||
|
||||
**One push per stop, and not a second one a minute later.** The hook and the
|
||||
watcher both understand a `waiting` event as well, and Claude Code's
|
||||
`Notification` hook is where it would come from - but that hook fires when
|
||||
Claude needs permission to run something and when the prompt has sat idle,
|
||||
and a dejima session runs with permission prompts off. Only the timer is
|
||||
left, and it expires shortly after the Stop it follows, so registering both
|
||||
sent two pushes for one event with the second saying nothing the first had
|
||||
not. What is given up is being told about a session that has gone idle
|
||||
without having stopped first, which Claude Code cannot currently distinguish;
|
||||
a harness that can may register `waiting` and get its own notification.
|
||||
|
||||
On the host, `dejima-notify-watch` turns those markers into ntfy pushes.
|
||||
Same installation shape as above:
|
||||
@@ -781,8 +821,9 @@ than a new exposure, but a RAM-backed filesystem fails harder and sooner.
|
||||
There is deliberately no quota here; `rm -rf` on that run's marker directory (or
|
||||
logging out, which discards the tmpfs) is the recovery.
|
||||
|
||||
**What a notification contains.** A title of `dejima: <project> needs input`
|
||||
(or `dejima: <project> finished`), a fixed one-line body, and - when
|
||||
**What a notification contains.** A title of `dejima: <project> finished`
|
||||
(or `dejima: <project> needs input`, for a harness that registers `waiting`),
|
||||
a fixed one-line body, and - when
|
||||
`base_url` is set - a click link of `<base_url>/?arg=<run-id>` that opens the
|
||||
web front door already attached to that session. `<project>` is the
|
||||
workspace directory's name, taken from the host-side registry and reduced to
|
||||
@@ -808,7 +849,20 @@ last point is what the enum is really for: ntfy's own headers include
|
||||
issue an arbitrary HTTP request, so a single attacker-controlled header
|
||||
would turn it into a confused deputy inside your network.
|
||||
|
||||
**When no notification arrives.** Five things have to happen in order, and a
|
||||
**Where that guarantee stops is the container boundary.** `ntfy_url` is a
|
||||
credential for a channel your phone trusts, sitting in a file on this host.
|
||||
Anyone with your account on this machine can read it, publish whatever they
|
||||
like to that topic, drown it until you mute it, or subscribe to it if it is
|
||||
not write-only. None of that goes through the sandbox, so none of the
|
||||
reasoning above applies to it.
|
||||
|
||||
Scope the topic accordingly: a token that can only write the topic dejima
|
||||
uses, and a **separate** topic for anything you want to trust more than you
|
||||
trust this host. Anything monitoring this machine's own health belongs in that
|
||||
second topic, with its credential not on this machine at all - a box that can
|
||||
forge alerts about itself is not reporting on itself.
|
||||
|
||||
**When no notification arrives.** Six things have to happen in order, and a
|
||||
break in any of them looks identical from the phone - which is to say, like
|
||||
nothing at all. Walk them from the inside out; each step tells you whether
|
||||
the next one is worth checking.
|
||||
@@ -817,9 +871,9 @@ the next one is worth checking.
|
||||
and `echo $DEJIMA_NOTIFY_DIR`. Both empty means `dejima` started this
|
||||
container with remote access off - `[remote-access] enabled` was off at
|
||||
launch, and no later change affects a session already running.
|
||||
2. **Is the hook registered?** The `Notification` and `Stop` entries live in
|
||||
the throwaway override layer, not in your real `settings.json`:
|
||||
`grep -c dejima-notify /etc/dejima-settings.json` from inside should be 2.
|
||||
2. **Is the hook registered?** The `Stop` entry lives in the throwaway
|
||||
override layer, not in your real `settings.json`:
|
||||
`grep -c dejima-notify /etc/dejima-settings.json` from inside should be 1.
|
||||
That file is passed to the harness by `harness-wrapper.sh`, as whatever
|
||||
its manifest's `settings_args` names (`--settings` for Claude Code);
|
||||
if it is missing entirely, this container was not started by `dejima`.
|
||||
@@ -841,7 +895,11 @@ the next one is worth checking.
|
||||
or 403 means the instance wants credentials, which the URL can carry as
|
||||
`https://<user>:<token>@<host>/<topic>` - nothing here sends an auth
|
||||
header of its own.
|
||||
5. **Is the phone subscribed to the topic the config names?** Last in the
|
||||
5. **Can this host reach the ntfy server at all?** `curl -sv "$ntfy_url"`
|
||||
from the host, not from a session. A host-level egress filter this machine
|
||||
does not control drops the push with nothing in any log here, and every
|
||||
step above still passes - see the note under `ntfy_url` above.
|
||||
6. **Is the phone subscribed to the topic the config names?** Last in the
|
||||
list and first to check in practice, since it is the only link with no
|
||||
log anywhere. The topic in `ntfy_url` and the one in the app have to be
|
||||
the same string.
|
||||
|
||||
@@ -0,0 +1,173 @@
|
||||
# Reviewing the state of the art
|
||||
|
||||
[← dejima README](../README.md)
|
||||
|
||||
dejima's first month, from late July 2026, was spent reasoning from its own
|
||||
threat model without checking it against anyone else's. The first sweep, in
|
||||
August, turned up two things worth having found sooner than that:
|
||||
|
||||
- **A parser-differential bypass class against egress allowlists**, disclosed
|
||||
against another vendor's agent network sandbox: a null byte in a SOCKS5
|
||||
hostname, so the policy check read `attacker-host\x00.google.com` and matched
|
||||
a `.google.com` suffix while the resolver read `attacker-host`. dejima's
|
||||
matcher refused that shape and every neighbouring one, for structural reasons
|
||||
now recorded beside it - it matches whole domains rather than suffixes, and
|
||||
the decision and the dial are bound by the ipset being filled from the
|
||||
answer the resolver returned. One laxity turned up and was fixed.
|
||||
- **The closest comparable project ships the opposite default.** Trail of Bits'
|
||||
Claude Code devcontainer lists network under "not sandboxed" and has full
|
||||
outbound access unless an operator opts in. Working out why was worth more
|
||||
than the comparison: their scope is the host filesystem for an auditor
|
||||
watching a session, and network was never the thing they were containing.
|
||||
|
||||
Neither changed a control, which is the point. A month is not long to have gone
|
||||
unchecked, and finding out was cheap - which is the argument for doing it on a
|
||||
schedule rather than when something goes wrong.
|
||||
|
||||
This is the process. It is deliberately small: the failure mode of a research
|
||||
review is producing a reading list nobody acts on.
|
||||
|
||||
## When to run one
|
||||
|
||||
**Before locking a control.** This repository's rule is to measure the premise
|
||||
before designing on it. Extended one step: ask what measurement would falsify
|
||||
the control, *and* whether someone has already run it - or already bypassed it.
|
||||
|
||||
- Before adding or changing a boundary: a mount, an egress path, a guard, a
|
||||
credential that crosses.
|
||||
- When a control is being justified by reasoning rather than by a test. That is
|
||||
the moment to find out whether the reasoning is known to be wrong.
|
||||
- When a bypass is published for anything in the same class. Another project's
|
||||
egress allowlist bypass is a test case for this one.
|
||||
- Quarterly as a standing sweep, whether or not anything is pending. A threat
|
||||
model written eighteen months ago describes a different attacker.
|
||||
|
||||
That last one is the reason the schedule exists at all. Reported model
|
||||
capability on offensive security tasks has moved fast enough that a sandbox
|
||||
designed against a 2024 agent is not obviously adequate against a 2026 one, and
|
||||
nothing else here re-examines that assumption on any schedule.
|
||||
|
||||
## The standing questions
|
||||
|
||||
The agenda. Each entry is a live claim dejima rests on, phrased so the field can
|
||||
contradict it. Keep it current: a question nobody would answer "no" to is not
|
||||
doing any work.
|
||||
|
||||
1. **Is a hardened container an adequate boundary for an agent assumed
|
||||
hostile?** The field says no for untrusted code, and tiers gVisor and
|
||||
per-workload VM kernels above it. dejima's answer is that escape moves a
|
||||
layer - true where the layer exists. See
|
||||
[Which deployment this describes](threat-model.md#which-deployment-this-describes).
|
||||
2. **Does a name-based egress allowlist hold?** It holds against an agent that
|
||||
must resolve a name. It does not hold against exfiltration through an
|
||||
allowed domain or against DNS query-name channels, both of which are listed
|
||||
in [What dejima does not sandbox](security.md#what-dejima-does-not-sandbox).
|
||||
The open part is parser differentials between the matcher and the resolver.
|
||||
3. **Where must egress enforcement sit?** Below the harness: a subprocess with
|
||||
its own HTTP client bypasses anything the harness mediates. dejima enforces
|
||||
at the container's network layer, which satisfies this. Settled unless the
|
||||
architecture changes.
|
||||
4. **Is "the operator merges" the right shape for human-in-the-loop?** The
|
||||
field's phrasing is "human approval on irreversible actions", which is what
|
||||
the merge and push guards implement. Corroborated; stop re-deriving it.
|
||||
5. **What is the current bypass literature for agent sandboxes?** The most
|
||||
valuable question and the one that ages fastest.
|
||||
6. **Does anyone else treat the previous session's output as hostile input to
|
||||
the next one?** The positioning question, and as of the first sweep the
|
||||
answer is no.
|
||||
7. **What does the field consider baseline that dejima does not do?** The
|
||||
cheapest question to ask. It found the absence of timeouts, which is now a
|
||||
[stated non-goal](security.md#why-there-are-no-timeouts) rather than a gap.
|
||||
8. **Is a control argued in one layer honoured in the others?** The three
|
||||
projects are three repositories with three vocabularies, and nothing checks
|
||||
that a claim made in one reaches the next. The first sweep produced the
|
||||
worked example: dejima blocks IPv6 outright and says why, `dejima-ci-hardener`
|
||||
makes the same argument for its job network - and both sibling projects'
|
||||
node-side firewalls were IPv4-only, written later, by people who had already
|
||||
made that argument twice. Each project's tests pass, because each tests its
|
||||
own layer against its own template. This question is the only thing looking
|
||||
at the seams.
|
||||
|
||||
## How to run one
|
||||
|
||||
**1. Sweep, do not read.** Search broadly and read only summaries. This pass
|
||||
produces a shortlist, not understanding. Search the standing questions, not
|
||||
dejima's vocabulary - our terms are ours, and "guarded store" finds nothing.
|
||||
|
||||
**2. Read in full only what could change a control.** A source that agrees
|
||||
changes nothing and can stay a citation. Read the ones describing a bypass of a
|
||||
control that exists here, quantifying something asserted here, or occupying
|
||||
ground assumed empty.
|
||||
|
||||
**3. Get the mechanism, not the headline.** "Egress allowlists are bypassable"
|
||||
is not actionable. "The policy check saw one hostname and the resolver saw
|
||||
another" is a test to write.
|
||||
|
||||
**4. Sort every finding into a bucket.**
|
||||
|
||||
| bucket | what it means | what to do |
|
||||
| --- | --- | --- |
|
||||
| **Prior art** | Someone built this | Read it properly, and start from where they ended. |
|
||||
| **Corroboration** | They hold the same premise | Cite it, stop re-deriving it, and stop treating it as a differentiator. |
|
||||
| **Their control** | They defend something dejima does not | Take the *distinction* if it is real. Do not take the *control* without asking what threat model produced it. |
|
||||
| **Contradiction** | Their default is the opposite | The most valuable bucket. Work out whether the threat models differ before conceding or dismissing. |
|
||||
| **Open ground** | Nobody does this | Say so, and say *why*. Usually a constraint others do not have; occasionally it means everyone else knows something. |
|
||||
|
||||
**5. Write down the contradiction even when it resolves in dejima's favour.**
|
||||
The default-network difference above is the worked example: it reads as dejima
|
||||
being ahead, and the reason turned out to be scope rather than rigour.
|
||||
Recording the reason is what stops a different scope being mistaken for a
|
||||
weaker one - by us, in six months, reading our own note.
|
||||
|
||||
**6. Turn every finding that changes a control into an issue.** A review that
|
||||
ends in a document has not finished.
|
||||
|
||||
## What to record, and where it does not go
|
||||
|
||||
**A sweep is not committed here.** It is written to the shared mount on the
|
||||
operator's machine, alongside the specs, plans and design notes that live
|
||||
there for the same reason: a review is ephemeral, and what belongs in this
|
||||
repository is the *action* it produced, not the reasoning that produced it.
|
||||
|
||||
What lands here is the outcome - an issue, a pull request, a paragraph in the
|
||||
documentation section the finding actually bears on. This page is itself an
|
||||
example: the August 2026 sweep produced a matcher fix, a
|
||||
[not-sandboxed list](security.md#what-dejima-does-not-sandbox), a
|
||||
[statement of which deployment the threat model describes](threat-model.md#which-deployment-this-describes),
|
||||
and a stated non-goal on timeouts. The sweep that produced them stayed on the
|
||||
operator's machine.
|
||||
|
||||
The sweep itself is one page, dated and sourced, in the house style, written
|
||||
where the other ephemeral documents go. Two rules specific to reviews, because
|
||||
both distinctions vanish within a week of writing:
|
||||
|
||||
- **Mark what was read in full and what came from a search summary.** A summary
|
||||
of a bypass is enough to write a test case from and not enough to claim
|
||||
dejima is safe from it.
|
||||
- **Quote claims with their conditions.** "Containers are inadequate" is false
|
||||
without "for untrusted code, where the host kernel is the boundary". The
|
||||
honesty rules here apply to what is read as much as to what is written.
|
||||
|
||||
## The standing test queue
|
||||
|
||||
A bypass from the literature is a hypothesis about *their* implementation until
|
||||
it is run against this one. dejima differs in ways that plausibly change the
|
||||
answer: enforcement is `iptables` and a DNS proxy rather than an in-process
|
||||
proxy, the matcher is an anchored shell regex rather than a string-suffix test,
|
||||
the allowlist matches whole domains rather than suffixes, and the ipset is
|
||||
populated from the answer the resolver returned rather than from a second parse
|
||||
of a string.
|
||||
|
||||
Each entry states a prediction that can fail.
|
||||
|
||||
- **Hostile hostnames against `valid_domain`.** Null bytes, percent-encoding,
|
||||
trailing dots, embedded newlines, IDNA, empty labels. Prediction: all refused.
|
||||
*Run 2026-08-25: all refused except an empty label, which was accepted and
|
||||
has since been fixed.*
|
||||
- **A published SOCKS-style parser differential, run end to end** rather than
|
||||
against the validator alone. Prediction: no path, because nothing in dejima
|
||||
speaks SOCKS and the decision and the dial are bound by the ipset. Not yet
|
||||
run.
|
||||
- **Redirect chains to a host outside the allowlist.** Prediction: fail at the
|
||||
ipset, because dejima does not mediate HTTP and the connection is judged by
|
||||
address. Not yet run.
|
||||
+112
-5
@@ -4,8 +4,8 @@
|
||||
|
||||
**Threat model, honestly stated:** this reduces the blast radius of a
|
||||
misbehaving or prompt-injected coding agent - it does not make it safe to
|
||||
point at arbitrary untrusted or adversarial input, and it does not turn
|
||||
`--dangerously-skip-permissions` into something without real risk. Point it
|
||||
point at arbitrary untrusted or adversarial input, and it does not make
|
||||
running an agent with its permission prompts off safe. Point it
|
||||
at repositories you already trust. Everything below is about how bad a
|
||||
compromised session *inside* that trust boundary can get, not a claim that
|
||||
one can't happen.
|
||||
@@ -16,6 +16,61 @@ person thought to check, and no outside audit or adversarial testing has
|
||||
happened. Read what follows as claims awaiting scrutiny rather than claims
|
||||
that have survived it. See [SECURITY.md](../SECURITY.md).
|
||||
|
||||
## What dejima does not sandbox
|
||||
|
||||
Every item here is documented somewhere below, and a document organised by
|
||||
control makes a reader assemble the negative space themselves. Most will not.
|
||||
So it is collected here, at the top, where it is the first thing read rather
|
||||
than the thing inferred from silence.
|
||||
|
||||
- **Exfiltration through a domain that is allowed.** The egress allowlist
|
||||
decides *where* a session may connect, not what it may put in the request. A
|
||||
session that can reach a host can encode data into a path or a query it
|
||||
sends there. Allowing a domain at all creates that channel.
|
||||
- **Data encoded into DNS query names.** The DNS proxy answers for allowlisted
|
||||
domains; the names asked for are a channel of their own.
|
||||
- **Anything below the container, where nothing is arranged there.** dejima's
|
||||
blast-radius table has rows beneath the container, and their controls belong
|
||||
to [dejima-devbox-hardener](https://gitbox.branderson.io/dejima/dejima-devbox-hardener).
|
||||
Run on a laptop with no VM layer, the row below the container is the
|
||||
operator's own machine, and dejima has nothing to say about it. See
|
||||
[Which deployment this describes](threat-model.md#which-deployment-this-describes).
|
||||
- **Anything finer than a session.** The unit of isolation is one container for
|
||||
one session. An MCP server, a hook, or a tool the session runs inherits the
|
||||
session's whole reach - dejima reports that a session *added* an MCP server
|
||||
(see the audit surfaces below) and does not constrain what that server then
|
||||
does. Per-tool granularity would need a second sandbox inside this one.
|
||||
- **Resource exhaustion.** No time limit, no memory limit, no CPU limit. A
|
||||
session that loops until someone notices is not prevented, and this is a
|
||||
deliberate omission rather than an oversight - see
|
||||
[Why there are no timeouts](#why-there-are-no-timeouts).
|
||||
- **The first layer's controls against an agent that has stopped
|
||||
cooperating.** The briefing and `.dejima.md` are advice. They shape what a
|
||||
cooperating agent does and stop nothing that has decided otherwise. Only the
|
||||
layers below them are enforcement.
|
||||
|
||||
## Why there are no timeouts
|
||||
|
||||
Every published checklist for sandboxing an agent lists timeouts alongside
|
||||
non-root, egress filtering and read-only mounts. dejima has none, and the
|
||||
reason is a judgement about what dejima is for rather than an item not yet
|
||||
reached.
|
||||
|
||||
**A runaway session costs money and does not cross the boundary.** It burns
|
||||
tokens and holds a CPU until someone looks. Nothing about it reaches the host,
|
||||
widens the allowlist, or writes where a session may not write - the guarantees
|
||||
dejima makes are all still held while it happens. A timeout would protect a
|
||||
budget, which dejima has never claimed to protect.
|
||||
|
||||
**And "unattended" here does not mean "unobserved".** The sessions this is
|
||||
built for run for days, and are checked at every issue and every pull request.
|
||||
They need less babysitting, not none. A wall clock tuned for that is either so
|
||||
long it prevents nothing or short enough to kill work in progress, and killing
|
||||
a session mid-commit is a failure mode of its own.
|
||||
|
||||
If this changes it will be because a resource limit starts protecting the
|
||||
boundary rather than the bill.
|
||||
|
||||
## Blast radius by layer
|
||||
|
||||
Where each layer's compromise stops, with and without the thing arranged
|
||||
@@ -209,8 +264,8 @@ can make; it is one the audit reports. See
|
||||
|
||||
## The mounted project is fully writable
|
||||
|
||||
- `--dangerously-skip-permissions` removes your chance to review tool calls
|
||||
before they run. Only point this at trusted repositories.
|
||||
- Running the harness with its permission prompts off removes your chance to
|
||||
review tool calls before they run. Only point this at trusted repositories.
|
||||
- The mounted project itself has **no write protection**. `deny-dangerous-
|
||||
bash.sh`, `git-push-guard.sh` and `merge-guard.sh` are regex
|
||||
pattern-matching on the literal Bash command string - a fast-fail guard
|
||||
@@ -705,11 +760,28 @@ session, where the credential deliberately never goes.
|
||||
the README) has no `sudo`/setuid path back to root once the container is up:
|
||||
`entrypoint.sh` runs as root, sets up the firewall directly, then drops to
|
||||
that user via `gosu` before execing the configured command (`[core] command`,
|
||||
`claude` by default). A compromised session can't
|
||||
or the selected harness's own if that is unset). A compromised session can't
|
||||
re-run `init-firewall.sh` with a wider allowlist to open its own
|
||||
exfiltration path. Verified: capabilities (`NET_ADMIN`/`NET_RAW`) are
|
||||
cleared from the effective/permitted sets on the `gosu` drop, and that
|
||||
user gets a permission error running `iptables` directly.
|
||||
- A forge credential reaches the container as `-e NAME`, never
|
||||
`-e NAME=value`. The value comes from the launcher's own environment, so it
|
||||
sits in `/proc/<pid>/environ` (mode 0400, owner only) rather than in
|
||||
`/proc/<pid>/cmdline`, which is world-readable and which `ps` prints to
|
||||
anyone. `docker inspect` still shows the resolved value to whoever can
|
||||
reach the daemon - that is daemon access rather than any process at all,
|
||||
and it is not something the launcher can change.
|
||||
- The container runs with `no-new-privileges` and an explicit capability
|
||||
floor - `cap_drop: ALL` plus the seven it actually uses. Six are the
|
||||
entrypoint's own; the seventh is `KILL`, which nothing in the entrypoint
|
||||
needs and `dejima-allow --container` does, because adding a domain to a
|
||||
running session signals dnsmasq and dnsmasq runs as its own user. The first means a setuid binary or a file capability cannot raise
|
||||
privileges on exec, which is the shape any escalation from the session user
|
||||
would have to take; the second means the capabilities nothing here uses were
|
||||
never in the bounding set to be regained. Both are asserted against a running
|
||||
container rather than against the compose file, and the capability list the
|
||||
test uses is read out of that file so the two cannot drift.
|
||||
- The approval store (`${DEJIMA_CONFIG_DIR:-$HOME/.config/dejima}`,
|
||||
see
|
||||
[Global and per-project domains and dependencies](../README.md#global-and-per-project-domains-and-dependencies)
|
||||
@@ -855,6 +927,14 @@ strips AAAA answers): there's no IPv6 equivalent of the allowlist above, so
|
||||
leaving it open would bypass the whole firewall on any host with IPv6
|
||||
egress.
|
||||
|
||||
Where `ip6tables` cannot be used at all, the firewall does not conclude that
|
||||
IPv6 is therefore absent - it asks the kernel, and treats an address on any
|
||||
interface other than loopback as the family being live. It then turns IPv6
|
||||
off in the container's own network namespace, and **refuses to start** if it
|
||||
cannot. A tool that will not run and a family that is not there are different
|
||||
conditions, and reporting the second on evidence of the first is how a
|
||||
boundary comes to be described rather than held.
|
||||
|
||||
If your Gitea host only resolves via a LAN-local DNS server, make sure the
|
||||
Docker host itself can resolve it: containers inherit the host's resolver.
|
||||
|
||||
@@ -987,6 +1067,33 @@ name. It belongs in that harness's worked example in
|
||||
[development.md](development.md#adding-a-new-harness) alongside the rest of
|
||||
what it can and cannot do.
|
||||
|
||||
## The one request dejima itself makes
|
||||
|
||||
Everything above bounds what a *session* reaches. dejima's own host side
|
||||
reaches one place, once an hour at most: `bin/dejima-update-check` asks the
|
||||
remote your checkout already tracks for the tip of the branch it already
|
||||
follows, so that a launch can say when the checkout is behind. It is
|
||||
`ls-remote`, so no objects are downloaded, and `[core] update_check = off`
|
||||
stops it entirely. There is no other endpoint and no telemetry - a domain
|
||||
you have not already configured dejima to push to is never contacted.
|
||||
|
||||
It reaches that remote by URL, from outside the repository, and never by
|
||||
remote name. `git ls-remote origin` reads the checkout's own config for how
|
||||
to get there, and `core.sshCommand`, `credential.helper` and
|
||||
`url.<base>.insteadOf` each name a command git then runs on the host. dejima
|
||||
mounts its own checkout writable when that checkout is the workspace, so a
|
||||
session that wrote `.git/config` there would otherwise get host execution out
|
||||
of the next launch. That is the same class as the `core.hooksPath` route
|
||||
above, with one difference worth stating: `hooksPath` waits for the operator
|
||||
to run a git command, and a check that runs at every startup does not wait
|
||||
for anything. Handing the URL to a git started outside the repository leaves
|
||||
none of that config in the path, and `protocol.allow` holds the transports to
|
||||
ones that cannot name a command.
|
||||
|
||||
What still crosses is the URL itself, which a session with that same write can
|
||||
point at a host of its choosing. That costs one outbound request and no
|
||||
execution, and the audit reports the config change it took.
|
||||
|
||||
## Network request logging
|
||||
|
||||
If `[logging] loki_url` is set (see Prerequisites in the README), every DNS query and every new
|
||||
|
||||
+67
-1
@@ -62,12 +62,26 @@ to instructions, because it arrives as instructions.
|
||||
4. **Cross-project context poisoning.** A session writes another project's
|
||||
agent memory or transcripts, and a later session there reads planted text
|
||||
as established background.
|
||||
5. **Container escape.** Real, and it recurs, but it needs an unpatched host
|
||||
5. **The operator running something the session asked them to run.** dejima
|
||||
tells agents to hand host-side work over rather than attempt it - a domain
|
||||
to allow, a dependency to approve, a command only the host can run. That is
|
||||
a designed, legitimate, frequent workflow, which is exactly what makes it a
|
||||
delivery mechanism: a script that does what it says and one thing more is
|
||||
indistinguishable at the moment of running it. Nothing here inspects what
|
||||
crosses that boundary, and nothing can - the whole point of the handoff is
|
||||
that a person decides.
|
||||
6. **Container escape.** Real, and it recurs, but it needs an unpatched host
|
||||
or a working zero-day, and the two rows it moves between are both already
|
||||
in the table below.
|
||||
|
||||
The ordering is the point. Nothing above the last item requires an exploit.
|
||||
|
||||
Item 5 is not an argument for making the handoff harder; a session that cannot
|
||||
ask is a session that works around you instead. It is an argument for being
|
||||
able to answer, afterwards, what that actually did to the machine - which is
|
||||
the layer below this repository's, and the reason the sister project is
|
||||
looking at detection rather than at more enforcement.
|
||||
|
||||
## Blast radius by layer
|
||||
|
||||
Read the last two columns together: the middle one is what the layer reaches
|
||||
@@ -127,6 +141,58 @@ has the two tiers and where each one's boundary sits.
|
||||
Neither is required to run dejima, and the container row holds without them.
|
||||
What they change is what the row below it costs.
|
||||
|
||||
**A survey of comparable projects found none with rows below the container at
|
||||
all** - their boundary is between the agent and the host, and what is under
|
||||
the host is outside their threat models. The same survey found nothing
|
||||
treating a forge or a CI runner as part of an agent's blast radius, which is
|
||||
what the second sister project exists for: a session that can open a pull
|
||||
request can execute code on a machine dejima never touches.
|
||||
|
||||
Recorded as an observation from one day of secondary sources rather than as a
|
||||
claim to have surveyed the field exhaustively. The reason it is here at all is
|
||||
that it changes what to defend: if the layers below and beside the container
|
||||
are ones nobody else is examining, they are also ones where nobody else's
|
||||
mistakes are available to learn from.
|
||||
|
||||
## Which deployment this describes
|
||||
|
||||
The table above describes dejima **as deployed on a devbox VM with the two
|
||||
sister projects arranged around it**. Say that plainly, because the README
|
||||
also invites running dejima on a laptop, and there the table is shorter than
|
||||
it looks: the container row holds exactly as described, and the row below it
|
||||
is the operator's own machine with nothing arranged against it.
|
||||
|
||||
That matters more than it used to. The field's own ordering for isolating an
|
||||
agent whose contents are assumed hostile puts a hardened container below
|
||||
gVisor and below a per-workload VM kernel, on the grounds that a container
|
||||
shares the host kernel and that container *runtime* vulnerabilities bypass
|
||||
syscall filtering rather than being caught by it. dejima's answer to that
|
||||
ordering is not to dispute it. It is that escape moves a layer instead of
|
||||
ending the argument - which is a better answer where the next layer exists,
|
||||
and no answer at all where it does not.
|
||||
|
||||
So `dejima-devbox-hardener` is load-bearing rather than optional-and-nice.
|
||||
On a laptop, dejima is a hardened container and the honest description of what
|
||||
is under it is "your home directory, and dejima has nothing to say about it".
|
||||
|
||||
**Load-bearing for what, exactly**, because the field's tiering invites a
|
||||
reading that project does not accept and has never claimed. A per-workload VM
|
||||
kernel is reached for elsewhere as a *containment* boundary. That is not what
|
||||
the row below the container buys here. `dejima-devbox-hardener`'s own threat
|
||||
model states in three places that its firewall bounds where a compromise can
|
||||
**spread**, not whether it can phone home: an escape reopens internet egress,
|
||||
deliberately, because deny-by-default earns its keep where the protected set
|
||||
is enumerable and the internet is not.
|
||||
|
||||
Read the row as written, then: it cuts LAN reach to what is declared, and it
|
||||
is enforced from outside the guest so root in the VM cannot flush it. It does
|
||||
not restore the egress control the container layer provides. Anyone writing
|
||||
this sentence more confidently than that is making a promise on another
|
||||
repository's behalf.
|
||||
|
||||
**What this repository can do about that is say so**, which is the whole of
|
||||
this section. Nothing in dejima can bound its own host.
|
||||
|
||||
## What this repository does not claim
|
||||
|
||||
- **That the egress allowlist bounds what reaches the model.** It bounds what
|
||||
|
||||
+130
@@ -0,0 +1,130 @@
|
||||
# Optional tools
|
||||
|
||||
A tool is a program dejima can put in a session's image that is not the
|
||||
harness and not a project dependency: something an agent uses to work, that
|
||||
dejima has looked at first.
|
||||
|
||||
None is enabled by default.
|
||||
|
||||
```ini
|
||||
# ~/.config/dejima/config - on this machine, always
|
||||
[core]
|
||||
tools = rtk
|
||||
```
|
||||
|
||||
```
|
||||
# .dejima/tools in the project - shared, and approved before it takes effect
|
||||
rtk
|
||||
```
|
||||
|
||||
```sh
|
||||
dejima --include rtk # or -i rtk, repeatable, for one launch
|
||||
```
|
||||
|
||||
The three are a union rather than a precedence chain: they answer different
|
||||
questions - what this machine always wants, what this project needs, what this
|
||||
run is for - and none is a correction of another. The project's half is a
|
||||
declaration like every other file in `.dejima/`: it grants nothing until
|
||||
`dejima-project approve` records it in a store outside the container's reach.
|
||||
|
||||
## What "optional tool" does not mean
|
||||
|
||||
**It does not mean a bare install.** This is the part worth stating first,
|
||||
because it is the whole difference between this and adding a line to
|
||||
`.dejima/dependencies`.
|
||||
|
||||
A dependency is something a project says it needs and an operator agrees to.
|
||||
Nobody claims to have read it. A tool is something **dejima ships**, and the
|
||||
bar for adding one is that dejima has hardened it. That bar applies to every
|
||||
tool added this way, not only the first:
|
||||
|
||||
- **Pinned and checksummed.** A published artifact at a fixed version with a
|
||||
`sha256` in the manifest, verified before it is unpacked. Never the
|
||||
project's own `curl | sh` installer, which fetches whatever its default
|
||||
branch points at today - an image build that produces a different binary on
|
||||
different days is one nothing has reviewed.
|
||||
- **Its network behaviour established, not assumed.** Read the source for
|
||||
outbound calls, then check the artifact you are actually shipping, because
|
||||
the two can differ. Anything it wants to reach is off unless the firewall
|
||||
allowlists it, and a tool that needs a domain allowlisted to function is one
|
||||
to argue about rather than to add.
|
||||
- **Telemetry off at the tool's own switch as well as at the firewall.** Two
|
||||
independent offs, because either one can be wrong.
|
||||
- **Wired up by dejima, not by the tool's installer.** Most of these ship an
|
||||
`init` that patches a harness's config file, and what it patches is often
|
||||
the same hook surface dejima's guards live on. dejima renders the wiring
|
||||
itself so the ordering, and what the file ends up containing, stay dejima's.
|
||||
- **The guards still hold with it enabled**, and a test says so.
|
||||
|
||||
- **It sets only its own environment.** A tool's `image_env` becomes a
|
||||
Dockerfile `ENV` that every process in the container inherits, so a bare
|
||||
name reaches the harness too. Names must be namespaced to the tool and a
|
||||
launch refuses one that is not. This is the bar's newest line, and it is
|
||||
here because rtk broke it: it shipped with `NO_COLOR=1`, and a session with
|
||||
the tool enabled lost colour in the harness, git and everything else.
|
||||
|
||||
If a tool cannot clear that, it is not an optional tool. It might still be a
|
||||
dependency a project declares and an operator approves, where the claim being
|
||||
made is much smaller.
|
||||
|
||||
## What a tool may declare
|
||||
|
||||
Deliberately little. A tool's manifest names what it is, what installs it,
|
||||
what its environment needs, and what the session should be told about it.
|
||||
There is no key for a hook, a mount, a domain or a guard - a tool that needed
|
||||
one of those would be a change to the boundary rather than a program on PATH,
|
||||
and would have to be argued for rather than declared.
|
||||
|
||||
See `docs/providers.md` for the key-by-key table.
|
||||
|
||||
## rtk
|
||||
|
||||
[rtk](https://github.com/rtk-ai/rtk) (Apache-2.0) compresses command output
|
||||
before it reaches the model: `rtk git status` runs git and prints a shorter
|
||||
form of the result. It makes no model calls of its own - it is a deterministic
|
||||
filter, so nothing about it sends your code anywhere.
|
||||
|
||||
What was checked, since the list above is only worth as much as its worst
|
||||
entry:
|
||||
|
||||
- **Pinned** to the published `x86_64-unknown-linux-musl` release by digest,
|
||||
taken from the artifact and confirmed against a second download.
|
||||
- **Telemetry exists and the project's README does not mention it.** An HTTPS
|
||||
ping is compiled into the release binary - visible in the shipped artifact's
|
||||
strings, not only in the source - gated on a consent flag that defaults to
|
||||
unset. It is off three ways here: consent unset, `RTK_TELEMETRY_DISABLED=1`
|
||||
in the image environment, and the endpoint is not allowlisted, so the
|
||||
request cannot leave the container even if the first two were wrong.
|
||||
- **It resolves wrapped commands through PATH.** Measured: `rtk git status`
|
||||
with a stub `git` earlier on PATH runs the stub. So dejima's PATH shadows -
|
||||
the git guard and the forge guard - still apply to a command run through it,
|
||||
which is the property that matters most here.
|
||||
- **Its Claude Code integration installs a `PreToolUse` hook that rewrites
|
||||
commands**, in the same slot dejima's guards occupy. dejima does not install
|
||||
that hook. See below.
|
||||
|
||||
### Why the hook is not installed
|
||||
|
||||
`rtk init` registers a hook that rewrites a Bash command before it runs -
|
||||
`git push origin main` becomes `rtk git push origin main`. That is the same
|
||||
`PreToolUse`/`Bash` slot as `deny-dangerous-bash.sh`, `git-push-guard.sh` and
|
||||
`merge-guard.sh`, and the ordering between a third-party rewrite and dejima's
|
||||
guards is not something dejima would control once the tool's installer had
|
||||
written it.
|
||||
|
||||
So dejima tells the session the tool exists instead, which is exactly what
|
||||
rtk's own Cline integration does. That is weaker: the agent chooses when to
|
||||
use it rather than getting it automatically. It is also the conservative first
|
||||
position for the first tool of this kind, and the thing that would change it
|
||||
is a measurement - establishing how Claude Code merges hooks across settings
|
||||
layers, and whether a guard sees the original command or the rewritten one -
|
||||
rather than a preference.
|
||||
|
||||
Note what is not being claimed: a session can run `rtk git push` itself
|
||||
whether or not dejima installs the hook. The guards hold because they hold at
|
||||
the PATH and hook layers, not because the tool is absent.
|
||||
|
||||
### Limitation
|
||||
|
||||
x86_64 only. The tarball spec names one architecture (issue #97), so an arm64
|
||||
host cannot use this entry.
|
||||
@@ -6,6 +6,12 @@ merge_block = gitea-pr merge
|
||||
# marker is core's (docker/forge-guard.sh); this only says which commands carry
|
||||
# one and what each of them is writing.
|
||||
disclose = pr:gitea-pr create, pr:gitea-pr edit, issue:gitea-issue create, issue:gitea-issue edit, comment:gitea-issue comment
|
||||
# Which of the keys above belong to a PERSON rather than to the project. A
|
||||
# project's .dejima/ is committed and shared; a token path is per-user and
|
||||
# per-machine, so a project may not declare one and an [identity.<name>]
|
||||
# section may set one. One declaration drives both rules, so they cannot
|
||||
# disagree about which key is which.
|
||||
identity_keys = token_file
|
||||
keys = ssh_host:?hostname api:?url token_file:path=~/.config/gitea/token
|
||||
requires = ssh_host api token_file
|
||||
host_keys = ssh_host
|
||||
|
||||
Executable
+215
@@ -0,0 +1,215 @@
|
||||
#!/bin/bash
|
||||
# The one thing `gh` cannot do (#186).
|
||||
#
|
||||
# `gh pr view --comments` prints reviews and comments with no resolution state
|
||||
# anywhere in the output, because the REST API it uses does not carry any.
|
||||
# `isResolved` exists only on `reviewThreads` in the GraphQL API. So an agent
|
||||
# or an operator working through PR feedback re-reads and re-answers threads
|
||||
# that were closed a week ago, with nothing saying so - quiet in the direction
|
||||
# that wastes the most work.
|
||||
#
|
||||
# Everything else `gitea-pr` does has a `gh` subcommand already, which is why
|
||||
# this ships one command rather than a second CLI. It reads and never writes,
|
||||
# so there is no authorship disclosure to apply: docker/forge-guard.sh shadows
|
||||
# `gh`, not this.
|
||||
set -euo pipefail
|
||||
|
||||
function usage() {
|
||||
echo "Usage: github-pr comments PR_NUMBER [--all]"
|
||||
echo ""
|
||||
echo "Shows a pull request's comments, reviews and inline review threads."
|
||||
echo "Unresolved threads only by default; --all includes the ones already"
|
||||
echo "resolved, marked as such."
|
||||
echo ""
|
||||
echo "The repository is the 'origin' remote of the checkout you are in, and"
|
||||
echo "must be on github.com. Authentication is gh's own - GH_TOKEN, or"
|
||||
echo "whatever 'gh auth status' reports."
|
||||
}
|
||||
|
||||
# Same shape as gitea-pr's: resolve from origin and refuse another host, so
|
||||
# this tool cannot be pointed at a repository the checkout is not for. Covers
|
||||
# ssh, scp-style and https remotes by taking the last two path components
|
||||
# rather than parsing any of them as a URL.
|
||||
function github_owner_repo() {
|
||||
local remote_url stripped name rest owner
|
||||
remote_url=$(git remote get-url origin 2>/dev/null) || {
|
||||
echo "No 'origin' remote found in this repository" >&2
|
||||
exit 1
|
||||
}
|
||||
case "$remote_url" in
|
||||
*github.com[:/]*) ;;
|
||||
*) echo "origin remote ($remote_url) is not on github.com; github-pr only supports this host" >&2
|
||||
exit 1 ;;
|
||||
esac
|
||||
stripped="${remote_url%/}"
|
||||
stripped="${stripped%.git}"
|
||||
name="${stripped##*/}"
|
||||
rest="${stripped%/*}"
|
||||
owner="${rest##*[:/]}"
|
||||
if [ -z "$owner" ] || [ -z "$name" ] || [ "$owner" = "$stripped" ]; then
|
||||
echo "Could not read an owner/name out of the origin remote ($remote_url)" >&2
|
||||
exit 1
|
||||
fi
|
||||
printf '%s/%s' "$owner" "$name"
|
||||
}
|
||||
|
||||
# The number reaches gh as a typed GraphQL variable rather than being spliced
|
||||
# into a path, so this is not the URL-traversal check gitea-pr's is. It is
|
||||
# here so a mistyped argument fails with something a person can act on instead
|
||||
# of a GraphQL type error.
|
||||
function require_number() {
|
||||
if ! [[ "${1:-}" =~ ^[0-9]+$ ]]; then
|
||||
echo "Expected a PR number, got '${1:-}'" >&2
|
||||
exit 1
|
||||
fi
|
||||
}
|
||||
|
||||
if [ "$#" -lt 1 ]; then
|
||||
usage
|
||||
exit 1
|
||||
fi
|
||||
|
||||
subcommand="$1"
|
||||
shift
|
||||
|
||||
case "$subcommand" in
|
||||
-h|--help|help) usage; exit 0 ;;
|
||||
comments) ;;
|
||||
*) echo "Unknown subcommand: $subcommand" >&2; usage >&2; exit 1 ;;
|
||||
esac
|
||||
|
||||
require_number "${1:-}"
|
||||
pr_number="$1"
|
||||
shift || true
|
||||
show_all=0
|
||||
while [ "$#" -gt 0 ]; do
|
||||
case "$1" in
|
||||
--all) show_all=1 ;;
|
||||
*) echo "Unknown argument: $1" >&2
|
||||
echo "Usage: github-pr comments PR_NUMBER [--all]" >&2
|
||||
exit 1 ;;
|
||||
esac
|
||||
shift
|
||||
done
|
||||
|
||||
owner_repo="$(github_owner_repo)"
|
||||
owner="${owner_repo%%/*}"
|
||||
repo="${owner_repo##*/}"
|
||||
|
||||
# gh's own message, then one line saying what was being asked for. Captured
|
||||
# rather than piped straight into jq: on a 404 gh prints "Not Found" and exits,
|
||||
# and jq then fails on the message text, so the last thing on the terminal is
|
||||
# "Cannot index string with string" rather than the fact that the PR does not
|
||||
# exist.
|
||||
api_or_die() {
|
||||
local what="$1"; shift
|
||||
local out
|
||||
if ! out="$("$@" 2>&1)"; then
|
||||
printf '%s\n' "$out" >&2
|
||||
echo "github-pr: could not $what for ${owner_repo}#${pr_number}" >&2
|
||||
exit 1
|
||||
fi
|
||||
printf '%s' "$out"
|
||||
}
|
||||
|
||||
echo "=== Issue comments ==="
|
||||
api_or_die "fetch issue comments" \
|
||||
gh api --paginate "repos/${owner}/${repo}/issues/${pr_number}/comments" \
|
||||
| jq -r '.[] | "[\(.user.login) @ \(.created_at)]\n\(.body)\n"'
|
||||
|
||||
echo "=== Reviews ==="
|
||||
api_or_die "fetch reviews" \
|
||||
gh api --paginate "repos/${owner}/${repo}/pulls/${pr_number}/reviews" \
|
||||
| jq -r '.[] | select(.body != "") | "[\(.user.login) @ \(.submitted_at) — \(.state)]\n\(.body)\n"'
|
||||
|
||||
echo "=== Inline review comments ==="
|
||||
|
||||
# reviewThreads, not the REST review comments, for the whole reason this tool
|
||||
# exists: `isResolved` is only here. `isOutdated` comes with it and is worth
|
||||
# printing - a thread against a hunk that no longer exists is usually already
|
||||
# handled, and reads as outstanding otherwise.
|
||||
#
|
||||
# Paginated by hand rather than with `gh api --paginate`: that flag emits one
|
||||
# JSON document per page for GraphQL, which would have to be reassembled here
|
||||
# anyway, and the bound below is the point. A server that ignored `after`
|
||||
# would otherwise loop forever, and this runs unattended.
|
||||
PAGE_SIZE=50
|
||||
PAGE_MAX=20
|
||||
read -r -d '' QUERY <<'GRAPHQL' || true
|
||||
query($owner: String!, $name: String!, $number: Int!, $size: Int!, $cursor: String) {
|
||||
repository(owner: $owner, name: $name) {
|
||||
pullRequest(number: $number) {
|
||||
reviewThreads(first: $size, after: $cursor) {
|
||||
pageInfo { hasNextPage endCursor }
|
||||
nodes {
|
||||
isResolved
|
||||
isOutdated
|
||||
path
|
||||
line
|
||||
comments(first: 100) {
|
||||
pageInfo { hasNextPage }
|
||||
nodes { author { login } body diffHunk createdAt }
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
GRAPHQL
|
||||
|
||||
threads='[]'
|
||||
cursor=""
|
||||
page=1
|
||||
while [ "$page" -le "$PAGE_MAX" ]; do
|
||||
if [ -z "$cursor" ]; then
|
||||
json="$(api_or_die "fetch review threads" gh api graphql -f query="$QUERY" \
|
||||
-f owner="$owner" -f name="$repo" -F number="$pr_number" -F size="$PAGE_SIZE")"
|
||||
else
|
||||
json="$(api_or_die "fetch review threads" gh api graphql -f query="$QUERY" \
|
||||
-f owner="$owner" -f name="$repo" -F number="$pr_number" -F size="$PAGE_SIZE" \
|
||||
-f cursor="$cursor")"
|
||||
fi
|
||||
# GraphQL answers a PR number that does not exist with a null pullRequest
|
||||
# and no error at all, so this is the check that catches it rather than
|
||||
# adding null to an array and failing with jq's wording.
|
||||
if [ "$(jq -r '.data.repository.pullRequest // "null"' <<< "$json")" = "null" ]; then
|
||||
echo "github-pr: no pull request ${owner_repo}#${pr_number}" >&2
|
||||
exit 1
|
||||
fi
|
||||
threads="$(jq -n --argjson a "$threads" --argjson b "$json" \
|
||||
'$a + $b.data.repository.pullRequest.reviewThreads.nodes')"
|
||||
if [ "$(jq -r '.data.repository.pullRequest.reviewThreads.pageInfo.hasNextPage' <<< "$json")" != "true" ]; then
|
||||
break
|
||||
fi
|
||||
cursor="$(jq -r '.data.repository.pullRequest.reviewThreads.pageInfo.endCursor' <<< "$json")"
|
||||
page=$((page + 1))
|
||||
done
|
||||
if [ "$page" -gt "$PAGE_MAX" ]; then
|
||||
echo "warning: stopped reading review threads after $PAGE_MAX pages - some may be missing" >&2
|
||||
fi
|
||||
|
||||
# A thread whose replies did not all fit is reported rather than silently
|
||||
# truncated, for the same reason the page bound is: a feedback tool that drops
|
||||
# the comment someone is waiting on is worse than one that says it might have.
|
||||
truncated="$(jq '[.[] | select(.comments.pageInfo.hasNextPage)] | length' <<< "$threads")"
|
||||
[ "$truncated" -eq 0 ] || \
|
||||
echo "warning: $truncated thread(s) have more replies than were fetched" >&2
|
||||
|
||||
resolved_count="$(jq '[.[] | select(.isResolved)] | length' <<< "$threads")"
|
||||
if [ "$show_all" -eq 1 ]; then
|
||||
visible="$threads"
|
||||
else
|
||||
visible="$(jq '[.[] | select(.isResolved | not)]' <<< "$threads")"
|
||||
fi
|
||||
|
||||
# The hunk, not just the path, and the same layout gitea-pr prints: whoever
|
||||
# reads one of these tools should not have to learn the other's output.
|
||||
jq -r '.[]
|
||||
| . as $t
|
||||
| .comments.nodes[]
|
||||
| "[\(.author.login // "?") @ \($t.path):\($t.line // "?")\(if $t.isResolved then " (resolved)" else "" end)\(if $t.isOutdated then " (outdated)" else "" end)]\n\($t.comments.nodes[0].diffHunk // "(no hunk recorded)")\n--- comment ---\n\(.body)\n"' \
|
||||
<<< "$visible"
|
||||
|
||||
if [ "$show_all" -ne 1 ] && [ "$resolved_count" -gt 0 ]; then
|
||||
echo "($resolved_count resolved thread(s) hidden. Re-run with --all to include them.)"
|
||||
fi
|
||||
@@ -24,7 +24,25 @@ capabilities = pr issues
|
||||
pr_command = gh pr
|
||||
issue_command = gh issue
|
||||
merge_block = gh pr merge
|
||||
# How this CLI can be pointed at a repository other than the one the session
|
||||
# was launched against. `gh` takes --repo/-R on essentially every subcommand
|
||||
# and reads GH_REPO from the environment, so the ordinary path can file an
|
||||
# issue or leave a comment anywhere the token reaches (#187). The gitea CLIs
|
||||
# have no equivalent - they resolve the repo from origin and refuse another
|
||||
# host - which is why these keys are empty for that forge rather than absent
|
||||
# from the schema.
|
||||
#
|
||||
# Fast-fail, not a boundary, exactly as merge_block is: the session holds the
|
||||
# token and could call the API directly. What actually bounds this is the
|
||||
# scope of push_token_file, which is why docs/providers.md says a
|
||||
# repository-scoped fine-grained PAT is the expected shape.
|
||||
repo_flags = --repo -R
|
||||
repo_env = GH_REPO
|
||||
disclose = pr:gh pr create, pr:gh pr edit, issue:gh issue create, issue:gh issue edit, comment:gh issue comment
|
||||
# See the gitea manifest's note: this is the key an identity supplies and a
|
||||
# project may not. The read-only [github] token_file is core's rather than
|
||||
# this forge's, and is not here for that reason.
|
||||
identity_keys = push_token_file
|
||||
keys = push_token_file:?path
|
||||
requires = push_token_file
|
||||
fixed_hosts = github.com ssh.github.com api.github.com
|
||||
@@ -33,5 +51,11 @@ hosts_allowlisted_by_core = on
|
||||
# declared: the entrypoint links the merge shadow over a command only when it
|
||||
# is behind /usr/local/lib/dejima/forge, and refuses to start otherwise rather
|
||||
# than leave a merge block that looks enforced and is not.
|
||||
install = system:gh
|
||||
#
|
||||
# github-pr is dejima's, and exists for one thing gh cannot do: thread
|
||||
# resolution lives only in the GraphQL API, so `gh pr view --comments` shows
|
||||
# resolved and unresolved review threads alike and an agent working through
|
||||
# feedback re-answers what was closed a week ago (#186). It reads and never
|
||||
# writes, so nothing is shadowed over it.
|
||||
install = system:gh bin/github-pr
|
||||
env_export = GH_TOKEN=@push_token_file
|
||||
|
||||
@@ -207,7 +207,7 @@ if [ -f "$decl_dir/allowed-domains" ]; then
|
||||
Tell the user to run, outside the sandbox:
|
||||
dejima-project approve \"$project_dir\"
|
||||
(or, for one domain right now:
|
||||
bin/dejima-allow --container $container_id <domain>)"
|
||||
dejima-allow --container $container_id <domain>)"
|
||||
fi
|
||||
fi
|
||||
|
||||
|
||||
@@ -1,8 +1,8 @@
|
||||
#!/usr/bin/env bash
|
||||
# Notification/Stop hook. bin/dejima registers it, per session, into the
|
||||
# throwaway settings.json copy it generates for a session that has remote
|
||||
# access enabled, and nowhere else. Every sandbox gets such a copy, derived
|
||||
# from the operator's real settings.json; registering it in that real file
|
||||
# Notification hook. The selected harness's plugin registers it, per session,
|
||||
# into the throwaway settings.json copy bin/dejima generates for a session
|
||||
# that has remote access enabled, and nowhere else. Every sandbox gets such a
|
||||
# copy, derived from the operator's real settings.json; registering it there
|
||||
# instead would put this hook into all of them - and into the host's own
|
||||
# Claude Code, which reads that file directly - where there is no marker
|
||||
# directory to write into. The copy is mounted read-only (see
|
||||
|
||||
@@ -76,6 +76,7 @@ link_bin dejima-project
|
||||
# operator to run `dejima-audit ack`, which is only true once it is on PATH.
|
||||
link_bin dejima-audit
|
||||
link_bin dejima-epitaph
|
||||
link_bin dejima-update-check
|
||||
|
||||
# Remote access (opt-in, see docs/remote-access.md). All three are inert
|
||||
# without [remote-access] enabled = on - they refuse to run at all - so
|
||||
|
||||
+621
-5
@@ -27,7 +27,7 @@ setup() {
|
||||
}
|
||||
|
||||
teardown() {
|
||||
rm -rf "$CONFIG_DIR" ${STUB_DIR:+"$STUB_DIR"}
|
||||
rm -rf "$CONFIG_DIR" ${STUB_DIR:+"$STUB_DIR"} ${UPD_DIR:+"$UPD_DIR"}
|
||||
}
|
||||
|
||||
lib() { bash -c 'source "$1"; shift; "$@"' _ "$LIB" "$@"; }
|
||||
@@ -487,6 +487,100 @@ write_config() {
|
||||
|| { echo "the refusal does not name the key: $output"; return 1; }
|
||||
}
|
||||
|
||||
# --- identities: the half of a project's config that belongs to a person -----
|
||||
#
|
||||
# A project's .dejima/ is committed and shared; an ssh key path and a token
|
||||
# path are per-user and per-machine. An identity is where those live, so a
|
||||
# project can name an account without naming a path.
|
||||
|
||||
_identity_fixture() {
|
||||
ID_DIR="$(mktemp -d)"
|
||||
: > "$ID_DIR/default-key"; : > "$ID_DIR/work-key"; : > "$ID_DIR/oss-key"
|
||||
: > "$ID_DIR/default-token"; : > "$ID_DIR/work-token"
|
||||
write_config '[core]' 'forge = gitea' "ssh_key = $ID_DIR/default-key" \
|
||||
'[forge.gitea]' 'ssh_host = git.example' 'api = https://git.example/api/v1' \
|
||||
"token_file = $ID_DIR/default-token" \
|
||||
'[identity.work]' "ssh_key = $ID_DIR/work-key" 'user_name = A Name' \
|
||||
'user_email = name@work.example' "token_file = $ID_DIR/work-token" \
|
||||
'[identity.oss]' "ssh_key = $ID_DIR/oss-key"
|
||||
}
|
||||
|
||||
@test "an identity supplies the ssh key and the forge credential" {
|
||||
_identity_fixture
|
||||
run "$REPO_ROOT/bin/dejima" --identity work --print-config
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
grep -qx "core.ssh_key=$ID_DIR/work-key" <<< "$output" || { echo "$output"; return 1; }
|
||||
grep -qx "forge.gitea.token_file=$ID_DIR/work-token" <<< "$output" \
|
||||
|| { echo "$output"; return 1; }
|
||||
rm -rf "$ID_DIR"
|
||||
}
|
||||
|
||||
@test "a key the identity does not name falls through to the file" {
|
||||
# An identity overrides what it names. Treating it as a replacement for
|
||||
# the whole section would make a half-filled one silently unset the rest.
|
||||
_identity_fixture
|
||||
run "$REPO_ROOT/bin/dejima" --identity oss --print-config
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
grep -qx "core.ssh_key=$ID_DIR/oss-key" <<< "$output" || { echo "$output"; return 1; }
|
||||
grep -qx "forge.gitea.token_file=$ID_DIR/default-token" <<< "$output" \
|
||||
|| { echo "oss has no token_file and did not fall through: $output"; return 1; }
|
||||
rm -rf "$ID_DIR"
|
||||
}
|
||||
|
||||
@test "an identity that names nothing is refused, not ignored" {
|
||||
# The whole point of the refusal: falling through to this machine's own
|
||||
# credentials would push under the wrong account with nothing saying so.
|
||||
# Pushing under the wrong key fails loudly; pushing under the default key
|
||||
# when you asked for another does not fail at all.
|
||||
_identity_fixture
|
||||
run "$REPO_ROOT/bin/dejima" --identity wrok --print-config
|
||||
[ "$status" -ne 0 ] || { echo "a nonexistent identity was accepted"; return 1; }
|
||||
[[ "$output" == *"wrok"* ]] || { echo "$output"; return 1; }
|
||||
[[ "$output" != *"core.ssh_key="* ]] \
|
||||
|| { echo "printed a resolved config under an identity that does not exist"; return 1; }
|
||||
rm -rf "$ID_DIR"
|
||||
}
|
||||
|
||||
@test "a flag beats the identity, and the identity beats the file" {
|
||||
_identity_fixture
|
||||
run "$REPO_ROOT/bin/dejima" --identity work --print-config
|
||||
grep -qx "core.ssh_key=$ID_DIR/work-key" <<< "$output" || { echo "$output"; return 1; }
|
||||
# [core] identity in the file, overridden by the flag.
|
||||
write_config '[core]' 'identity = work' "ssh_key = $ID_DIR/default-key" \
|
||||
'[identity.work]' "ssh_key = $ID_DIR/work-key" \
|
||||
'[identity.oss]' "ssh_key = $ID_DIR/oss-key"
|
||||
run "$REPO_ROOT/bin/dejima" --print-config
|
||||
grep -qx "core.ssh_key=$ID_DIR/work-key" <<< "$output" || { echo "$output"; return 1; }
|
||||
run "$REPO_ROOT/bin/dejima" --identity oss --print-config
|
||||
grep -qx "core.ssh_key=$ID_DIR/oss-key" <<< "$output" \
|
||||
|| { echo "--identity did not beat [core] identity: $output"; return 1; }
|
||||
rm -rf "$ID_DIR"
|
||||
}
|
||||
|
||||
@test "an identity may only set what a person owns" {
|
||||
# Not a second config file with different rules about what may be in it.
|
||||
_identity_fixture
|
||||
write_config '[core]' 'forge = gitea' '[identity.work]' 'firewall = off'
|
||||
run "$REPO_ROOT/bin/dejima" --identity work --print-config
|
||||
[ "$status" -ne 0 ] || { echo "an identity set [core] firewall"; return 1; }
|
||||
[[ "$output" == *"firewall"* ]] || { echo "$output"; return 1; }
|
||||
rm -rf "$ID_DIR"
|
||||
}
|
||||
|
||||
@test "an identity's git name reaches the container's gitconfig copy" {
|
||||
# Appended to the COPY dejima already makes, so the real ~/.gitconfig is
|
||||
# untouched - which was already true and is what the copy is for.
|
||||
_identity_fixture
|
||||
grep -q 'identity_git_field' "$REPO_ROOT/bin/dejima" \
|
||||
|| { echo "the launcher no longer reads the identity's git name"; return 1; }
|
||||
# Written with git itself rather than printf: the value is the operator's
|
||||
# own text, and a name with a quote or a backslash in it has to survive
|
||||
# into a file git reads back the same way.
|
||||
grep -q 'git config -f "$SANDBOX_GITCONFIG_DIR/.gitconfig"' "$REPO_ROOT/bin/dejima" \
|
||||
|| { echo "the git name is no longer written with git"; return 1; }
|
||||
rm -rf "$ID_DIR"
|
||||
}
|
||||
|
||||
@test "--harness selects a harness for one launch without changing the default" {
|
||||
# A host keeps one harness as its default and reaches another when it wants
|
||||
# to. Everything else was already in place - harnesses configure side by
|
||||
@@ -639,6 +733,88 @@ write_config() {
|
||||
[[ "$output" == *"core.command=nvim"* ]]
|
||||
}
|
||||
|
||||
@test "the narrowing flags only ever narrow" {
|
||||
# Each of these turns something off for one launch and has no counterpart
|
||||
# that turns it on. A config saying off is a decision; a flag that could
|
||||
# undo it in passing would make the file's answer the weaker one.
|
||||
write_config '[logging]' 'loki_url = https://loki.example.com' 'conversation = on' \
|
||||
'[epitaph]' 'enabled = on' \
|
||||
'[audit]' 'strict = off'
|
||||
run "$REPO_ROOT/bin/dejima" --print-config
|
||||
[[ "$output" == *"logging.conversation=on"* ]] || { echo "$output"; return 1; }
|
||||
|
||||
run "$REPO_ROOT/bin/dejima" --no-conversation --print-config
|
||||
[[ "$output" == *"logging.conversation=off"* ]] || { echo "$output"; return 1; }
|
||||
# and only that: the DNS and firewall log still ships.
|
||||
[[ "$output" == *"logging.loki_url=https://loki.example.com"* ]] \
|
||||
|| { echo "--no-conversation took the whole log with it"; return 1; }
|
||||
|
||||
run "$REPO_ROOT/bin/dejima" --no-log --print-config
|
||||
grep -qx 'logging.loki_url=' <<< "$output" || { echo "$output"; return 1; }
|
||||
# --no-log implies --no-conversation: shipping the transcript needs an
|
||||
# endpoint, and leaving the key on while clearing the endpoint would read
|
||||
# as conversation logging still being in force.
|
||||
[[ "$output" == *"logging.conversation=off"* ]] || { echo "$output"; return 1; }
|
||||
|
||||
run "$REPO_ROOT/bin/dejima" --no-epitaph --print-config
|
||||
[[ "$output" == *"epitaph.enabled=off"* ]] || { echo "$output"; return 1; }
|
||||
|
||||
run "$REPO_ROOT/bin/dejima" --strict-audit --print-config
|
||||
[[ "$output" == *"audit.strict=on"* ]] || { echo "$output"; return 1; }
|
||||
|
||||
# None of them takes a value, so none can be turned back on by passing one.
|
||||
local f
|
||||
for f in --no-log --no-conversation --no-epitaph --strict-audit; do
|
||||
run "$REPO_ROOT/bin/dejima" "$f" on --print-config
|
||||
[ "$status" -ne 0 ] || { echo "$f accepted a value: $output"; return 1; }
|
||||
done
|
||||
}
|
||||
|
||||
@test "a harness-key flag sets the selected harness's key" {
|
||||
# --model is one flag over harnesses that spell the setting differently or
|
||||
# do not have it at all, so what it resolves to depends on the selection.
|
||||
write_config '[core]' 'harness = cline' \
|
||||
'[harness.cline]' 'model = from-the-file'
|
||||
run "$REPO_ROOT/bin/dejima" --print-config
|
||||
[[ "$output" == *"harness.cline.model=from-the-file"* ]] || { echo "$output"; return 1; }
|
||||
|
||||
run "$REPO_ROOT/bin/dejima" --model from-the-flag --base-url http://127.0.0.1:8080 \
|
||||
--context-window 60000 --print-config
|
||||
[[ "$output" == *"harness.cline.model=from-the-flag"* ]] || { echo "$output"; return 1; }
|
||||
[[ "$output" == *"harness.cline.base_url=http://127.0.0.1:8080"* ]] || { echo "$output"; return 1; }
|
||||
[[ "$output" == *"harness.cline.context_window=60000"* ]] || { echo "$output"; return 1; }
|
||||
}
|
||||
|
||||
@test "a harness-key flag is resolved after every flag, not where it appears" {
|
||||
# --harness may come after --model, so which harness the key belongs to is
|
||||
# not known until the whole line has been read. Resolving eagerly would
|
||||
# bind the flag to whatever the config happened to say.
|
||||
write_config '[core]' 'harness = claude-code'
|
||||
run "$REPO_ROOT/bin/dejima" --model chosen --harness cline --print-config
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
[[ "$output" == *"harness.cline.model=chosen"* ]] || { echo "$output"; return 1; }
|
||||
}
|
||||
|
||||
@test "a harness-key flag is refused for a harness without that key" {
|
||||
# Silently doing nothing is the failure worth avoiding: --model against a
|
||||
# harness with no model setting reads as having chosen one.
|
||||
write_config '[core]' 'harness = claude-code'
|
||||
run "$REPO_ROOT/bin/dejima" --model x --print-config
|
||||
[ "$status" -ne 0 ] || { echo "--model was accepted for claude-code"; return 1; }
|
||||
[[ "$output" == *"claude-code"* ]] || { echo "the refusal does not name the harness: $output"; return 1; }
|
||||
[[ "$output" == *"model"* ]] || { echo "the refusal does not name the key: $output"; return 1; }
|
||||
}
|
||||
|
||||
@test "a harness-key flag names itself in a validation failure" {
|
||||
# _set_override reports the key by default, and --context-window's key is
|
||||
# context_window - an option nobody can type.
|
||||
write_config '[core]' 'harness = cline'
|
||||
run "$REPO_ROOT/bin/dejima" --context-window 5 --print-config
|
||||
[ "$status" -ne 0 ]
|
||||
[[ "$output" == *"--context-window"* ]] || { echo "$output"; return 1; }
|
||||
[[ "$output" != *"--context_window"* ]] || { echo "reported the key, not the flag: $output"; return 1; }
|
||||
}
|
||||
|
||||
@test "a flag value is validated against the same schema type" {
|
||||
write_config '[core]' 'firewall = on'
|
||||
run "$REPO_ROOT/bin/dejima" --cmd 'rm -rf /' --print-config
|
||||
@@ -1755,21 +1931,34 @@ _epitaph_fixture() {
|
||||
EPI_SLUG="$(printf '%s' "$EPI_WS" | sed 's/[^a-zA-Z0-9]/-/g')"
|
||||
mkdir -p "$EPI_TR/$EPI_SLUG"
|
||||
# The transcripts directory reaches the tool through the harness's own
|
||||
# config key now, not as an argument: where transcripts live is the
|
||||
# harness's, and dejima-epitaph no longer knows the shape of it.
|
||||
# config key, not as an argument: where transcripts live is the harness's,
|
||||
# and dejima-epitaph no longer knows the shape of it. `list` needs the same
|
||||
# key to report whether the session behind an epitaph is still resumable.
|
||||
write_config '[epitaph]' "dir = $EPI_STORE" \
|
||||
'[harness.claude-code]' "projects_dir = $EPI_TR"
|
||||
}
|
||||
|
||||
# One compact_boundary carrying the metadata, then the summary itself.
|
||||
# One compact_boundary carrying the metadata, then the summary itself. The
|
||||
# session id matches the transcript's filename, as Claude Code's own do -
|
||||
# that pairing is what `list` resolves to decide a session is still there.
|
||||
_epitaph_transcript() {
|
||||
local f="$EPI_TR/$EPI_SLUG/$1.jsonl" text="${2:-worked out X}" uid="${3:-aaaabbbb}"
|
||||
local ts="${4:-2026-01-02T03:04:05.000Z}"
|
||||
{
|
||||
printf '{"type":"system","subtype":"compact_boundary","compactMetadata":{"trigger":"manual","preTokens":900,"postTokens":90}}\n'
|
||||
printf '{"type":"user","isCompactSummary":true,"uuid":"%s","sessionId":"s-1","timestamp":"2026-01-02T03:04:05.000Z","message":{"content":"%s"}}\n' "$uid" "$text"
|
||||
printf '{"type":"user","isCompactSummary":true,"uuid":"%s","sessionId":"%s","timestamp":"%s","message":{"content":"%s"}}\n' "$uid" "$1" "$ts" "$text"
|
||||
} > "$f"
|
||||
}
|
||||
|
||||
# Three epitaphs in a known order, so an index means something to assert on.
|
||||
_epitaph_three() {
|
||||
_epitaph_fixture
|
||||
_epitaph_transcript s1 "the firewall drops IPv6" aaaa1111 2026-01-02T03:04:05.000Z
|
||||
_epitaph_transcript s2 "the DNS proxy rewrote resolv" bbbb2222 2026-02-03T04:05:06.000Z
|
||||
_epitaph_transcript s3 "worked out the audit baseline" cccc3333 2026-03-04T05:06:07.000Z
|
||||
"$REPO_ROOT/bin/dejima-epitaph" save "$EPI_WS" >/dev/null 2>&1
|
||||
}
|
||||
|
||||
@test "an epitaph is written out of the container's reach" {
|
||||
_epitaph_fixture
|
||||
_epitaph_transcript s1 "the thing this session worked out"
|
||||
@@ -1842,6 +2031,128 @@ _epitaph_transcript() {
|
||||
rm -rf "$EPI_STORE" "$EPI_TR" "$EPI_WS"
|
||||
}
|
||||
|
||||
@test "list shows one row per epitaph, oldest first" {
|
||||
_epitaph_three
|
||||
run "$REPO_ROOT/bin/dejima-epitaph" list "$EPI_WS"
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
[ "$(grep -cE '^ +[0-9]+ [0-9]{4}-' <<< "$output")" -eq 3 ] || { echo "$output"; return 1; }
|
||||
# Chronological by the timestamp in the name, which is what makes an
|
||||
# index stable enough for `show <n>` to mean anything.
|
||||
grep -q '^ *1 2026-01-02' <<< "$output" || { echo "$output"; return 1; }
|
||||
grep -q '^ *3 2026-03-04' <<< "$output" || { echo "$output"; return 1; }
|
||||
rm -rf "$EPI_STORE" "$EPI_TR" "$EPI_WS"
|
||||
}
|
||||
|
||||
@test "list says whether the session behind an epitaph is still resumable" {
|
||||
# Resuming the real session beats reading a summary of it, so the listing
|
||||
# has to say which of the two is still on offer.
|
||||
_epitaph_three
|
||||
run "$REPO_ROOT/bin/dejima-epitaph" list "$EPI_WS"
|
||||
[ "$(grep -c 'resumable' <<< "$output")" -eq 3 ] || { echo "$output"; return 1; }
|
||||
rm -f "$EPI_TR/$EPI_SLUG/s2.jsonl"
|
||||
run "$REPO_ROOT/bin/dejima-epitaph" list "$EPI_WS"
|
||||
[ "$(grep -c 'resumable' <<< "$output")" -eq 2 ] || { echo "$output"; return 1; }
|
||||
grep -q '^ *2 .*aged out' <<< "$output" || { echo "$output"; return 1; }
|
||||
rm -rf "$EPI_STORE" "$EPI_TR" "$EPI_WS"
|
||||
}
|
||||
|
||||
@test "reading the store is not gated on [epitaph] enabled" {
|
||||
# Turning epitaph off must not strand what it already kept: the operator
|
||||
# who switches it off is the one most likely to want to look at, and get
|
||||
# rid of, what is there.
|
||||
_epitaph_three
|
||||
write_config '[epitaph]' "dir = $EPI_STORE" 'enabled = off' \
|
||||
'[harness.claude-code]' "projects_dir = $EPI_TR"
|
||||
run "$REPO_ROOT/bin/dejima-epitaph" list "$EPI_WS"
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
[ "$(grep -cE '^ +[0-9]+ [0-9]{4}-' <<< "$output")" -eq 3 ] || { echo "$output"; return 1; }
|
||||
# Writing still is.
|
||||
_epitaph_transcript s4 "should not be kept" dddd4444 2026-04-05T06:07:08.000Z
|
||||
"$REPO_ROOT/bin/dejima-epitaph" save "$EPI_WS" >/dev/null 2>&1
|
||||
[ "$(find "$EPI_STORE" -name '*.md' | wc -l)" -eq 3 ]
|
||||
rm -rf "$EPI_STORE" "$EPI_TR" "$EPI_WS"
|
||||
}
|
||||
|
||||
@test "list says the resumable state is unknown rather than guessing it" {
|
||||
# Which sessions still have a transcript is the harness's answer. With no
|
||||
# harness there is nobody to ask, and "aged out" would be a claim this
|
||||
# cannot support - the transcripts may be sitting right there. The config
|
||||
# is written directly because write_config seeds a harness otherwise.
|
||||
_epitaph_three
|
||||
printf '[epitaph]\ndir = %s\n' "$EPI_STORE" > "$CONFIG_DIR/config"
|
||||
run "$REPO_ROOT/bin/dejima-epitaph" list "$EPI_WS"
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
[ "$(grep -c 'resumable' <<< "$output")" -eq 0 ] || { echo "$output"; return 1; }
|
||||
[ "$(grep -c 'aged out' <<< "$output")" -eq 0 ] || { echo "$output"; return 1; }
|
||||
[ "$(grep -cE '^ +[0-9]+ [0-9]{4}-' <<< "$output")" -eq 3 ] || { echo "$output"; return 1; }
|
||||
rm -rf "$EPI_STORE" "$EPI_TR" "$EPI_WS"
|
||||
}
|
||||
|
||||
@test "search finds an epitaph by content and reports its listing index" {
|
||||
# The names are a timestamp and a uuid, so nothing about a filename says
|
||||
# which session it was. Search is the only way in.
|
||||
_epitaph_three
|
||||
run "$REPO_ROOT/bin/dejima-epitaph" search "resolv" "$EPI_WS"
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
grep -q '1 of 3' <<< "$output" || { echo "$output"; return 1; }
|
||||
# The index it prints is the position in the same listing `list` shows,
|
||||
# so `show <n>` straight after a search opens what the search found.
|
||||
grep -qE '^ *2 20260203' <<< "$output" || { echo "$output"; return 1; }
|
||||
run "$REPO_ROOT/bin/dejima-epitaph" show 2 "$EPI_WS"
|
||||
grep -q 'the DNS proxy rewrote resolv' <<< "$output" || { echo "$output"; return 1; }
|
||||
rm -rf "$EPI_STORE" "$EPI_TR" "$EPI_WS"
|
||||
}
|
||||
|
||||
@test "search matching nothing says so without failing" {
|
||||
_epitaph_three
|
||||
run "$REPO_ROOT/bin/dejima-epitaph" search "nothing-in-any-of-them" "$EPI_WS"
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
grep -q 'no epitaph matches' <<< "$output" || { echo "$output"; return 1; }
|
||||
rm -rf "$EPI_STORE" "$EPI_TR" "$EPI_WS"
|
||||
}
|
||||
|
||||
@test "show writes to stdout when there is no terminal to open an editor on" {
|
||||
# `dejima-epitaph show | grep` must not try to launch an editor, and a
|
||||
# test is the same case as a pipe.
|
||||
_epitaph_three
|
||||
run env VISUAL=/bin/false EDITOR=/bin/false \
|
||||
"$REPO_ROOT/bin/dejima-epitaph" show 1 "$EPI_WS"
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
grep -q 'the firewall drops IPv6' <<< "$output" || { echo "$output"; return 1; }
|
||||
# Newest by default.
|
||||
run env VISUAL=/bin/false "$REPO_ROOT/bin/dejima-epitaph" show "$EPI_WS"
|
||||
grep -q 'worked out the audit baseline' <<< "$output" || { echo "$output"; return 1; }
|
||||
rm -rf "$EPI_STORE" "$EPI_TR" "$EPI_WS"
|
||||
}
|
||||
|
||||
@test "show opens the editor and leaves the epitaph at 0600" {
|
||||
command -v script >/dev/null 2>&1 || skip "no script(1) to allocate a pty"
|
||||
_epitaph_three
|
||||
local ed; ed="$(mktemp -d)"
|
||||
# Rewrites through a temp file and a rename, which is what an editor
|
||||
# does and what drops the mode to the umask's.
|
||||
printf '#!/bin/bash\nprintf "%%s\\n" "$1" > %s/got\nprintf edited > "$1.t" && mv "$1.t" "$1"\n' \
|
||||
"$ed" > "$ed/ed"
|
||||
chmod +x "$ed/ed"
|
||||
local f; f="$(find "$EPI_STORE" -name '*.md' | sort | head -1)"
|
||||
chmod 600 "$f"
|
||||
run env VISUAL="$ed/ed" EDITOR="$ed/ed" script -qec \
|
||||
"$REPO_ROOT/bin/dejima-epitaph show 1 $EPI_WS" /dev/null
|
||||
[ -f "$ed/got" ] || { echo "the editor was never run: $output"; return 1; }
|
||||
[ "$(cat "$ed/got")" = "$f" ] || { echo "opened $(cat "$ed/got"), wanted $f"; return 1; }
|
||||
[ "$(stat -c %a "$f")" = "600" ] \
|
||||
|| { echo "left at $(stat -c %a "$f") after the editor rewrote it"; return 1; }
|
||||
rm -rf "$EPI_STORE" "$EPI_TR" "$EPI_WS" "$ed"
|
||||
}
|
||||
|
||||
@test "an unknown epitaph subcommand is refused" {
|
||||
_epitaph_fixture
|
||||
run "$REPO_ROOT/bin/dejima-epitaph" delete-everything "$EPI_WS"
|
||||
[ "$status" -eq 2 ] || { echo "$output"; return 1; }
|
||||
grep -q 'usage:' <<< "$output" || { echo "$output"; return 1; }
|
||||
rm -rf "$EPI_STORE" "$EPI_TR" "$EPI_WS"
|
||||
}
|
||||
|
||||
@test "the epitaph store is not mounted into the container" {
|
||||
# The whole point: a session must not be able to read what earlier
|
||||
# sessions concluded, or edit what this one is about to record.
|
||||
@@ -2185,6 +2496,53 @@ STUB
|
||||
rm -rf "$workspace" "$RW_HOME" "$root" "${docker_log:-}"
|
||||
}
|
||||
|
||||
@test "a forge credential never reaches the docker command line" {
|
||||
# /proc/<pid>/cmdline is world-readable, so a secret passed as
|
||||
# `-e NAME=value` is visible to every process on the host via ps - and
|
||||
# from there into whatever captures ps output. That is how #226 was
|
||||
# found: an operator ran ps while debugging something unrelated and
|
||||
# pasted the result.
|
||||
#
|
||||
# `-e NAME` takes the value from the launcher's own environment instead,
|
||||
# where it lives in /proc/<pid>/environ - mode 0400, owner only.
|
||||
#
|
||||
# This repository already made the argument one layer down: gitea-pr
|
||||
# feeds curl its auth header on stdin rather than as an argument, and
|
||||
# says why. The test is here so the two cannot drift apart again.
|
||||
_rw_setup
|
||||
workspace="$(mktemp -d)"
|
||||
local tokfile="$RW_HOME/tok" secret="tok-$RANDOM-do-not-leak"
|
||||
printf '%s\n' "$secret" > "$tokfile"
|
||||
write_config '[core]' "ssh_key = $RW_KEY" 'forge = gitea' 'workflow = local-only' \
|
||||
'[forge.gitea]' 'ssh_host = git.example' 'api = https://git.example/api/v1' \
|
||||
"token_file = $tokfile"
|
||||
STUB_DIR="$(mktemp -d)"
|
||||
local argv_log; argv_log="$(mktemp)"
|
||||
cat > "$STUB_DIR/docker" <<'STUB'
|
||||
#!/bin/bash
|
||||
printf '%s\n' "$*" >> "$SANDBOX_TEST_ARGV_LOG"
|
||||
exit 0
|
||||
STUB
|
||||
chmod +x "$STUB_DIR/docker"
|
||||
HOME="$RW_HOME" PATH="$STUB_DIR:$PATH" SSH_AUTH_SOCK= \
|
||||
SANDBOX_TEST_DOCKER_LOG=/dev/null SANDBOX_TEST_ARGV_LOG="$argv_log" \
|
||||
run "$REPO_ROOT/bin/dejima" "$workspace"
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
|
||||
local argv; argv="$(cat "$argv_log")"
|
||||
[ -n "$argv" ] || { echo "the stub captured no docker invocation"; return 1; }
|
||||
# The whole point.
|
||||
[[ "$argv" != *"$secret"* ]] \
|
||||
|| { echo "the token is in the docker command line"; return 1; }
|
||||
# And it is still passed, by name, or the forge simply has no credential.
|
||||
[[ "$argv" == *"-e GITEA_TOKEN"* ]] \
|
||||
|| { echo "GITEA_TOKEN is not passed at all: $argv"; return 1; }
|
||||
# Specifically the bare form. `-e GITEA_TOKEN=` would also match above.
|
||||
[[ "$argv" != *"-e GITEA_TOKEN="* ]] \
|
||||
|| { echo "passed as NAME=value after all: $argv"; return 1; }
|
||||
rm -rf "$workspace" "$RW_HOME" "$STUB_DIR" "$argv_log"
|
||||
}
|
||||
|
||||
@test "the harness layer creates the harness's own state directories and environment" {
|
||||
# These were in the base image, imposed on every image dejima builds. They
|
||||
# are the selected harness's now, and have to actually reach its layer -
|
||||
@@ -2226,3 +2584,261 @@ STUB
|
||||
|| { echo "the declared environment is missing from the layer:"; echo "$df"; return 1; }
|
||||
rm -rf "$workspace" "$RW_HOME" "$dockerfile_log"
|
||||
}
|
||||
|
||||
# --- dejima-update-check: is this checkout behind the branch it tracks? ---
|
||||
#
|
||||
# A real checkout and a real repository for it to track, neither of them this
|
||||
# one. bin/ and the provider trees are copied rather than symlinked because
|
||||
# the script finds its own repository through readlink -f "$0", which would
|
||||
# follow a symlink straight back to the repository running the tests.
|
||||
#
|
||||
# No `git push` anywhere below: dejima's own forge guard refuses a push to a
|
||||
# path, so a fixture built that way passes on a host and fails inside a
|
||||
# sandbox. The remote is an ordinary repository committed to directly.
|
||||
_upd_commit() {
|
||||
git -C "$1" -c user.email=t@t -c user.name=t commit -q --allow-empty -m "$2"
|
||||
}
|
||||
|
||||
_upd_fixture() {
|
||||
UPD_DIR="$(mktemp -d)"
|
||||
UPD_ORIGIN="$UPD_DIR/origin"
|
||||
UPD_CHECKOUT="$UPD_DIR/checkout"
|
||||
# Stated, not inherited: the cache lands under XDG_STATE_HOME, and a test
|
||||
# that left it unset would write into whoever ran it.
|
||||
export XDG_STATE_HOME="$UPD_DIR/state"
|
||||
# -b trunk so the fixture does not depend on the host's
|
||||
# init.defaultBranch, and so no guard has an opinion about the name.
|
||||
git init -q -b trunk "$UPD_ORIGIN"
|
||||
_upd_commit "$UPD_ORIGIN" first
|
||||
git clone -q "$UPD_ORIGIN" "$UPD_CHECKOUT"
|
||||
cp -r "$REPO_ROOT/bin" "$REPO_ROOT/forges" "$REPO_ROOT/harnesses" \
|
||||
"$REPO_ROOT/workflows" "$REPO_ROOT/tools" "$UPD_CHECKOUT/"
|
||||
printf '[core]\nharness = claude-code\n' > "$CONFIG_DIR/config"
|
||||
}
|
||||
|
||||
_upd_check() { "$UPD_CHECKOUT/bin/dejima-update-check" 2>&1; }
|
||||
|
||||
@test "a checkout level with its remote says nothing" {
|
||||
_upd_fixture
|
||||
run _upd_check
|
||||
[ "$status" -eq 0 ]
|
||||
[ -z "$output" ] || { echo "said: $output"; return 1; }
|
||||
}
|
||||
|
||||
@test "a checkout behind its remote is told, and told how to update" {
|
||||
_upd_fixture
|
||||
_upd_commit "$UPD_ORIGIN" second
|
||||
run _upd_check
|
||||
[ "$status" -eq 0 ]
|
||||
[[ "$output" == *"origin/trunk"* ]] \
|
||||
|| { echo "does not name what it is behind: $output"; return 1; }
|
||||
# The path, because the checkout that is behind is not necessarily the
|
||||
# directory the operator is standing in when they read this.
|
||||
[[ "$output" == *"git -C $UPD_CHECKOUT pull"* ]] \
|
||||
|| { echo "does not say how to update: $output"; return 1; }
|
||||
}
|
||||
|
||||
@test "the commit count is given only when the commits are actually here" {
|
||||
_upd_fixture
|
||||
_upd_commit "$UPD_ORIGIN" second
|
||||
# Nothing fetched, so the tip is a commit this checkout has never seen and
|
||||
# there is no number to give. Counting what it can reach would report the
|
||||
# commits it already has, which is zero, not the one it is missing.
|
||||
run _upd_check
|
||||
[[ "$output" != *" 0 "* ]] || { echo "invented a count: $output"; return 1; }
|
||||
[[ "$output" == *"has commits this checkout does not"* ]] \
|
||||
|| { echo "$output"; return 1; }
|
||||
|
||||
git -C "$UPD_CHECKOUT" fetch -q origin
|
||||
rm -rf "$XDG_STATE_HOME"
|
||||
run _upd_check
|
||||
[[ "$output" == *"has 1 commit this checkout does not"* ]] \
|
||||
|| { echo "no count once the commit is present: $output"; return 1; }
|
||||
}
|
||||
|
||||
@test "a checkout ahead of its remote says nothing" {
|
||||
_upd_fixture
|
||||
_upd_commit "$UPD_CHECKOUT" local-work
|
||||
run _upd_check
|
||||
[ -z "$output" ] || { echo "said: $output"; return 1; }
|
||||
}
|
||||
|
||||
@test "a detached HEAD is silence, not a git error on the terminal" {
|
||||
_upd_fixture
|
||||
_upd_commit "$UPD_ORIGIN" second
|
||||
git -C "$UPD_CHECKOUT" checkout -q --detach HEAD
|
||||
run _upd_check
|
||||
[ "$status" -eq 0 ]
|
||||
[ -z "$output" ] || { echo "said: $output"; return 1; }
|
||||
}
|
||||
|
||||
@test "[core] update_check off reaches the remote not at all" {
|
||||
_upd_fixture
|
||||
_upd_commit "$UPD_ORIGIN" second
|
||||
printf '[core]\nharness = claude-code\nupdate_check = off\n' > "$CONFIG_DIR/config"
|
||||
run _upd_check
|
||||
[ -z "$output" ] || { echo "said: $output"; return 1; }
|
||||
# Silence alone would also be produced by asking and saying nothing. The
|
||||
# cache is written on every lookup, including a failed one, so its absence
|
||||
# is what shows no lookup happened.
|
||||
[ ! -e "$XDG_STATE_HOME/dejima/update-check" ] \
|
||||
|| { echo "it asked anyway"; return 1; }
|
||||
}
|
||||
|
||||
@test "the remote is asked once, and the cached answer is compared to HEAD" {
|
||||
_upd_fixture
|
||||
_upd_commit "$UPD_ORIGIN" second
|
||||
run _upd_check
|
||||
[[ "$output" == *"commits this checkout does not"* ]] || { echo "$output"; return 1; }
|
||||
|
||||
# Unreachable now. A second run inside the interval still reports, which
|
||||
# is what makes this a throttle on the network call rather than on the
|
||||
# notice - told once and then silence would be worse than never telling.
|
||||
mv "$UPD_ORIGIN" "$UPD_ORIGIN.gone"
|
||||
run _upd_check
|
||||
[[ "$output" == *"commits this checkout does not"* ]] \
|
||||
|| { echo "the notice lasted one launch: $output"; return 1; }
|
||||
|
||||
# And it stops the moment HEAD catches up, from the same cached answer,
|
||||
# without waiting for the interval to expire.
|
||||
mv "$UPD_ORIGIN.gone" "$UPD_ORIGIN"
|
||||
git -C "$UPD_CHECKOUT" fetch -q origin
|
||||
git -C "$UPD_CHECKOUT" reset -q --hard origin/trunk
|
||||
run _upd_check
|
||||
[ -z "$output" ] || { echo "still complaining after updating: $output"; return 1; }
|
||||
}
|
||||
|
||||
@test "the remote is not reached through the checkout's own git config" {
|
||||
# The whole reason this tool talks to a URL from outside the repository.
|
||||
# dejima mounts its own checkout writable when that is the workspace, so
|
||||
# .git/config there is session-writable - and core.sshCommand names a
|
||||
# command git runs on the host. Reaching the remote by name would turn a
|
||||
# session's config write into host execution on the next launch, with no
|
||||
# operator action at all.
|
||||
_upd_fixture
|
||||
# No port in the URL: git refuses to pass one to an sshCommand it classes
|
||||
# as "simple", which would fail the control for a reason unrelated to what
|
||||
# it tests. .invalid never resolves, so the mitigated path fails at once
|
||||
# instead of reaching for an sshd that may exist on whoever runs this.
|
||||
git -C "$UPD_CHECKOUT" remote set-url origin ssh://git@example.invalid/x.git
|
||||
# A file rather than a message: the tool sends git's stderr to /dev/null,
|
||||
# so an assertion on what it printed would hold whether the command ran or
|
||||
# not. Execution has to be observed by its effect.
|
||||
local ran="$UPD_DIR/repo-config-ran"
|
||||
git -C "$UPD_CHECKOUT" config core.sshCommand \
|
||||
"sh -c 'touch $ran; exit 1' --"
|
||||
git -C "$UPD_CHECKOUT" config credential.helper "!sh -c 'touch $ran'"
|
||||
|
||||
run _upd_check
|
||||
[ ! -e "$ran" ] || { echo "the checkout's own config ran"; return 1; }
|
||||
|
||||
# The control, so this cannot pass because the threat quietly went away.
|
||||
# If a future git stops honouring a repository's core.sshCommand here,
|
||||
# that is worth knowing rather than reading as a mitigation working.
|
||||
run timeout 20 git -C "$UPD_CHECKOUT" ls-remote origin
|
||||
[ -e "$ran" ] \
|
||||
|| { echo "reaching it by name no longer runs repo config: $output"; return 1; }
|
||||
}
|
||||
|
||||
@test "a remote URL that could name a command is refused, not run" {
|
||||
_upd_fixture
|
||||
local marker="$UPD_DIR/pwned" url
|
||||
for url in "ext::sh -c \"touch $UPD_DIR/pwned\"" \
|
||||
"--upload-pack=touch $UPD_DIR/pwned" \
|
||||
"http://example.invalid/x.git"; do
|
||||
# Written into the file directly: `git remote set-url` rejects a value
|
||||
# starting with a dash itself, which would leave that case untested.
|
||||
sed -i "s#\turl = .*#\turl = $url#" "$UPD_CHECKOUT/.git/config"
|
||||
rm -rf "$XDG_STATE_HOME"
|
||||
run _upd_check
|
||||
[ "$status" -eq 0 ] || { echo "$url exited $status"; return 1; }
|
||||
[ ! -e "$marker" ] || { echo "$url ran"; return 1; }
|
||||
# Nothing recorded either, so a refused URL does not also poison the
|
||||
# cache for the hour after someone fixes it.
|
||||
[ ! -e "$XDG_STATE_HOME/dejima/update-check" ] \
|
||||
|| { echo "$url was attempted"; return 1; }
|
||||
done
|
||||
}
|
||||
|
||||
@test "a branch is compared against what it tracks, not against its own name" {
|
||||
# `git worktree add -b x origin/development` leaves a branch called x
|
||||
# tracking refs/heads/development. Asking the remote for refs/heads/x gets
|
||||
# an empty answer, and an empty answer is indistinguishable from being up
|
||||
# to date - so the whole check goes quiet on exactly the branches someone
|
||||
# developing dejima is standing on.
|
||||
_upd_fixture
|
||||
git -C "$UPD_CHECKOUT" checkout -q -b feature --track origin/trunk
|
||||
_upd_commit "$UPD_ORIGIN" second
|
||||
run _upd_check
|
||||
[[ "$output" == *"origin/trunk"* ]] \
|
||||
|| { echo "compared against the wrong ref: $output"; return 1; }
|
||||
}
|
||||
|
||||
# --- what a session wrote, on its way to the operator's terminal ---
|
||||
#
|
||||
# Reading an epitaph is the tool's stated purpose, and every byte of one came
|
||||
# from a session transcript. Same class as the audit findings, which is why
|
||||
# both go through the same sanitize()/sanitize_body() in dejima-color-lib.sh.
|
||||
# Colour is off in these: bats captures the output, so nothing is a terminal
|
||||
# and every escape byte left is one the fixture planted.
|
||||
_epitaph_hostile() {
|
||||
_epitaph_fixture
|
||||
# \u001b through the JSON, which is how it would actually arrive: the
|
||||
# extractor decodes it, so the store holds a real ESC byte.
|
||||
local f="$EPI_TR/$EPI_SLUG/s1.jsonl"
|
||||
{
|
||||
printf '{"type":"system","subtype":"compact_boundary","compactMetadata":{"trigger":"\\u001b[31mmanual","preTokens":900,"postTokens":90}}\n'
|
||||
printf '{"type":"user","isCompactSummary":true,"uuid":"aaaabbbb","sessionId":"s1","timestamp":"2026-01-02T03:04:05.000Z","message":{"content":"first line\\u001b[2Jcleared\\nsecond\\u0007 line"}}\n'
|
||||
} > "$f"
|
||||
"$REPO_ROOT/bin/dejima-epitaph" save "$EPI_WS" >/dev/null 2>&1
|
||||
}
|
||||
|
||||
@test "showing an epitaph strips the escapes a session put in it" {
|
||||
_epitaph_hostile
|
||||
run "$REPO_ROOT/bin/dejima-epitaph" show 1 "$EPI_WS"
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
[[ "$output" != *$'\033'* ]] || { echo "an escape reached the terminal"; return 1; }
|
||||
[[ "$output" != *$'\007'* ]] || { echo "a BEL reached the terminal"; return 1; }
|
||||
# The text either side of the escape survives - this strips control bytes,
|
||||
# it does not drop the content they were hidden in.
|
||||
[[ "$output" == *"first line"* ]] && [[ "$output" == *"cleared"* ]] \
|
||||
|| { echo "$output"; return 1; }
|
||||
# And it is still a body: the field rule would have taken the newlines
|
||||
# with the rest of C0 and folded the whole epitaph onto one line.
|
||||
[ "${#lines[@]}" -gt 1 ] || { echo "the body was folded to one line"; return 1; }
|
||||
rm -rf "$EPI_STORE" "$EPI_TR" "$EPI_WS"
|
||||
}
|
||||
|
||||
@test "searching epitaphs strips the escapes out of what it prints" {
|
||||
_epitaph_hostile
|
||||
run "$REPO_ROOT/bin/dejima-epitaph" search 'line' "$EPI_WS"
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
[[ "$output" != *$'\033'* ]] || { echo "an escape reached the terminal"; return 1; }
|
||||
[[ "$output" == *"first line"* ]] || { echo "the hit is gone entirely: $output"; return 1; }
|
||||
rm -rf "$EPI_STORE" "$EPI_TR" "$EPI_WS"
|
||||
}
|
||||
|
||||
@test "listing epitaphs strips the escapes out of the header fields" {
|
||||
# trigger comes off the transcript, and the filename is built from its
|
||||
# timestamp and uuid - so the row is session-authored on both sides.
|
||||
_epitaph_hostile
|
||||
run "$REPO_ROOT/bin/dejima-epitaph" list "$EPI_WS"
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
[[ "$output" != *$'\033'* ]] || { echo "an escape reached the terminal"; return 1; }
|
||||
rm -rf "$EPI_STORE" "$EPI_TR" "$EPI_WS"
|
||||
}
|
||||
|
||||
@test "the update notice strips the escapes out of a remote's name" {
|
||||
# Both the remote name and the branch it tracks are read from the
|
||||
# checkout's .git/config, which is session-writable when dejima's own
|
||||
# checkout is the workspace.
|
||||
_upd_fixture
|
||||
_upd_commit "$UPD_ORIGIN" second
|
||||
git -C "$UPD_CHECKOUT" config "branch.trunk.remote" "$(printf 'ori\033[2Jgin')"
|
||||
git -C "$UPD_CHECKOUT" config "remote.$(printf 'ori\033[2Jgin').url" "$UPD_ORIGIN"
|
||||
git -C "$UPD_CHECKOUT" config "remote.$(printf 'ori\033[2Jgin').fetch" '+refs/heads/*:refs/remotes/o/*'
|
||||
run _upd_check
|
||||
[[ "$output" == *"commits this checkout does not"* ]] \
|
||||
|| { echo "no notice at all: $output"; return 1; }
|
||||
[[ "$output" != *$'\033'* ]] || { echo "an escape reached the terminal: $output"; return 1; }
|
||||
}
|
||||
|
||||
Vendored
+81
-5
@@ -36,12 +36,51 @@ CONTAINER = os.path.join(WORK, "container.py")
|
||||
# "Onward" is a file, which is what lets a test see whether a keystroke reached
|
||||
# the container or was turned into a signal before it could.
|
||||
open(CONTAINER, "w").write('''#!/usr/bin/env python3
|
||||
import os, signal, sys, termios, tty
|
||||
import fcntl, os, signal, struct, sys, termios, tty
|
||||
fd = 0
|
||||
saved = termios.tcgetattr(fd)
|
||||
signal.signal(signal.SIGWINCH,
|
||||
lambda *a: (sys.stdout.write("CONTAINER-REDRAW\\r\\n"), sys.stdout.flush()))
|
||||
|
||||
def _size():
|
||||
return struct.unpack("HHHH", fcntl.ioctl(fd, termios.TIOCGWINSZ, b"\\0" * 8))[:2]
|
||||
|
||||
# Redraws only when the dimensions ACTUALLY moved, which is what both shipped
|
||||
# harnesses do. Measured on a pty, bytes written in a fixed window after each
|
||||
# kind of poke:
|
||||
#
|
||||
# idle same-size SIGWINCH size changed and back
|
||||
# Claude Code 0 0 3337
|
||||
# Cline 0 0 17810
|
||||
# nvim (control) 0 3356 6724
|
||||
#
|
||||
# The first version of this stand-in redrew on the bare signal, like nvim. That
|
||||
# is the one behaviour the programs dejima actually runs do not have, so the
|
||||
# suite could not see that the resume poke was a no-op for both of them.
|
||||
_last = [_size()]
|
||||
|
||||
def _on_winch(*a):
|
||||
now = _size()
|
||||
if now == _last[0]:
|
||||
return
|
||||
_last[0] = now
|
||||
sys.stdout.write("CONTAINER-REDRAW\\r\\n")
|
||||
sys.stdout.flush()
|
||||
|
||||
signal.signal(signal.SIGWINCH, _on_winch)
|
||||
# The finding of #179, as something a test can observe: the client survives
|
||||
# SIGSTOP and does not survive SIGTSTP, so the launcher has to start it with
|
||||
# SIGTSTP already ignored. Read back rather than caught - installing a handler
|
||||
# would REPLACE the inherited SIG_IGN and defeat the very thing being checked,
|
||||
# which is what the first version of this did.
|
||||
_ign = 0
|
||||
for _line in open("/proc/self/status"):
|
||||
if _line.startswith("SigIgn"):
|
||||
_ign = int(_line.split()[1], 16)
|
||||
if _ign & (1 << (signal.SIGTSTP - 1)):
|
||||
sys.stdout.write("CONTAINER-TSTP-IGNORED\\r\\n")
|
||||
sys.stdout.flush()
|
||||
tty.setraw(fd)
|
||||
# What a full-screen harness does on startup, and does not undo on a suspend.
|
||||
sys.stdout.write("\\033[?25l")
|
||||
sys.stdout.write("CONTAINER-ATTACHED\\r\\n"); sys.stdout.flush()
|
||||
open(%r, "wb").close()
|
||||
try:
|
||||
@@ -73,11 +112,32 @@ finally:
|
||||
# trusted to see the fix either.
|
||||
start_helper = "" if os.environ.get("TTY_SUSPEND_NO_HELPER") else \
|
||||
'"%s" &\nhelper=$!' % HELPER
|
||||
# bin/dejima's shape: the client inherits SIGTSTP ignored and is started with
|
||||
# the terminal, and the keystroke is converted into an explicit SIGSTOP for it
|
||||
# before the launcher stops itself. Without the conversion the client is the
|
||||
# one thing that must not be stopped by a catchable signal.
|
||||
open(LAUNCHER, "w").write('''#!/bin/bash
|
||||
sleep 300 &
|
||||
sleep 300 &
|
||||
%s
|
||||
python3 %s
|
||||
trap '' TSTP
|
||||
python3 %s < /dev/tty &
|
||||
client=$!
|
||||
trap - TSTP
|
||||
on_tstp() {
|
||||
kill -STOP "$client" 2>/dev/null || true
|
||||
printf '\\033[?25h' > /dev/tty 2>/dev/null || true
|
||||
trap - TSTP
|
||||
kill -TSTP $$
|
||||
trap on_tstp TSTP
|
||||
kill -CONT "$client" 2>/dev/null || true
|
||||
}
|
||||
trap on_tstp TSTP
|
||||
while kill -0 "$client" 2>/dev/null; do
|
||||
wait "$client" && break
|
||||
case "$?" in 146|148) continue ;; esac
|
||||
break
|
||||
done
|
||||
kill "${helper:-0}" 2>/dev/null || true
|
||||
echo LAUNCHER-DONE
|
||||
''' % (start_helper, CONTAINER))
|
||||
@@ -106,6 +166,7 @@ os.close(slave)
|
||||
|
||||
seen = []
|
||||
failures = []
|
||||
transcript_all = ""
|
||||
|
||||
|
||||
def pump(seconds):
|
||||
@@ -119,7 +180,10 @@ def pump(seconds):
|
||||
return
|
||||
if not chunk:
|
||||
return
|
||||
seen.append(chunk.decode("utf-8", "replace"))
|
||||
text = chunk.decode("utf-8", "replace")
|
||||
seen.append(text)
|
||||
global transcript_all
|
||||
transcript_all += text
|
||||
|
||||
|
||||
def expect(text, timeout=8.0):
|
||||
@@ -197,6 +261,18 @@ try:
|
||||
pump(0.8)
|
||||
check("ctrl-c-still-reaches-the-session", received().endswith(b"\x03"),
|
||||
repr(received()[-4:]))
|
||||
|
||||
# The finding, asserted: the client is stopped by SIGSTOP, which it cannot
|
||||
# observe, and never by SIGTSTP, which it cannot survive.
|
||||
# A suspended session must not leave the prompt with an invisible cursor:
|
||||
# the harness hid it and a suspend is not an exit, so somebody has to.
|
||||
check("the-cursor-is-shown-again-when-suspended",
|
||||
"\033[?25h" in transcript_all,
|
||||
"the prompt inherits a hidden cursor, like a dead ssh session")
|
||||
|
||||
check("the-client-was-started-with-sigtstp-ignored",
|
||||
"CONTAINER-TSTP-IGNORED" in transcript_all,
|
||||
"it would be stopped by the one signal it cannot survive")
|
||||
finally:
|
||||
try:
|
||||
os.killpg(os.getpgid(pid), 9)
|
||||
|
||||
+181
-6
@@ -112,6 +112,35 @@ dockerfile_for() {
|
||||
"$LAUNCH_DIR/dockerfile-log" 2>/dev/null
|
||||
}
|
||||
|
||||
@test "valid_domain refuses the hostname shapes a resolver would read differently" {
|
||||
# The matcher is a trust boundary: what it accepts becomes a dnsmasq
|
||||
# `server=` line and an ipset entry. The published bypass in this space
|
||||
# came from an egress control accepting a string its resolver then read as
|
||||
# a different host, so the shapes below are the ones worth asserting on
|
||||
# rather than only "does it reject evil.com".
|
||||
#
|
||||
# Run against this matcher during the 2026-08 prior-art sweep: every case
|
||||
# here was already refused except the empty label, which was not.
|
||||
local bad
|
||||
for bad in 'a..b.com' 'github.com.' '.github.com' '-bad.com' 'bad-.com' \
|
||||
'a.-b.com' 'evil.com%00.github.com' 'a_b.com' '' \
|
||||
'evil.com
|
||||
github.com'; do
|
||||
run bash -c 'source "$1"; valid_domain "$2"' _ "$LIB" "$bad"
|
||||
[ "$status" -ne 0 ] || { echo "accepted: $(printf %q "$bad")"; return 1; }
|
||||
done
|
||||
|
||||
# And the shapes that must keep working, including the ones the tightening
|
||||
# could plausibly have broken: an IDNA label starts with a letter and
|
||||
# contains hyphens, and a single label with no dot is a real internal name.
|
||||
local good
|
||||
for good in 'crates.io' 'static.crates.io' 'xn--e1afmkfd.com' 'GitHub.com' \
|
||||
'localhost' 'a' 'llm-backend.example.com'; do
|
||||
run bash -c 'source "$1"; valid_domain "$2"' _ "$LIB" "$good"
|
||||
[ "$status" -eq 0 ] || { echo "refused: $good"; return 1; }
|
||||
done
|
||||
}
|
||||
|
||||
@test "valid_domain accepts real domains and rejects shell-active input" {
|
||||
run bash -c 'source "$1"; valid_domain "crates.io"' _ "$LIB"
|
||||
[ "$status" -eq 0 ]
|
||||
@@ -506,6 +535,85 @@ EOF
|
||||
[ ! -f "$CONFIG_DIR/dependencies" ]
|
||||
}
|
||||
|
||||
# Two running sandboxes, each with a working directory, plus a dejima-attach
|
||||
# that lists them in the order its picker numbers them.
|
||||
stub_two_containers() {
|
||||
STUB_DIR="$(mktemp -d)"
|
||||
cat > "$STUB_DIR/docker" <<'EOF'
|
||||
#!/bin/bash
|
||||
if [ "$1" = ps ]; then
|
||||
printf 'dejima-run-aaaa\taaaaaaaaaaaa\n'
|
||||
printf 'dejima-run-bbbb\tbbbbbbbbbbbb\n'
|
||||
exit 0
|
||||
fi
|
||||
if [ "$1" = inspect ]; then
|
||||
case "$*" in
|
||||
*aaaaaaaaaaaa*) echo /home/someone/workspace/alpha ;;
|
||||
*bbbbbbbbbbbb*) echo /home/someone/workspace/beta ;;
|
||||
esac
|
||||
exit 0
|
||||
fi
|
||||
exit 0
|
||||
EOF
|
||||
chmod +x "$STUB_DIR/docker"
|
||||
cat > "$STUB_DIR/dejima-attach" <<'EOF'
|
||||
#!/bin/bash
|
||||
[ "$1" = --list ] || exit 1
|
||||
printf 'run1\tlabel-b\tbeta\t3m\tattachable\tbbbbbbbbbbbb\n'
|
||||
printf 'run2\tlabel-a\talpha\t9m\tattachable\taaaaaaaaaaaa\n'
|
||||
EOF
|
||||
chmod +x "$STUB_DIR/dejima-attach"
|
||||
PATH="$STUB_DIR:$PATH"
|
||||
}
|
||||
|
||||
@test "several running sandboxes are listed by project, not by run id alone" {
|
||||
# The name is a run id, which is exactly what someone with three sessions
|
||||
# open does not know. What they do know is which project each is working
|
||||
# on. Taken from the container's own working directory, so it is there
|
||||
# whether or not remote access is on.
|
||||
stub_two_containers
|
||||
run "$REPO_ROOT/bin/dejima-allow" crates.io
|
||||
[ "$status" -ne 0 ]
|
||||
[[ "$output" == *"Multiple running dejima containers"* ]] || { echo "$output"; return 1; }
|
||||
grep -qE 'dejima-run-aaaa +alpha' <<< "$output" || { echo "$output"; return 1; }
|
||||
grep -qE 'dejima-run-bbbb +beta' <<< "$output" || { echo "$output"; return 1; }
|
||||
rm -rf "$STUB_DIR"
|
||||
}
|
||||
|
||||
@test "the listing carries the number the dejima-attach picker gives each one" {
|
||||
# The picker numbers its rows 1..N in the order --list prints them, so a
|
||||
# position there is the number an operator would type. Deliberately not
|
||||
# this tool's own ordering: two lists that number the same sessions
|
||||
# differently is worse than one list without numbers.
|
||||
stub_two_containers
|
||||
run "$REPO_ROOT/bin/dejima-allow" crates.io
|
||||
# beta is first in the attach listing, so beta is 1 - not alpha, which
|
||||
# docker happens to report first.
|
||||
grep -qE 'beta .*\(dejima-attach 1\)' <<< "$output" || { echo "$output"; return 1; }
|
||||
grep -qE 'alpha .*\(dejima-attach 2\)' <<< "$output" || { echo "$output"; return 1; }
|
||||
rm -rf "$STUB_DIR"
|
||||
}
|
||||
|
||||
@test "the listing drops the picker number rather than failing without one" {
|
||||
# dejima-attach refuses outright when remote access is off. That is a
|
||||
# column missing, not an error: the project name is the part that makes
|
||||
# this usable and it does not depend on the feature.
|
||||
stub_two_containers
|
||||
cat > "$STUB_DIR/dejima-attach" <<'EOF'
|
||||
#!/bin/bash
|
||||
echo "Remote access is not configured." >&2
|
||||
exit 1
|
||||
EOF
|
||||
chmod +x "$STUB_DIR/dejima-attach"
|
||||
run "$REPO_ROOT/bin/dejima-allow" crates.io
|
||||
[ "$status" -ne 0 ]
|
||||
grep -qE 'dejima-run-aaaa +alpha' <<< "$output" || { echo "$output"; return 1; }
|
||||
[[ "$output" != *"dejima-attach 1"* ]] || { echo "invented a number: $output"; return 1; }
|
||||
[[ "$output" != *"Remote access is not configured"* ]] \
|
||||
|| { echo "leaked the attach refusal: $output"; return 1; }
|
||||
rm -rf "$STUB_DIR"
|
||||
}
|
||||
|
||||
@test "dejima-allow --project persists without needing a container" {
|
||||
run "$REPO_ROOT/bin/dejima-allow" --project "$PROJ" crates.io
|
||||
[ "$status" -eq 0 ]
|
||||
@@ -1677,22 +1785,67 @@ EOF
|
||||
# The assertion is one-sided on purpose: the victim must never be written. The
|
||||
# refusal count is only there to prove the swap window was real, so a run where
|
||||
# the swapper never landed cannot pass vacuously.
|
||||
#
|
||||
# Each half restores state before swapping again, and that is what keeps the
|
||||
# window open rather than tidiness. declare_entry calls os.makedirs the moment
|
||||
# the directory is missing, so the writer puts a real directory back at the
|
||||
# path while the symlink is meant to be there. A swapper that only tried
|
||||
# unlink() then hit "Is a directory", left `held` stranded, and every later
|
||||
# rename failed with "Directory not empty" - it went through the motions for
|
||||
# the rest of the run without ever planting another symlink. The window closed
|
||||
# in the first few milliseconds, the refusal count stopped rising, and a run
|
||||
# where it closed before the writer's first attempt scored zero and failed a
|
||||
# test whose guarantee had held perfectly. Discarding what the writer put there
|
||||
# is also what a hostile session does: it owns that directory.
|
||||
swap_loop() {
|
||||
python3 - "$1" "$2" <<'PY' &
|
||||
import os, sys, time
|
||||
SWAP_HEALTH="$(mktemp)"
|
||||
python3 - "$1" "$2" "$SWAP_HEALTH" <<'PY' &
|
||||
import errno, os, shutil, stat, sys, time
|
||||
|
||||
path, target = sys.argv[1], sys.argv[2]
|
||||
path, target, health_at = sys.argv[1], sys.argv[2], sys.argv[3]
|
||||
held = path + ".held"
|
||||
|
||||
def clear(p):
|
||||
# Whatever is at the path, gone - a symlink this loop planted, or the
|
||||
# directory the writer recreated underneath it.
|
||||
try:
|
||||
if stat.S_ISDIR(os.lstat(p).st_mode):
|
||||
shutil.rmtree(p)
|
||||
else:
|
||||
os.unlink(p)
|
||||
except OSError as e:
|
||||
if e.errno != errno.ENOENT:
|
||||
raise
|
||||
|
||||
# The longest run of cycles that planted nothing, which is what the test
|
||||
# asserts on. A count of successful plants does not separate the two cases:
|
||||
# the wedge took about a second to happen, so a broken swapper still plants
|
||||
# a hundred times and then never again. Losing a single cycle to the writer
|
||||
# recreating the directory at the wrong moment is normal and self-correcting;
|
||||
# never recovering is the bug.
|
||||
plants = streak = worst = 0
|
||||
end = time.time() + 60
|
||||
while time.time() < end:
|
||||
try:
|
||||
os.rename(path, held)
|
||||
if not os.path.lexists(held):
|
||||
os.rename(path, held)
|
||||
clear(path)
|
||||
os.symlink(target, path)
|
||||
plants += 1
|
||||
streak = 0
|
||||
except OSError:
|
||||
pass
|
||||
streak += 1
|
||||
worst = max(worst, streak)
|
||||
# Written as it goes: this process is killed, not allowed to finish.
|
||||
# Through a rename, because the reader is a shell that may look at any
|
||||
# moment - truncate-then-write hands it an empty file often enough to
|
||||
# matter, which reads as "the swapper never planted anything".
|
||||
with open(health_at + ".tmp", "w") as fh:
|
||||
fh.write("%d %d\n" % (plants, worst))
|
||||
os.replace(health_at + ".tmp", health_at)
|
||||
time.sleep(0.004)
|
||||
try:
|
||||
os.unlink(path)
|
||||
clear(path)
|
||||
os.rename(held, path)
|
||||
except OSError:
|
||||
pass
|
||||
@@ -1701,6 +1854,20 @@ PY
|
||||
SWAPPER=$!
|
||||
}
|
||||
|
||||
# Plants, and the longest run of cycles that planted nothing.
|
||||
assert_swap_window_stayed_open() {
|
||||
local plants=0 worst=0
|
||||
# || true and the defaults: the file does not exist until the swapper's
|
||||
# first cycle, and an empty read there is "nothing yet", not a value.
|
||||
read -r plants worst < "$SWAP_HEALTH" || true
|
||||
plants="${plants:-0}"; worst="${worst:-0}"
|
||||
rm -f "$SWAP_HEALTH"
|
||||
[ "$plants" -gt 20 ] \
|
||||
|| { echo "the swapper planted only $plants time(s)"; return 1; }
|
||||
[ "$worst" -lt 10 ] \
|
||||
|| { echo "the swapper stalled for $worst consecutive cycles"; return 1; }
|
||||
}
|
||||
|
||||
declare_repeatedly() {
|
||||
bash -c '
|
||||
source "$1"
|
||||
@@ -1723,6 +1890,10 @@ declare_repeatedly() {
|
||||
kill "$SWAPPER" 2>/dev/null || true
|
||||
[ "$(cat "$victim")" = "original" ]
|
||||
[ "$refused" -gt 0 ]
|
||||
# The window stayed open for the whole run rather than closing after the
|
||||
# first collision - the failure that made this test flaky while the guard
|
||||
# it covers was working.
|
||||
assert_swap_window_stayed_open
|
||||
rm -rf "$(dirname "$victim")"
|
||||
}
|
||||
|
||||
@@ -1738,6 +1909,10 @@ declare_repeatedly() {
|
||||
kill "$SWAPPER" 2>/dev/null || true
|
||||
[ "$(cat "$elsewhere/allowed-domains")" = "original" ]
|
||||
[ "$refused" -gt 0 ]
|
||||
# The window stayed open for the whole run rather than closing after the
|
||||
# first collision - the failure that made this test flaky while the guard
|
||||
# it covers was working.
|
||||
assert_swap_window_stayed_open
|
||||
rm -rf "$elsewhere"
|
||||
}
|
||||
|
||||
|
||||
+267
-3
@@ -5,6 +5,7 @@
|
||||
setup() {
|
||||
REPO_ROOT="$BATS_TEST_DIRNAME/.."
|
||||
LIB="$REPO_ROOT/bin/dejima-provider-lib.sh"
|
||||
LIB_PROJECT="$REPO_ROOT/bin/dejima-project-lib.sh"
|
||||
CONFIG_DIR="$(mktemp -d)"
|
||||
export DEJIMA_CONFIG_DIR="$CONFIG_DIR"
|
||||
}
|
||||
@@ -622,7 +623,7 @@ assert_remedy_forges_exist() {
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
[ "$(lib manifest_get workflow branch-push push)" = "on" ]
|
||||
[ "$(lib manifest_get workflow branch-push blocked_branches)" = "main master" ]
|
||||
[ "$(lib manifest_get workflow branch-push block_merge)" = "off" ]
|
||||
[ "$(lib manifest_get workflow branch-push block_merge)" = "on" ]
|
||||
[ "$(lib manifest_get workflow branch-push requires_worktree)" = "on" ]
|
||||
[ "$(lib manifest_get workflow branch-push autonomy)" = "push-branch" ]
|
||||
# Requires no capability, so it is usable against a forge that offers
|
||||
@@ -770,11 +771,51 @@ assert_remedy_forges_exist() {
|
||||
grep -q 'export DEJIMA_GITHUB_PUSH' "$REPO_ROOT/bin/dejima"
|
||||
}
|
||||
|
||||
@test "no shipped workflow tells the agent not to merge without blocking it" {
|
||||
# Every shipped briefing says some version of "do not merge". Two of them
|
||||
# said it with block_merge off, which made the sentence an assertion
|
||||
# nothing held: the forge's CLI is installed by the FORGE, so `<pr> merge`
|
||||
# is on PATH whenever a forge is selected, whatever the workflow tells the
|
||||
# agent to do. The manifest that was off carried a reason - "nothing here
|
||||
# ever reaches a forge's PR interface" - and the reason was false.
|
||||
#
|
||||
# Asserted as an invariant over every workflow rather than as three pinned
|
||||
# values, because a fourth workflow gets this wrong the same way. A
|
||||
# workflow that genuinely means to permit merging has to say so in its
|
||||
# briefing and change this test on purpose.
|
||||
local wf name
|
||||
for wf in "$REPO_ROOT"/workflows/*/; do
|
||||
[ -d "$wf" ] || continue
|
||||
name="$(basename "$wf")"
|
||||
[ "$(lib manifest_get workflow "$name" block_merge)" = "on" ] \
|
||||
|| { echo "$name leaves merging unguarded"; return 1; }
|
||||
grep -qi 'merg' "$wf/briefing.md" \
|
||||
|| { echo "$name's briefing says nothing about merging"; return 1; }
|
||||
done
|
||||
}
|
||||
|
||||
@test "a workflow blocking merges reaches the guard with the forge's command" {
|
||||
# block_merge is only half of it: what actually refuses the command is
|
||||
# DEJIMA_MERGE_BLOCK, resolved from the FORGE's merge_block and passed to
|
||||
# docker/forge-guard.sh. A workflow with the flag on and a forge that
|
||||
# names no command blocks nothing, which is correct - there is nothing to
|
||||
# block - but the pairing is what has to hold.
|
||||
local wf
|
||||
for wf in branch-push local-only worktree-pr; do
|
||||
[ "$(lib manifest_get workflow "$wf" block_merge)" = "on" ] || continue
|
||||
[ -n "$(lib manifest_get forge gitea merge_block)" ] \
|
||||
|| { echo "gitea names no merge command for $wf to block"; return 1; }
|
||||
done
|
||||
grep -q 'DEJIMA_MERGE_BLOCK="$(manifest_get forge "$DEJIMA_FORGE_NAME" merge_block)"' \
|
||||
"$REPO_ROOT/bin/dejima" \
|
||||
|| { echo "the launcher no longer resolves the forge's merge command"; return 1; }
|
||||
}
|
||||
|
||||
@test "local-only pushes nothing and blocks no branches" {
|
||||
run lib manifest_validate workflow local-only
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
[ "$(lib manifest_get workflow local-only push)" = "off" ]
|
||||
[ "$(lib manifest_get workflow local-only block_merge)" = "off" ]
|
||||
[ "$(lib manifest_get workflow local-only block_merge)" = "on" ]
|
||||
[ "$(lib manifest_get workflow local-only requires_worktree)" = "off" ]
|
||||
[ "$(lib manifest_get workflow local-only autonomy)" = "commit" ]
|
||||
# blocked_branches is empty BECAUSE push is off - there is no push to
|
||||
@@ -789,6 +830,144 @@ assert_remedy_forges_exist() {
|
||||
[ -z "$output" ]
|
||||
}
|
||||
|
||||
# --- optional tools ----------------------------------------------------------
|
||||
|
||||
@test "every shipped tool is pinned by digest, not fetched from a moving ref" {
|
||||
# The bar docs/tools.md sets, asserted rather than described. A tool that
|
||||
# installs from whatever a branch points at today is one nothing has
|
||||
# reviewed, and it would build differently on different days with no
|
||||
# change to this repository.
|
||||
local tool spec
|
||||
for tool in $(lib provider_list tool); do
|
||||
run lib manifest_validate tool "$tool"
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
spec="$(lib manifest_get tool "$tool" install)"
|
||||
[[ "$spec" == tarball:* ]] \
|
||||
|| { echo "$tool does not install from a pinned artifact: $spec"; return 1; }
|
||||
# valid_tarball_spec already requires a 64-hex digest and an https
|
||||
# URL; this is the part it cannot check - that the URL names a
|
||||
# version rather than a branch.
|
||||
[[ "$spec" != *"/refs/heads/"* && "$spec" != *"/master/"* && "$spec" != *"/main/"* ]] \
|
||||
|| { echo "$tool installs from a moving ref: $spec"; return 1; }
|
||||
done
|
||||
}
|
||||
|
||||
@test "a tool cannot declare anything that changes what dejima permits" {
|
||||
# The manifest has no key for a hook, a mount, a domain or a guard. A tool
|
||||
# that needed one would be a change to the boundary rather than a program
|
||||
# on PATH, and adding the key is the moment to argue about it - not the
|
||||
# moment a manifest quietly starts carrying one.
|
||||
local key
|
||||
for key in guards hooks mounts api_domains fixed_hosts install_hook \
|
||||
briefing no_confirm_args settings_args; do
|
||||
run lib manifest_get tool rtk "$key"
|
||||
[ "$status" -ne 0 ] \
|
||||
|| { echo "the tool schema accepts '$key', which it must not"; return 1; }
|
||||
done
|
||||
}
|
||||
|
||||
@test "rtk declares the archive shape its release actually has" {
|
||||
# Inspected: `tar tzf rtk-x86_64-unknown-linux-musl.tar.gz` lists one
|
||||
# entry, `rtk`, with no enclosing directory. Declared `prefix`, the layer
|
||||
# would strip that single component, extract nothing, and build cleanly -
|
||||
# a tool the session is told it has and does not.
|
||||
#
|
||||
# Pinned here because the emitter test below exercises both shapes with an
|
||||
# explicit setting and so cannot notice this manifest changing.
|
||||
[ "$(lib manifest_get tool rtk install_layout)" = "binary" ] \
|
||||
|| { echo "rtk's release is a bare binary and the manifest no longer says so"; return 1; }
|
||||
}
|
||||
|
||||
@test "a tool may only set environment variables that are its own" {
|
||||
# image_env becomes a Dockerfile ENV, which every process in the container
|
||||
# inherits - not just the tool that declared it. rtk shipped with
|
||||
# NO_COLOR=1, reasoning that its output lands in a model's context where an
|
||||
# escape sequence is noise. The reasoning was fine and the scope was wrong:
|
||||
# a launch with the tool enabled lost colour in the harness, in git, in ls,
|
||||
# in everything.
|
||||
#
|
||||
# A harness may set a bare name there, because a harness IS the container's
|
||||
# main process. A tool is one program among many.
|
||||
local d; d="$(mktemp -d "$BATS_TEST_TMPDIR/toolenv.XXXXXX")"
|
||||
mkdir -p "$d/tools/probe"
|
||||
local sha; sha="$(printf 'a%.0s' {1..64})"
|
||||
local bad
|
||||
for bad in 'NO_COLOR=1' 'DO_NOT_TRACK=1' 'PATH=/x' 'PROBEISH_X=1'; do
|
||||
printf 'description = x\ninstall = tarball:p@%s:https://e.example/p.tgz\ncommand = p\nimage_env = %s\n' \
|
||||
"$sha" "$bad" > "$d/tools/probe/tool.conf"
|
||||
run env DEJIMA_PROVIDER_ROOT="$d" \
|
||||
bash -c 'source "$1"; tool_validate probe' _ "$LIB"
|
||||
[ "$status" -ne 0 ] || { echo "accepted image_env $bad"; return 1; }
|
||||
[[ "$output" == *"not its own"* ]] || { echo "$output"; return 1; }
|
||||
done
|
||||
|
||||
# Namespaced to the tool, which is what a tool's own switch looks like.
|
||||
printf 'description = x\ninstall = tarball:p@%s:https://e.example/p.tgz\ncommand = p\nimage_env = PROBE_TELEMETRY=0 PROBE_QUIET=1\n' \
|
||||
"$sha" > "$d/tools/probe/tool.conf"
|
||||
run env DEJIMA_PROVIDER_ROOT="$d" bash -c 'source "$1"; tool_validate probe' _ "$LIB"
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
}
|
||||
|
||||
@test "no shipped tool takes the colour out of the rest of the container" {
|
||||
# The specific regression, pinned by name as well as by the rule above:
|
||||
# these are the bare names most likely to look like a tool's own business
|
||||
# and reach everything.
|
||||
local tool pair
|
||||
for tool in $(lib provider_list tool); do
|
||||
run lib tool_validate "$tool"
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
for pair in $(lib manifest_get tool "$tool" image_env); do
|
||||
case "${pair%%=*}" in
|
||||
NO_COLOR|TERM|CLICOLOR|CLICOLOR_FORCE|FORCE_COLOR)
|
||||
echo "$tool sets ${pair%%=*} for the whole container"; return 1 ;;
|
||||
esac
|
||||
done
|
||||
done
|
||||
}
|
||||
|
||||
@test "rtk is declared with its telemetry switched off in the image" {
|
||||
# Two independent offs, because either one can be wrong: the tool's own
|
||||
# switch here, and the firewall, which does not allowlist the endpoint.
|
||||
[[ "$(lib manifest_get tool rtk image_env)" == *"RTK_TELEMETRY_DISABLED=1"* ]] \
|
||||
|| { echo "rtk's telemetry switch is no longer set"; return 1; }
|
||||
# And the endpoint stays out of what core allowlists.
|
||||
run grep -rn 'telemetry.rtk-ai' "$REPO_ROOT/docker" "$REPO_ROOT/bin"
|
||||
[ "$status" -ne 0 ] || { echo "the telemetry endpoint reached the allowlist:"; echo "$output"; return 1; }
|
||||
}
|
||||
|
||||
@test "a tool's archive shape decides how it is unpacked" {
|
||||
# A bare-binary archive stripped of a component extracts NOTHING, and does
|
||||
# it silently: the layer builds, and the tool is not in it.
|
||||
local spec
|
||||
spec="tarball:x@$(printf 'a%.0s' {1..64}):https://e.example/x.tgz"
|
||||
run env DEJIMA_TARBALL_STRIP=binary bash -c \
|
||||
'source "$1"; generate_spec_dockerfile base "$2"' _ "$LIB_PROJECT" "$spec"
|
||||
[[ "$output" == *"tar -C /opt/dejima/x/bin -xaf"* ]] \
|
||||
|| { echo "binary layout still strips a component: $output"; return 1; }
|
||||
run env DEJIMA_TARBALL_STRIP=prefix bash -c \
|
||||
'source "$1"; generate_spec_dockerfile base "$2"' _ "$LIB_PROJECT" "$spec"
|
||||
[[ "$output" == *"--strip-components=1"* ]] \
|
||||
|| { echo "prefix layout stopped stripping: $output"; return 1; }
|
||||
# Both verify before they unpack. A tar extracted first and checked after
|
||||
# has already written whatever it contained.
|
||||
[[ "$output" == *"sha256sum -c -"*"tar -C"* ]] \
|
||||
|| { echo "the digest is no longer checked before unpacking"; return 1; }
|
||||
}
|
||||
|
||||
@test "the briefing names the tools a launch enabled, and says nothing when there are none" {
|
||||
run env DEJIMA_TOOLS=rtk bash -c \
|
||||
'source "$1"; briefing_compose none local-only claude-code' _ "$LIB"
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
[[ "$output" == *"Extra tools this session has"* ]] || { echo "$output"; return 1; }
|
||||
[[ "$output" == *"rtk git status"* ]] \
|
||||
|| { echo "the tool's own instructions did not reach the briefing"; return 1; }
|
||||
|
||||
run env DEJIMA_TOOLS= bash -c \
|
||||
'source "$1"; briefing_compose none local-only claude-code' _ "$LIB"
|
||||
[[ "$output" != *"Extra tools this session has"* ]] \
|
||||
|| { echo "a heading with nothing under it"; return 1; }
|
||||
}
|
||||
|
||||
@test "the github forge pushes with its own token, not the read-only one" {
|
||||
run lib manifest_validate forge github
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
@@ -803,7 +982,92 @@ assert_remedy_forges_exist() {
|
||||
# declared: the entrypoint links the merge shadow only over a command that
|
||||
# is behind /usr/local/lib/dejima/forge, and refuses to start otherwise.
|
||||
# This forge shipping nothing of its own is what "system:" says.
|
||||
[ "$(lib manifest_get forge github install)" = "system:gh" ]
|
||||
# system:gh AND the one CLI this forge ships. install-forge-bins.sh fails
|
||||
# the build in both directions - a declared file that is missing, and a
|
||||
# file under bin/ that no manifest declares - so this is the declaration
|
||||
# an operator reads to know what lands in the image.
|
||||
[ "$(lib manifest_get forge github install)" = "system:gh bin/github-pr" ]
|
||||
}
|
||||
|
||||
@test "each forge declares which of its keys belong to a person" {
|
||||
# The credential paths, which a project may not declare and an identity
|
||||
# may set. One declaration drives both rules, so they cannot disagree
|
||||
# about which key is which.
|
||||
[ "$(lib manifest_get forge gitea identity_keys)" = "token_file" ]
|
||||
[ "$(lib manifest_get forge github identity_keys)" = "push_token_file" ]
|
||||
[ -z "$(lib manifest_get forge none identity_keys)" ]
|
||||
# And every one of them is a key that forge actually has, or the identity
|
||||
# would offer a setting nothing reads.
|
||||
local forge key spec found
|
||||
for forge in $(lib provider_list forge); do
|
||||
for key in $(lib manifest_get forge "$forge" identity_keys); do
|
||||
found=0
|
||||
for spec in $(lib manifest_get forge "$forge" keys); do
|
||||
[ "${spec%%:*}" = "$key" ] && found=1
|
||||
done
|
||||
[ "$found" -eq 1 ] \
|
||||
|| { echo "$forge names identity key '$key' and has no such key"; return 1; }
|
||||
done
|
||||
done
|
||||
}
|
||||
|
||||
@test "no two forges claim the same identity key name" {
|
||||
# An identity's keys are unqualified, so one name resolving to two forges'
|
||||
# types would make the validation depend on which forge was read first.
|
||||
# Refused here rather than guessed at in _identity_key_specs.
|
||||
local forge key seen=""
|
||||
for forge in $(lib provider_list forge); do
|
||||
for key in $(lib manifest_get forge "$forge" identity_keys); do
|
||||
case " $seen " in
|
||||
*" $key "*) echo "two forges declare identity key '$key'"; return 1 ;;
|
||||
esac
|
||||
seen="$seen $key"
|
||||
done
|
||||
done
|
||||
}
|
||||
|
||||
@test "the identity key set is core's two plus whatever the forges declare" {
|
||||
# ssh_key and the git name are core's, because every forge needs the same
|
||||
# answer to "who is pushing". The credentials are not, and are typed by
|
||||
# the forge that owns them rather than by a second copy here.
|
||||
local specs
|
||||
specs="$(lib _identity_key_specs)"
|
||||
grep -qP '^ssh_key\t\?path$' <<< "$specs" || { echo "$specs"; return 1; }
|
||||
grep -qP '^user_name\t\?text$' <<< "$specs" || { echo "$specs"; return 1; }
|
||||
grep -qP '^user_email\t\?text$' <<< "$specs" || { echo "$specs"; return 1; }
|
||||
grep -qP '^token_file\t\?path$' <<< "$specs" \
|
||||
|| { echo "token_file did not inherit gitea's type: $specs"; return 1; }
|
||||
}
|
||||
|
||||
@test "the github forge declares how its CLI can be aimed at another repo" {
|
||||
# gh takes --repo on nearly every subcommand and reads GH_REPO, so the
|
||||
# ordinary path can act on a repository the session has nothing to do
|
||||
# with (#187). The guard is generic; the manifest is what makes it fire.
|
||||
[ "$(lib manifest_get forge github repo_flags)" = "--repo -R" ]
|
||||
[ "$(lib manifest_get forge github repo_env)" = "GH_REPO" ]
|
||||
# The gitea CLIs resolve the repo from origin and refuse another host, so
|
||||
# there is nothing to declare and nothing for the guard to compare. A
|
||||
# forge is not required to be aimable.
|
||||
[ -z "$(lib manifest_get forge gitea repo_flags)" ]
|
||||
[ -z "$(lib manifest_get forge gitea repo_env)" ]
|
||||
}
|
||||
|
||||
@test "a repo flag has to look like a flag" {
|
||||
# It is compared against argv. A bare word would be indistinguishable from
|
||||
# a subcommand or a value, and would refuse commands at random.
|
||||
local d bad; d="$(mktemp -d "$BATS_TEST_TMPDIR/flagtype.XXXXXX")"
|
||||
mkdir -p "$d/forges/probe"
|
||||
for bad in "repo" "--" "-" "--repo=x"; do
|
||||
printf 'repo_flags = %s\n' "$bad" > "$d/forges/probe/forge.conf"
|
||||
run env DEJIMA_PROVIDER_ROOT="$d" \
|
||||
bash -c 'source "$1"; manifest_validate forge probe' _ "$LIB"
|
||||
[ "$status" -ne 0 ] || { echo "accepted repo_flags = $bad"; return 1; }
|
||||
done
|
||||
# Space-separated, like every other manifest list.
|
||||
printf 'repo_flags = --repo -R\n' > "$d/forges/probe/forge.conf"
|
||||
run env DEJIMA_PROVIDER_ROOT="$d" \
|
||||
bash -c 'source "$1"; manifest_validate forge probe' _ "$LIB"
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
}
|
||||
|
||||
@test "the briefing does not call GitHub read-only when the forge can push to it" {
|
||||
|
||||
+47
-5
@@ -12,7 +12,10 @@ set -uo pipefail
|
||||
root="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)"
|
||||
base="${1:-main}"
|
||||
head="${2:-HEAD}"
|
||||
cd "$root"
|
||||
# Guarded, because everything below is relative to it: a cd that failed
|
||||
# silently would have this reporting on some other directory's suites and
|
||||
# diff, which for a release gate is the worst way to be wrong.
|
||||
cd "$root" || { echo "cannot enter $root" >&2; exit 1; }
|
||||
|
||||
case "${1:-}" in
|
||||
-h|--help)
|
||||
@@ -77,9 +80,13 @@ fi
|
||||
|
||||
touches() { grep -qE "$1" <<< "$changed"; }
|
||||
|
||||
note "Manual checks this release calls for"
|
||||
# Not a checklist to complete: an inventory of what nothing has checked. The
|
||||
# gate for a release here is the security review plus the maintainer running
|
||||
# the build - see docs/release.md. Printed anyway, because a release whose
|
||||
# unverified paths are written down is one somebody can debug later.
|
||||
note "Nothing has verified these, and this release touches them"
|
||||
printed=0
|
||||
manual() { printf ' [ ] %s\n' "$1"; printed=1; }
|
||||
manual() { printf ' - %s\n' "$1"; printed=1; }
|
||||
|
||||
touches '^(bin/dejima$|docker/entrypoint|docker/Dockerfile|docker/docker-compose)' &&
|
||||
manual "Launch a real session. Nothing else exercises the mounts, the
|
||||
@@ -103,11 +110,46 @@ touches '^\.dejima/allowed-domains$' &&
|
||||
future CI job on that runner. Say in the PR what it is for."
|
||||
[ "$printed" = 1 ] || echo " (none - this release touches nothing with a manual check)"
|
||||
|
||||
note "Reviews"
|
||||
note "Required before this merges"
|
||||
echo " [ ] Security review of the whole $base...$head diff, against this"
|
||||
echo " project's own invariants - see docs/release.md."
|
||||
echo " project's own invariants - see docs/release.md. This is the gate."
|
||||
echo " [ ] Documentation review: every changed behaviour has its doc changed,"
|
||||
echo " and no doc describes something that no longer exists."
|
||||
echo " [ ] The maintainer runs the build: normal usage for a while, and a"
|
||||
echo " launch on the other configured harness to confirm it starts."
|
||||
|
||||
# A config key added in a release makes the PREVIOUS main refuse to start once
|
||||
# an operator has adopted it, because an unknown key fails validation. That
|
||||
# turns the obvious rollback into a second outage, so it is worth knowing
|
||||
# before rather than after.
|
||||
note "Config keys this release adds (a rollback refuses a config using them)"
|
||||
added="$(comm -13 \
|
||||
<(git show "$base:bin/dejima-config-lib.sh" 2>/dev/null | grep -oE "^[a-z-]+\\.[a-z_]+" | sort -u) \
|
||||
<(grep -oE "^[a-z-]+\\.[a-z_]+" bin/dejima-config-lib.sh | sort -u))"
|
||||
# Providers too, and this is the sharper half: a [harness.<name>] section for
|
||||
# a harness the older dejima does not ship is an unknown SECTION, which fails
|
||||
# validation exactly as an unknown key does. So adopting a new provider is
|
||||
# itself the thing that makes the rollback refuse.
|
||||
# The singular is spelled out rather than derived: "harnesses" does not lose
|
||||
# an s to become "harness", and a manifest is named for the singular.
|
||||
new_providers=""
|
||||
for pair in harnesses:harness forges:forge workflows:workflow; do
|
||||
axis="${pair%%:*}"
|
||||
one="${pair#*:}"
|
||||
[ -d "$axis" ] || continue
|
||||
while IFS= read -r name; do
|
||||
[ -n "$name" ] || continue
|
||||
git cat-file -e "$base:$axis/$name/$one.conf" 2>/dev/null ||
|
||||
new_providers="$new_providers $one.$name"
|
||||
done < <(find "$axis" -mindepth 1 -maxdepth 1 -type d -printf '%f\n' | sort)
|
||||
done
|
||||
|
||||
if [ -n "$added" ] || [ -n "$new_providers" ]; then
|
||||
[ -z "$added" ] || printf ' %s\n' $added
|
||||
[ -z "$new_providers" ] || printf ' [%s] as a config section\n' $new_providers
|
||||
else
|
||||
echo " (none - a rollback accepts any config this release accepts)"
|
||||
fi
|
||||
|
||||
note "Then"
|
||||
echo " Say in the release PR what was run and what was not. A privileged job"
|
||||
|
||||
+71
-4
@@ -1314,7 +1314,6 @@ EOF
|
||||
stub_launch
|
||||
write_remote_config
|
||||
launch "$PROJ"
|
||||
grep -q 'dejima-notify.sh waiting' "$LAUNCH_DIR/settings-copy.json"
|
||||
grep -q 'dejima-notify.sh done' "$LAUNCH_DIR/settings-copy.json"
|
||||
# The layer is a throwaway, so the operator's real settings.json - which
|
||||
# nothing registers this hook into - is left byte-for-byte alone.
|
||||
@@ -1329,8 +1328,8 @@ EOF
|
||||
# Copying them would run each of them twice. Verified against Claude Code
|
||||
# 2.1.220: a SessionStart hook in a --settings file and one in
|
||||
# ~/.claude/settings.json both fire.
|
||||
[ "$(jq '.hooks.Notification | length' "$LAUNCH_DIR/settings-copy.json")" = "1" ]
|
||||
[ "$(jq '.hooks.Stop | length' "$LAUNCH_DIR/settings-copy.json")" = "1" ]
|
||||
[ "$(jq '.hooks.Notification // [] | length' "$LAUNCH_DIR/settings-copy.json")" = "0" ]
|
||||
run jq -r '[.hooks[][].hooks[].command] | join(" ")' "$LAUNCH_DIR/settings-copy.json"
|
||||
[[ "$output" != *operator-desktop-notify.sh* ]]
|
||||
[[ "$output" != *operator-tts.sh* ]]
|
||||
@@ -1943,6 +1942,7 @@ expect_ttyd_argv() {
|
||||
[ -z "${2:-}" ] || printf '%s\n' -t "fontSize=$2"
|
||||
[ -z "${3:-}" ] || printf '%s\n' -t "tmuxPrefix=$3"
|
||||
[ -z "${4:-}" ] || printf '%s\n' -t "focusOnTap=$4"
|
||||
[ -z "${5:-}" ] || printf '%s\n' -t "buttonColors=$5"
|
||||
printf '%s\n' "$(readlink -f "$REPO_ROOT/bin")/dejima-attach"
|
||||
}
|
||||
# Sentinel on both sides: both are command substitutions, which strip trailing
|
||||
@@ -2232,6 +2232,36 @@ PY
|
||||
assert_ttyd_argv 12345 20 C-Space
|
||||
}
|
||||
|
||||
@test "ttyd_button_colors reaches ttyd, and unset sends nothing so the page decides" {
|
||||
[ -x "$REPO_ROOT/bin/dejima-ttyd" ]
|
||||
|
||||
# Unset is not "off": the page colours the toolbar unless told not to, and
|
||||
# a host-wide "off" written here would be a different thing from silence.
|
||||
write_remote_config 'ttyd_port = 12345'
|
||||
stub_ttyd
|
||||
run "$REPO_ROOT/bin/dejima-ttyd"
|
||||
[ "$status" -eq 0 ]
|
||||
run grep -c 'buttonColors' "$STUB_DIR/ttyd-argv"
|
||||
[ "$output" = "0" ]
|
||||
|
||||
local value
|
||||
for value in on off; do
|
||||
: > "$STUB_DIR/ttyd-argv"
|
||||
write_remote_config 'ttyd_port = 12345' "ttyd_button_colors = $value"
|
||||
run "$REPO_ROOT/bin/dejima-ttyd"
|
||||
[ "$status" -eq 0 ]
|
||||
assert_ttyd_argv 12345 '' '' '' "$value"
|
||||
done
|
||||
|
||||
# Alongside every other -t knob, since they share one splice.
|
||||
: > "$STUB_DIR/ttyd-argv"
|
||||
write_remote_config 'ttyd_port = 12345' 'ttyd_font_size = 20' \
|
||||
'ttyd_tmux_prefix = C-a' 'ttyd_focus_on_tap = on' 'ttyd_button_colors = off'
|
||||
run "$REPO_ROOT/bin/dejima-ttyd"
|
||||
[ "$status" -eq 0 ]
|
||||
assert_ttyd_argv 12345 20 C-a on off
|
||||
}
|
||||
|
||||
@test "ttyd_focus_on_tap reaches ttyd, and unset sends nothing so the page decides" {
|
||||
[ -x "$REPO_ROOT/bin/dejima-ttyd" ]
|
||||
|
||||
@@ -2667,7 +2697,7 @@ nginx_blocks() {
|
||||
|
||||
# bin/dejima registers $HOME/.claude/hooks/dejima-notify.sh per session,
|
||||
# and ~/.claude/hooks is what gets mounted read-only into the container.
|
||||
# Without this link every Notification and Stop is an exit-127.
|
||||
# Without this link every notification hook is an exit-127.
|
||||
[ -L "$FAKE_HOME/.claude/hooks/dejima-notify.sh" ]
|
||||
[ "$(readlink -f "$FAKE_HOME/.claude/hooks/dejima-notify.sh")" \
|
||||
= "$(readlink -f "$REPO_ROOT/hooks/dejima-notify.sh")" ]
|
||||
@@ -2887,7 +2917,7 @@ remote_doc() {
|
||||
# rather than derived so this still catches the doc losing one of them.
|
||||
local keys key
|
||||
keys='enabled ntfy_url base_url ttyd_port ttyd_font_size ttyd_tmux_prefix
|
||||
ttyd_focus_on_tap'
|
||||
ttyd_focus_on_tap ttyd_button_colors'
|
||||
for key in $keys; do has -F "\`$key\`"; done
|
||||
|
||||
# The port default, taken from the library so the two cannot drift.
|
||||
@@ -3015,3 +3045,40 @@ remote_doc() {
|
||||
[ "$status" -ne 0 ]
|
||||
[ -z "$output" ]
|
||||
}
|
||||
|
||||
@test "one session-finished push per stop, not a second one a minute later" {
|
||||
# Claude Code raises Notification when it needs permission and when the
|
||||
# prompt has sat idle. A dejima session runs with permission prompts off,
|
||||
# so only the timer is left, and it expires shortly after the Stop it
|
||||
# follows - two pushes on a phone for one event, the second carrying
|
||||
# nothing the first had not. Debouncing cannot merge them: the watcher
|
||||
# keys on run id AND event, deliberately, so waiting and done are separate
|
||||
# signals whenever a harness can actually tell them apart.
|
||||
stub_launch
|
||||
write_remote_config
|
||||
launch "$PROJ"
|
||||
run jq -r '[.hooks[][].hooks[].command] | join(" ")' "$LAUNCH_DIR/settings-copy.json"
|
||||
[[ "$output" == *'dejima-notify.sh done'* ]] \
|
||||
|| { echo "the stop notification is gone entirely: $output"; return 1; }
|
||||
[[ "$output" != *'dejima-notify.sh waiting'* ]] \
|
||||
|| { echo "the idle timer is registered again: $output"; return 1; }
|
||||
rm -rf "$PROJ"
|
||||
}
|
||||
|
||||
@test "the watcher still consumes a waiting marker no hook registers" {
|
||||
# Nothing writes one by default now, and that changes nothing here: the
|
||||
# marker directory is bind-mounted read-write, so a session creates
|
||||
# whatever names it likes. The enum is the boundary, not the registration,
|
||||
# and dropping `waiting` from it would leave a marker that accumulates
|
||||
# rather than one that is refused.
|
||||
conf_with_ntfy
|
||||
stub_curl
|
||||
write_entry 0123456789abcdef '%1' 'work:2'
|
||||
marker 0123456789abcdef waiting
|
||||
run "$REPO_ROOT/bin/dejima-notify-watch" --once
|
||||
[ "$status" -eq 0 ]
|
||||
[ ! -e "$RUNTIME_DIR/dejima/notify/0123456789abcdef/waiting" ] \
|
||||
|| { echo "the marker was left to accumulate"; return 1; }
|
||||
assert_argv 'myproject needs input' 'Session is waiting for you.' \
|
||||
'https://dejima.example.invalid/?arg=0123456789abcdef'
|
||||
}
|
||||
|
||||
+125
-1
@@ -37,6 +37,18 @@ bats_require_minimum_version 1.5.0
|
||||
# The `dejima-test-` prefix is this suite's own namespace. Nothing else may use
|
||||
# it, which is what makes the reclaim in setup_file safe.
|
||||
|
||||
# The cap_add list from the compose file, one per line. A minimal reader for
|
||||
# one known block rather than a YAML parser: the alternative is this suite
|
||||
# hardcoding a second copy of the capability floor and the two disagreeing
|
||||
# silently, which is exactly the failure the floor exists to prevent.
|
||||
compose_cap_add() {
|
||||
awk '
|
||||
/^ cap_add:/ { in_block = 1; next }
|
||||
in_block && /^ - / { sub(/^ - /, ""); print; next }
|
||||
in_block && !/^ / { in_block = 0 }
|
||||
' "$BATS_TEST_DIRNAME/../docker/docker-compose.yml"
|
||||
}
|
||||
|
||||
IMAGE=dejima:latest
|
||||
|
||||
# What a session actually runs: the base image plus the selected harness's own
|
||||
@@ -330,8 +342,18 @@ setup_file() {
|
||||
# container started without these gets none of them. Read from the
|
||||
# manifest rather than written here, so this fixture cannot drift from
|
||||
# what a real launch supplies.
|
||||
# The capability posture from docker-compose.yml rather than a copy of it.
|
||||
# This container is started with `docker run`, so a hand-written --cap-add
|
||||
# list here would drift from the compose file the moment either changed -
|
||||
# and the whole point of the floor is that the container a session actually
|
||||
# gets is the one under test.
|
||||
local -a caps=()
|
||||
while IFS= read -r cap; do caps+=(--cap-add="$cap"); done < <(compose_cap_add)
|
||||
[ "${#caps[@]}" -gt 0 ] || { echo "no cap_add found in docker-compose.yml" >&2; return 1; }
|
||||
|
||||
docker run -d --name "$container" \
|
||||
--cap-add=NET_ADMIN --cap-add=NET_RAW \
|
||||
--cap-drop=ALL "${caps[@]}" \
|
||||
--security-opt=no-new-privileges:true \
|
||||
--network "$network" \
|
||||
-e SANDBOX_TEST_MODE=1 \
|
||||
-e GH_TOKEN="${GH_TOKEN:-}" \
|
||||
@@ -525,6 +547,25 @@ dexec_node() {
|
||||
[[ "$output" == *"policy DROP"* ]]
|
||||
}
|
||||
|
||||
@test "the IPv6 block is a filtered family, not an absent one" {
|
||||
# The DROP policy above is the good path. This asserts the container is
|
||||
# actually ON that path rather than on the fallback, because the two are
|
||||
# indistinguishable from the outside: a container with no IPv6 at all also
|
||||
# reaches nothing over IPv6.
|
||||
#
|
||||
# If ip6tables ever stops working as root here, the test above fails and
|
||||
# this one says why - and on a host that takes the fallback branch,
|
||||
# init-firewall.sh now either turns the family off or refuses to start,
|
||||
# rather than logging a conclusion it had not checked.
|
||||
run dexec sh -c 'ip6tables -L >/dev/null 2>&1 && echo usable'
|
||||
[[ "$output" == *usable* ]] \
|
||||
|| { echo "ip6tables is not usable as root; the fallback branch is live"; return 1; }
|
||||
# And the fallback's own condition is readable, so a failure here can be
|
||||
# diagnosed without a second run: what does the kernel say is up?
|
||||
run dexec sh -c 'cat /proc/net/if_inet6 2>/dev/null || echo "(no /proc/net/if_inet6)"'
|
||||
[ "$status" -eq 0 ]
|
||||
}
|
||||
|
||||
@test "a non-allowlisted domain is refused by the DNS proxy, not just left to fail later" {
|
||||
run dexec dig definitely-not-on-the-allowlist.example.org
|
||||
[[ "$output" == *"status: REFUSED"* ]]
|
||||
@@ -1034,6 +1075,69 @@ dexec_node() {
|
||||
run ! dexec_node sudo -n true
|
||||
}
|
||||
|
||||
@test "the container runs with no path back up to more privilege" {
|
||||
# no-new-privileges in docker-compose.yml. gosu drops privilege rather
|
||||
# than gaining it, so this does not interfere with the session starting -
|
||||
# what it forbids is a setuid binary or a file capability raising
|
||||
# privileges on exec, which is the shape any escalation from the session
|
||||
# user would have to take.
|
||||
#
|
||||
# Asserted on PID 1 and on the session user, because the flag is a property
|
||||
# of the process tree and both halves of it matter.
|
||||
run dexec cat /proc/1/status
|
||||
[ "$status" -eq 0 ]
|
||||
[[ "$output" == *$'NoNewPrivs:\t1'* ]] \
|
||||
|| { echo "PID 1 can still gain privileges on exec"; return 1; }
|
||||
run dexec_node sh -c 'grep NoNewPrivs /proc/self/status'
|
||||
[[ "$output" == *"1"* ]] || { echo "the session user's shell can: $output"; return 1; }
|
||||
}
|
||||
|
||||
@test "the capability bounding set is the declared floor and nothing more" {
|
||||
# cap_drop: ALL plus an explicit list, rather than Docker's default set
|
||||
# plus two. The entrypoint uses six capabilities during its root phase and
|
||||
# the default carries about fourteen; this asserts the difference is real
|
||||
# in the running container rather than only present in the compose file.
|
||||
#
|
||||
# CapBnd, not CapEff: the effective set is zero for the session user
|
||||
# already (the test below), and the bounding set is what says the rest was
|
||||
# never available to regain.
|
||||
run dexec cat /proc/1/status
|
||||
[ "$status" -eq 0 ]
|
||||
local bnd; bnd=$(echo "$output" | awk '/^CapBnd:/ {print $2}')
|
||||
[ -n "$bnd" ] || { echo "no CapBnd in /proc/1/status"; return 1; }
|
||||
|
||||
# Decoded by name so a failure says which capability, not which bit.
|
||||
local have; have="$(dexec capsh --decode="$bnd" 2>/dev/null)" || have=""
|
||||
[ -n "$have" ] || skip "capsh not available in the image to decode $bnd"
|
||||
local cap
|
||||
for cap in $(compose_cap_add); do
|
||||
[[ "$have" == *"cap_$(echo "$cap" | tr '[:upper:]' '[:lower:]')"* ]] \
|
||||
|| { echo "declared $cap is missing from the bounding set: $have"; return 1; }
|
||||
done
|
||||
# Not KILL: `dejima-allow --container` signals dnsmasq, which runs as its
|
||||
# own user, so root here needs it. That absence is what failed the first
|
||||
# privileged run of this change.
|
||||
for cap in mknod setfcap setpcap sys_chroot audit_write net_bind_service sys_admin fsetid; do
|
||||
[[ "$have" != *"cap_$cap"* ]] \
|
||||
|| { echo "cap_$cap is in the bounding set and nothing declares it: $have"; return 1; }
|
||||
done
|
||||
}
|
||||
|
||||
@test "root can still signal dnsmasq, which is what adding a domain mid-session needs" {
|
||||
# Named for the thing rather than left to be caught by the ipset tests,
|
||||
# which is how it WAS caught: the first version of the capability floor
|
||||
# dropped KILL, and `dejima-allow --container` failed with "Operation not
|
||||
# permitted" because dnsmasq runs as its own user (`user=dnsmasq`) and root
|
||||
# cannot signal another user's process without CAP_KILL.
|
||||
#
|
||||
# Adding a domain to a running session is a documented feature that every
|
||||
# session briefing tells the agent to ask for, so this asserts the
|
||||
# capability by exercising what needs it.
|
||||
run dexec sh -c 'kill -HUP "$(cat /var/run/dnsmasq-sandbox.pid)"'
|
||||
[ "$status" -eq 0 ] \
|
||||
|| { echo "root cannot signal dnsmasq - is KILL in the floor? $output"; return 1; }
|
||||
}
|
||||
|
||||
@test "the real running node process has NET_ADMIN/NET_RAW stripped, not just the bounding set" {
|
||||
run dexec cat /proc/1/status
|
||||
[ "$status" -eq 0 ]
|
||||
@@ -1086,6 +1190,26 @@ EOF'
|
||||
[[ "$output" == *"PLAYWRIGHT_LAUNCH_OK"* ]]
|
||||
}
|
||||
|
||||
@test "a global package imports as ESM too, from a directory of its own" {
|
||||
# The test above proves the browser works, in the module system that
|
||||
# already resolved. NODE_PATH covers require() and nothing else: ESM walks
|
||||
# up from the importing file, so the modern form failed everywhere while
|
||||
# this suite stayed green. What an agent got was ERR_MODULE_NOT_FOUND,
|
||||
# which reads as an image without a browser.
|
||||
#
|
||||
# Written somewhere with no node_modules of its own, because anywhere
|
||||
# inside a project with one would resolve for the wrong reason.
|
||||
dexec_node bash -c 'mkdir -p /tmp/esm-probe && cat > /tmp/esm-probe/probe.mjs <<'"'"'EOF'"'"'
|
||||
import { chromium } from "playwright";
|
||||
const browser = await chromium.launch({});
|
||||
await browser.close();
|
||||
console.log("ESM_IMPORT_OK");
|
||||
EOF'
|
||||
run dexec_node node /tmp/esm-probe/probe.mjs
|
||||
[ "$status" -eq 0 ] || { echo "$output"; return 1; }
|
||||
[[ "$output" == *"ESM_IMPORT_OK"* ]] || { echo "$output"; return 1; }
|
||||
}
|
||||
|
||||
@test "the firewall applies to Playwright's browser traffic, not just curl/git" {
|
||||
# The whole point of pre-baking the browser at build time is that a
|
||||
# session never needs new network access for it - confirm the egress
|
||||
|
||||
+7
-1
@@ -3,7 +3,7 @@
|
||||
# and by test/static.bats, so the two cannot disagree about what is covered.
|
||||
#
|
||||
# The list is discovered, not enumerated: a script added under bin/, hooks/,
|
||||
# docker/ or a forge's bin/ is covered the day it lands, which is the only
|
||||
# docker/, test/ or a forge's bin/ is covered the day it lands, which is the only
|
||||
# version of this that stays true. Discovery is by shebang rather than by
|
||||
# extension, because most of this repo's scripts have no extension.
|
||||
#
|
||||
@@ -19,6 +19,12 @@ list_scripts() {
|
||||
ls bin/dejima bin/dejima-* bin/harness/*.sh 2>/dev/null || true
|
||||
ls hooks/*.sh docker/*.sh install.sh 2>/dev/null || true
|
||||
ls forges/*/bin/* 2>/dev/null || true
|
||||
# test/, for the reason .dejima.md gives for being careful what goes
|
||||
# there: CI checks the commit out on a host and runs it, so a helper
|
||||
# in a test file is code executing outside the sandbox. That makes
|
||||
# these the last scripts that should go unchecked, not the first -
|
||||
# and leaving them out hid a real fault in the release gate itself.
|
||||
ls test/*.sh 2>/dev/null || true
|
||||
} | sort -u | while read -r f; do
|
||||
[ -f "$f" ] || continue
|
||||
# Harness plugins are sourced, not executed, so they carry no shebang
|
||||
|
||||
+1019
-12
File diff suppressed because it is too large
Load Diff
@@ -0,0 +1,16 @@
|
||||
`rtk` is available, and reading less of a command's output is usually free:
|
||||
it runs the real command and prints a compressed form of what came back.
|
||||
Prefix a command with it where the full output is not the point.
|
||||
|
||||
rtk git status rtk git diff rtk git log -n 20
|
||||
rtk ls . rtk find "*.py" . rtk grep "pattern" .
|
||||
rtk cargo test rtk pytest rtk go test
|
||||
|
||||
It runs the real binary through PATH, so every guard that applies to a
|
||||
command applies to it wrapped in rtk too. `rtk proxy <cmd>` runs something
|
||||
unfiltered when you need the whole output, and `rtk read <file>` is a
|
||||
structure-first view of a file rather than the whole body.
|
||||
|
||||
Use judgement rather than wrapping everything: a test run you are about to
|
||||
debug line by line, or a diff you are about to apply, is output you want in
|
||||
full.
|
||||
@@ -0,0 +1,43 @@
|
||||
# rtk - a CLI proxy that compresses command output before an agent reads it.
|
||||
# https://github.com/rtk-ai/rtk, Apache-2.0, a single static Rust binary.
|
||||
#
|
||||
# The first optional tool, and the shape every later one has to follow: dejima
|
||||
# does not install what a project asks for, it installs what it has hardened.
|
||||
# See docs/tools.md for what that means and what was checked here.
|
||||
#
|
||||
# What it is NOT: rtk makes no model calls of its own. It is a deterministic
|
||||
# output filter - `rtk git status` runs git and prints less of the result - so
|
||||
# nothing here sends code anywhere.
|
||||
description = compresses command output before it reaches the model
|
||||
|
||||
# The published release, pinned by digest. Deliberately not the project's
|
||||
# `curl | sh` installer, which fetches whatever master points at today: an
|
||||
# image build that produces a different binary each time is one nothing has
|
||||
# reviewed. The digest was taken from the artifact below and checked against a
|
||||
# second download.
|
||||
#
|
||||
# x86_64 only, which is issue #97's limitation and not this tool's: the
|
||||
# tarball spec names one architecture and an arm64 host cannot use this entry.
|
||||
install = tarball:rtk@c4c036fbf181fc55ef329786c8c17e0d427972b053b825944d968a6aafef1ba4:https://github.com/rtk-ai/rtk/releases/download/v0.45.0/rtk-x86_64-unknown-linux-musl.tar.gz
|
||||
|
||||
# The archive is one bare executable with no enclosing directory, where a Go
|
||||
# or nvim release has everything under one. Stripping a component would strip
|
||||
# the binary itself and extract nothing.
|
||||
install_layout = binary
|
||||
|
||||
# rtk carries telemetry the README does not mention: an https ping compiled
|
||||
# into the release binary, gated on a consent flag that defaults to unset.
|
||||
# Disabled here as well, and the firewall does not allowlist the endpoint, so
|
||||
# it is off three ways. Verified in the shipped artifact's strings, not only
|
||||
# in the source - see docs/tools.md.
|
||||
#
|
||||
# This carried NO_COLOR=1 as well, reasoning that rtk's output lands in a
|
||||
# model's context where an escape sequence is noise. The reasoning was fine
|
||||
# and the mechanism was wrong: a tool's image_env becomes a Dockerfile ENV,
|
||||
# which every process in the container inherits, so it took the colour out of
|
||||
# the harness, git, ls and everything else. A tool may only set variables that
|
||||
# are its own, and core refuses one that is not.
|
||||
image_env = RTK_TELEMETRY_DISABLED=1
|
||||
|
||||
command = rtk
|
||||
instructions = instructions.md
|
||||
+146
-14
@@ -10,7 +10,7 @@
|
||||
<meta name="color-scheme" content="dark">
|
||||
<meta name="mobile-web-app-capable" content="yes">
|
||||
<title>dejima</title>
|
||||
<!-- Generated by web/build.mjs - do not edit. Sources: 0d07a16b97dd65deac6d7985dfa4603b6f68ba0ac31dccbb77c314bc200016ac -->
|
||||
<!-- Generated by web/build.mjs - do not edit. Sources: f8a5205278ef77485e319cdefff6cbeeb027f201ab27266b02703a9eb570c608 -->
|
||||
<style>
|
||||
/**
|
||||
* Copyright (c) 2014 The xterm.js authors. All rights reserved.
|
||||
@@ -344,14 +344,68 @@ body.touch #terminal {
|
||||
-webkit-touch-callout: none;
|
||||
}
|
||||
|
||||
/* gruvbox dark, the same values bin/dejima-attach uses for the session
|
||||
picker, each tagged with its upstream color.table name so a wrong hex is
|
||||
catchable by reading. The two sit either side of one attach: picker, then
|
||||
terminal. They should not look like different programs.
|
||||
https://github.com/gruvbox-community/gruvbox-contrib/blob/master/color.table */
|
||||
:root {
|
||||
--gb-dark0-hard: #1d2021;
|
||||
--gb-dark0: #282828;
|
||||
--gb-dark1: #3c3836;
|
||||
--gb-dark2: #504945;
|
||||
--gb-light1: #ebdbb2;
|
||||
--gb-orange: #fe8019; /* bright_orange, the wordmark */
|
||||
--gb-yellow: #fabd2f; /* bright_yellow */
|
||||
--gb-green: #b8bb26; /* bright_green */
|
||||
--gb-blue: #83a598; /* bright_blue */
|
||||
|
||||
/* What the toolbar is made of, in tiers rather than in colours, so that
|
||||
turning colour off is one block of overrides at the bottom of this file
|
||||
and not an edit to every rule.
|
||||
|
||||
The tiers are an attention hierarchy, and the order is not arbitrary: KBD
|
||||
is how you type at all on a phone, so it is the one button that must be
|
||||
findable without looking for it. Enter is the key a session asks for most.
|
||||
The window and arrow keys are movement - reached for often, but never the
|
||||
thing you are hunting for - so they are marked out as a group without
|
||||
being filled. Everything else is furniture. */
|
||||
--key-fg: var(--gb-light1);
|
||||
--key-bg: var(--gb-dark1);
|
||||
--key-border: var(--gb-dark2);
|
||||
--key-active-bg: var(--gb-dark2);
|
||||
--key-bar-bg: var(--gb-dark0-hard);
|
||||
--key-bar-border: var(--gb-dark2);
|
||||
|
||||
--key-primary-fg: var(--gb-dark0-hard);
|
||||
--key-primary-bg: var(--gb-orange);
|
||||
--key-primary-border: var(--gb-orange);
|
||||
|
||||
--key-secondary-fg: var(--gb-dark0-hard);
|
||||
--key-secondary-bg: var(--gb-green);
|
||||
--key-secondary-border: var(--gb-green);
|
||||
|
||||
/* Outlined, not coloured-in: bright_blue as text on dark1 measures 4.31:1,
|
||||
which is under the 4.5:1 an unenlarged label needs, and the label is the
|
||||
part that has to survive a phone in sunlight. The border carries the tier
|
||||
and the text stays at 8.45:1. */
|
||||
--key-nav-fg: var(--gb-light1);
|
||||
--key-nav-border: var(--gb-blue);
|
||||
|
||||
--key-armed-fg: var(--gb-dark0-hard);
|
||||
--key-armed-bg: var(--gb-blue);
|
||||
--key-locked-fg: var(--gb-dark0-hard);
|
||||
--key-locked-bg: var(--gb-yellow);
|
||||
}
|
||||
|
||||
#toolbar {
|
||||
flex: 0 0 auto;
|
||||
display: flex;
|
||||
flex-direction: column;
|
||||
gap: 4px;
|
||||
padding: 4px 4px calc(4px + env(safe-area-inset-bottom));
|
||||
background: #14161a;
|
||||
border-top: 1px solid #2a2f37;
|
||||
background: var(--key-bar-bg);
|
||||
border-top: 1px solid var(--key-bar-border);
|
||||
touch-action: manipulation;
|
||||
}
|
||||
|
||||
@@ -377,9 +431,9 @@ body.touch #terminal {
|
||||
bound is where a monospace PREFIX still fits; the upper is the size this
|
||||
has always been, so a wide screen is unchanged. */
|
||||
font: 600 clamp(10px, 2.8vw, 13px)/1 ui-monospace, SFMono-Regular, Menlo, Consolas, monospace;
|
||||
color: #d7dce3;
|
||||
background: #232830;
|
||||
border: 1px solid #343b45;
|
||||
color: var(--key-fg);
|
||||
background: var(--key-bg);
|
||||
border: 1px solid var(--key-border);
|
||||
border-radius: 6px;
|
||||
-webkit-user-select: none;
|
||||
user-select: none;
|
||||
@@ -387,21 +441,79 @@ body.touch #terminal {
|
||||
}
|
||||
|
||||
#toolbar button:active {
|
||||
background: #39414d;
|
||||
background: var(--key-active-bg);
|
||||
}
|
||||
|
||||
/* The hierarchy. Filled-warm beats filled-cool beats outlined beats plain,
|
||||
which is a ramp that survives being looked at quickly and in sunlight -
|
||||
the two conditions a phone toolbar is actually used in.
|
||||
|
||||
These sit ABOVE the latch rules on purpose. A latched CTRL and a tiered
|
||||
button match at the same specificity, so what decides is source order, and
|
||||
the state a button is IN has to beat the job it does. */
|
||||
#toolbar button[data-action="kbd"] {
|
||||
color: var(--key-primary-fg);
|
||||
background: var(--key-primary-bg);
|
||||
border-color: var(--key-primary-border);
|
||||
}
|
||||
|
||||
#toolbar button[data-action="enter"] {
|
||||
color: var(--key-secondary-fg);
|
||||
background: var(--key-secondary-bg);
|
||||
border-color: var(--key-secondary-border);
|
||||
}
|
||||
|
||||
#toolbar button[data-action="prev-window"],
|
||||
#toolbar button[data-action="next-window"],
|
||||
#toolbar button[data-action="left"],
|
||||
#toolbar button[data-action="down"],
|
||||
#toolbar button[data-action="up"],
|
||||
#toolbar button[data-action="right"] {
|
||||
color: var(--key-nav-fg);
|
||||
border-color: var(--key-nav-border);
|
||||
}
|
||||
|
||||
/* Armed for one key, versus latched on. Two states on one button, so the
|
||||
distinction has to be visible without a legend. */
|
||||
#toolbar button.is-armed {
|
||||
color: #0b0d10;
|
||||
background: #7fb3ff;
|
||||
border-color: #7fb3ff;
|
||||
color: var(--key-armed-fg);
|
||||
background: var(--key-armed-bg);
|
||||
border-color: var(--key-armed-bg);
|
||||
}
|
||||
|
||||
#toolbar button.is-locked {
|
||||
color: #0b0d10;
|
||||
background: #ffcc66;
|
||||
border-color: #ffcc66;
|
||||
color: var(--key-locked-fg);
|
||||
background: var(--key-locked-bg);
|
||||
border-color: var(--key-locked-bg);
|
||||
}
|
||||
|
||||
/* Every colour the toolbar had before it had a palette. One block, because
|
||||
the alternative is an override per rule and a way for the two to drift -
|
||||
an operator who turns colour off is asking for what was here, not for a
|
||||
second scheme to maintain. */
|
||||
body.mono-keys {
|
||||
--key-fg: #d7dce3;
|
||||
--key-bg: #232830;
|
||||
--key-border: #343b45;
|
||||
--key-active-bg: #39414d;
|
||||
--key-bar-bg: #14161a;
|
||||
--key-bar-border: #2a2f37;
|
||||
|
||||
--key-primary-fg: #d7dce3;
|
||||
--key-primary-bg: #232830;
|
||||
--key-primary-border: #343b45;
|
||||
|
||||
--key-secondary-fg: #d7dce3;
|
||||
--key-secondary-bg: #232830;
|
||||
--key-secondary-border: #343b45;
|
||||
|
||||
--key-nav-fg: #d7dce3;
|
||||
--key-nav-border: #343b45;
|
||||
|
||||
--key-armed-fg: #0b0d10;
|
||||
--key-armed-bg: #7fb3ff;
|
||||
--key-locked-fg: #0b0d10;
|
||||
--key-locked-bg: #ffcc66;
|
||||
}
|
||||
|
||||
#toast {
|
||||
@@ -744,7 +856,7 @@ body.touch #terminal {
|
||||
// an xterm.js option and is handed to the terminal untouched, which is how
|
||||
// the existing TTYD_FONT_SIZE knob keeps working with no code here knowing
|
||||
// about it. isWindows is ttyd's own, always present, and not an xterm option.
|
||||
var PAGE_KEYS = ['tmuxPrefix', 'focusOnTap'];
|
||||
var PAGE_KEYS = ['tmuxPrefix', 'focusOnTap', 'buttonColors'];
|
||||
var IGNORED_KEYS = ['isWindows'];
|
||||
|
||||
// "C-b" -> "\x02", the byte tmux is actually listening for. Deliberately
|
||||
@@ -811,6 +923,19 @@ body.touch #terminal {
|
||||
return !coarsePointer;
|
||||
}
|
||||
|
||||
// Whether the toolbar is colour-coded by what each button is for.
|
||||
//
|
||||
// On unless the operator says otherwise: the hierarchy is the point of it,
|
||||
// and a toolbar where every key looks the same is one where the key you
|
||||
// need most is found by counting positions. "off" restores exactly the grey
|
||||
// it had before, for a terminal colour scheme this clashes with or an
|
||||
// operator who would rather it were quiet.
|
||||
function buttonColorsWanted(preference) {
|
||||
if (preference === 'off' || preference === false || preference === 'false' ||
|
||||
preference === '0') return false;
|
||||
return true;
|
||||
}
|
||||
|
||||
// The address of the session picker: this page with the run-id dropped.
|
||||
//
|
||||
// ttyd passes ?arg=<run-id> to dejima-attach as argv (--url-arg), so a page
|
||||
@@ -834,6 +959,7 @@ body.touch #terminal {
|
||||
splitPreferences: splitPreferences,
|
||||
toolbarWanted: toolbarWanted,
|
||||
focusOnTapWanted: focusOnTapWanted,
|
||||
buttonColorsWanted: buttonColorsWanted,
|
||||
pickerSearch: pickerSearch
|
||||
};
|
||||
})((globalThis.DEJIMA = globalThis.DEJIMA || {}));
|
||||
@@ -1720,6 +1846,12 @@ body.touch #terminal {
|
||||
// able to change it.
|
||||
tapFocusPolicy(split.page.focusOnTap);
|
||||
|
||||
// A class rather than per-button styling: what the page decides is
|
||||
// whether there is a palette at all, and the stylesheet owns which button
|
||||
// gets which part of it.
|
||||
document.body.classList.toggle(
|
||||
'mono-keys', !D.config.buttonColorsWanted(split.page.buttonColors));
|
||||
|
||||
// A font size arriving in the preferences changes the cell size, so the
|
||||
// column count computed before it was applied is now wrong.
|
||||
viewport.refresh();
|
||||
|
||||
+3
-3
@@ -1,13 +1,13 @@
|
||||
f6f6611d0b3eacc39d10add9c4bbc56d4b3a70a47f022351a1c6eab68cd66e71 package-lock.json
|
||||
38b24a901a43db06854133f4de11094e30c590ff08074bb35bf0d664975a8cb2 src/config.js
|
||||
613d28096b1bed66f347590663f5f0136fb7f61a4578066fa2ed9e788ff9567a src/config.js
|
||||
f690fd9d35975bc977e3d323595a2a4aa1fca6ed50f213602f08adec3f5b2c92 src/gestures.js
|
||||
e75dc9d5e311a3d9bf9dc373b651ad506afbd7a7cc7ad54aac6fdad94276b0a4 src/keyboard.js
|
||||
2a070f63702b95b0c62963ec6b9ec4fa2b0b89b7553a8a889d68cdf3506f9ce3 src/keys.js
|
||||
7e2f5a89c28b048c6cc26d0a4a2a2411501f092dab11529a32ae3856f1350d63 src/main.js
|
||||
e5888ba8413fc2b442b44cade378f7393fd231dd5f79d44c58d1bc217ed7c807 src/main.js
|
||||
e3a550e2249b536c9bc3d90ee2735a9a2d8e6f772a6a631f724d289b96b1f557 src/modes.js
|
||||
8446be09a1eca041a5a2e2068fdace32596713aef1d1fb74b522ea4eacc50ec3 src/mouse.js
|
||||
cb5e33c0fa117176d9073bd9019f78b65bfe5535833bf1765ee542c700d67f1f src/osc52.js
|
||||
7af901e2df49772c42fc1e083b4db8616e7d5f04bedf21f482da766a169165b7 src/page.css
|
||||
94229c981f6287162d6ef774f71ef41d941494595f76f16bb742811ca32a767f src/page.css
|
||||
e02823ce9d5d57615a0a8c0c7b91611932202758048b7eadabe4f1054aaf1a9f src/protocol.js
|
||||
aac82e88c6a65617818c6589091cbb8c3bab50e82e98aabf8b583cbb3dfda7e7 src/sgr.js
|
||||
dab361cf748e6d530099f79ccd3f407fcc493f81dd4afeda227376a8c9e9b81f src/template.html
|
||||
|
||||
+15
-1
@@ -12,7 +12,7 @@
|
||||
// an xterm.js option and is handed to the terminal untouched, which is how
|
||||
// the existing TTYD_FONT_SIZE knob keeps working with no code here knowing
|
||||
// about it. isWindows is ttyd's own, always present, and not an xterm option.
|
||||
var PAGE_KEYS = ['tmuxPrefix', 'focusOnTap'];
|
||||
var PAGE_KEYS = ['tmuxPrefix', 'focusOnTap', 'buttonColors'];
|
||||
var IGNORED_KEYS = ['isWindows'];
|
||||
|
||||
// "C-b" -> "\x02", the byte tmux is actually listening for. Deliberately
|
||||
@@ -79,6 +79,19 @@
|
||||
return !coarsePointer;
|
||||
}
|
||||
|
||||
// Whether the toolbar is colour-coded by what each button is for.
|
||||
//
|
||||
// On unless the operator says otherwise: the hierarchy is the point of it,
|
||||
// and a toolbar where every key looks the same is one where the key you
|
||||
// need most is found by counting positions. "off" restores exactly the grey
|
||||
// it had before, for a terminal colour scheme this clashes with or an
|
||||
// operator who would rather it were quiet.
|
||||
function buttonColorsWanted(preference) {
|
||||
if (preference === 'off' || preference === false || preference === 'false' ||
|
||||
preference === '0') return false;
|
||||
return true;
|
||||
}
|
||||
|
||||
// The address of the session picker: this page with the run-id dropped.
|
||||
//
|
||||
// ttyd passes ?arg=<run-id> to dejima-attach as argv (--url-arg), so a page
|
||||
@@ -102,6 +115,7 @@
|
||||
splitPreferences: splitPreferences,
|
||||
toolbarWanted: toolbarWanted,
|
||||
focusOnTapWanted: focusOnTapWanted,
|
||||
buttonColorsWanted: buttonColorsWanted,
|
||||
pickerSearch: pickerSearch
|
||||
};
|
||||
})((globalThis.DEJIMA = globalThis.DEJIMA || {}));
|
||||
|
||||
@@ -110,6 +110,12 @@
|
||||
// able to change it.
|
||||
tapFocusPolicy(split.page.focusOnTap);
|
||||
|
||||
// A class rather than per-button styling: what the page decides is
|
||||
// whether there is a palette at all, and the stylesheet owns which button
|
||||
// gets which part of it.
|
||||
document.body.classList.toggle(
|
||||
'mono-keys', !D.config.buttonColorsWanted(split.page.buttonColors));
|
||||
|
||||
// A font size arriving in the preferences changes the cell size, so the
|
||||
// column count computed before it was applied is now wrong.
|
||||
viewport.refresh();
|
||||
|
||||
+124
-12
@@ -42,14 +42,68 @@ body.touch #terminal {
|
||||
-webkit-touch-callout: none;
|
||||
}
|
||||
|
||||
/* gruvbox dark, the same values bin/dejima-attach uses for the session
|
||||
picker, each tagged with its upstream color.table name so a wrong hex is
|
||||
catchable by reading. The two sit either side of one attach: picker, then
|
||||
terminal. They should not look like different programs.
|
||||
https://github.com/gruvbox-community/gruvbox-contrib/blob/master/color.table */
|
||||
:root {
|
||||
--gb-dark0-hard: #1d2021;
|
||||
--gb-dark0: #282828;
|
||||
--gb-dark1: #3c3836;
|
||||
--gb-dark2: #504945;
|
||||
--gb-light1: #ebdbb2;
|
||||
--gb-orange: #fe8019; /* bright_orange, the wordmark */
|
||||
--gb-yellow: #fabd2f; /* bright_yellow */
|
||||
--gb-green: #b8bb26; /* bright_green */
|
||||
--gb-blue: #83a598; /* bright_blue */
|
||||
|
||||
/* What the toolbar is made of, in tiers rather than in colours, so that
|
||||
turning colour off is one block of overrides at the bottom of this file
|
||||
and not an edit to every rule.
|
||||
|
||||
The tiers are an attention hierarchy, and the order is not arbitrary: KBD
|
||||
is how you type at all on a phone, so it is the one button that must be
|
||||
findable without looking for it. Enter is the key a session asks for most.
|
||||
The window and arrow keys are movement - reached for often, but never the
|
||||
thing you are hunting for - so they are marked out as a group without
|
||||
being filled. Everything else is furniture. */
|
||||
--key-fg: var(--gb-light1);
|
||||
--key-bg: var(--gb-dark1);
|
||||
--key-border: var(--gb-dark2);
|
||||
--key-active-bg: var(--gb-dark2);
|
||||
--key-bar-bg: var(--gb-dark0-hard);
|
||||
--key-bar-border: var(--gb-dark2);
|
||||
|
||||
--key-primary-fg: var(--gb-dark0-hard);
|
||||
--key-primary-bg: var(--gb-orange);
|
||||
--key-primary-border: var(--gb-orange);
|
||||
|
||||
--key-secondary-fg: var(--gb-dark0-hard);
|
||||
--key-secondary-bg: var(--gb-green);
|
||||
--key-secondary-border: var(--gb-green);
|
||||
|
||||
/* Outlined, not coloured-in: bright_blue as text on dark1 measures 4.31:1,
|
||||
which is under the 4.5:1 an unenlarged label needs, and the label is the
|
||||
part that has to survive a phone in sunlight. The border carries the tier
|
||||
and the text stays at 8.45:1. */
|
||||
--key-nav-fg: var(--gb-light1);
|
||||
--key-nav-border: var(--gb-blue);
|
||||
|
||||
--key-armed-fg: var(--gb-dark0-hard);
|
||||
--key-armed-bg: var(--gb-blue);
|
||||
--key-locked-fg: var(--gb-dark0-hard);
|
||||
--key-locked-bg: var(--gb-yellow);
|
||||
}
|
||||
|
||||
#toolbar {
|
||||
flex: 0 0 auto;
|
||||
display: flex;
|
||||
flex-direction: column;
|
||||
gap: 4px;
|
||||
padding: 4px 4px calc(4px + env(safe-area-inset-bottom));
|
||||
background: #14161a;
|
||||
border-top: 1px solid #2a2f37;
|
||||
background: var(--key-bar-bg);
|
||||
border-top: 1px solid var(--key-bar-border);
|
||||
touch-action: manipulation;
|
||||
}
|
||||
|
||||
@@ -75,9 +129,9 @@ body.touch #terminal {
|
||||
bound is where a monospace PREFIX still fits; the upper is the size this
|
||||
has always been, so a wide screen is unchanged. */
|
||||
font: 600 clamp(10px, 2.8vw, 13px)/1 ui-monospace, SFMono-Regular, Menlo, Consolas, monospace;
|
||||
color: #d7dce3;
|
||||
background: #232830;
|
||||
border: 1px solid #343b45;
|
||||
color: var(--key-fg);
|
||||
background: var(--key-bg);
|
||||
border: 1px solid var(--key-border);
|
||||
border-radius: 6px;
|
||||
-webkit-user-select: none;
|
||||
user-select: none;
|
||||
@@ -85,21 +139,79 @@ body.touch #terminal {
|
||||
}
|
||||
|
||||
#toolbar button:active {
|
||||
background: #39414d;
|
||||
background: var(--key-active-bg);
|
||||
}
|
||||
|
||||
/* The hierarchy. Filled-warm beats filled-cool beats outlined beats plain,
|
||||
which is a ramp that survives being looked at quickly and in sunlight -
|
||||
the two conditions a phone toolbar is actually used in.
|
||||
|
||||
These sit ABOVE the latch rules on purpose. A latched CTRL and a tiered
|
||||
button match at the same specificity, so what decides is source order, and
|
||||
the state a button is IN has to beat the job it does. */
|
||||
#toolbar button[data-action="kbd"] {
|
||||
color: var(--key-primary-fg);
|
||||
background: var(--key-primary-bg);
|
||||
border-color: var(--key-primary-border);
|
||||
}
|
||||
|
||||
#toolbar button[data-action="enter"] {
|
||||
color: var(--key-secondary-fg);
|
||||
background: var(--key-secondary-bg);
|
||||
border-color: var(--key-secondary-border);
|
||||
}
|
||||
|
||||
#toolbar button[data-action="prev-window"],
|
||||
#toolbar button[data-action="next-window"],
|
||||
#toolbar button[data-action="left"],
|
||||
#toolbar button[data-action="down"],
|
||||
#toolbar button[data-action="up"],
|
||||
#toolbar button[data-action="right"] {
|
||||
color: var(--key-nav-fg);
|
||||
border-color: var(--key-nav-border);
|
||||
}
|
||||
|
||||
/* Armed for one key, versus latched on. Two states on one button, so the
|
||||
distinction has to be visible without a legend. */
|
||||
#toolbar button.is-armed {
|
||||
color: #0b0d10;
|
||||
background: #7fb3ff;
|
||||
border-color: #7fb3ff;
|
||||
color: var(--key-armed-fg);
|
||||
background: var(--key-armed-bg);
|
||||
border-color: var(--key-armed-bg);
|
||||
}
|
||||
|
||||
#toolbar button.is-locked {
|
||||
color: #0b0d10;
|
||||
background: #ffcc66;
|
||||
border-color: #ffcc66;
|
||||
color: var(--key-locked-fg);
|
||||
background: var(--key-locked-bg);
|
||||
border-color: var(--key-locked-bg);
|
||||
}
|
||||
|
||||
/* Every colour the toolbar had before it had a palette. One block, because
|
||||
the alternative is an override per rule and a way for the two to drift -
|
||||
an operator who turns colour off is asking for what was here, not for a
|
||||
second scheme to maintain. */
|
||||
body.mono-keys {
|
||||
--key-fg: #d7dce3;
|
||||
--key-bg: #232830;
|
||||
--key-border: #343b45;
|
||||
--key-active-bg: #39414d;
|
||||
--key-bar-bg: #14161a;
|
||||
--key-bar-border: #2a2f37;
|
||||
|
||||
--key-primary-fg: #d7dce3;
|
||||
--key-primary-bg: #232830;
|
||||
--key-primary-border: #343b45;
|
||||
|
||||
--key-secondary-fg: #d7dce3;
|
||||
--key-secondary-bg: #232830;
|
||||
--key-secondary-border: #343b45;
|
||||
|
||||
--key-nav-fg: #d7dce3;
|
||||
--key-nav-border: #343b45;
|
||||
|
||||
--key-armed-fg: #0b0d10;
|
||||
--key-armed-bg: #7fb3ff;
|
||||
--key-locked-fg: #0b0d10;
|
||||
--key-locked-bg: #ffcc66;
|
||||
}
|
||||
|
||||
#toast {
|
||||
|
||||
+30
-1
@@ -4,7 +4,7 @@ const assert = require('node:assert');
|
||||
require('../src/keys.js'); // config.js parses the tmux prefix through it
|
||||
require('../src/config.js');
|
||||
const { DEFAULT_TMUX_PREFIX, parsePrefix, splitPreferences, toolbarWanted,
|
||||
focusOnTapWanted, pickerSearch } = globalThis.DEJIMA.config;
|
||||
focusOnTapWanted, pickerSearch, buttonColorsWanted } = globalThis.DEJIMA.config;
|
||||
|
||||
test('a tmux prefix is parsed into the byte tmux would receive', () => {
|
||||
assert.equal(parsePrefix('C-b'), '\x02');
|
||||
@@ -116,3 +116,32 @@ test('the picker address is already the picker when there is no run-id', () => {
|
||||
assert.equal(pickerSearch(''), '');
|
||||
assert.equal(pickerSearch('?toolbar=1'), '?toolbar=1');
|
||||
});
|
||||
|
||||
// The toolbar's colours are on unless the operator turns them off: the
|
||||
// hierarchy is the point of them, and a toolbar where every key looks alike is
|
||||
// one where the key you need most is found by counting positions.
|
||||
|
||||
test('the toolbar is coloured when nothing says otherwise', () => {
|
||||
assert.equal(buttonColorsWanted(undefined), true);
|
||||
assert.equal(buttonColorsWanted(''), true);
|
||||
assert.equal(buttonColorsWanted('on'), true);
|
||||
});
|
||||
|
||||
test('off turns the toolbar grey, in dejima\'s own bool spelling', () => {
|
||||
// ttyd_button_colors is a dejima bool, so what reaches the page is "off" -
|
||||
// not "false". Accepting only the latter would ship a documented key that
|
||||
// does nothing, which is exactly what focusOnTap nearly did.
|
||||
assert.equal(buttonColorsWanted('off'), false);
|
||||
assert.equal(buttonColorsWanted(false), false);
|
||||
assert.equal(buttonColorsWanted('false'), false);
|
||||
assert.equal(buttonColorsWanted('0'), false);
|
||||
});
|
||||
|
||||
test('buttonColors is a page option, not one xterm is handed', () => {
|
||||
// Every page key that reached term.options would be an unknown option to
|
||||
// xterm.js, which is the failure splitPreferences exists to prevent.
|
||||
const split = splitPreferences({ buttonColors: 'off', fontSize: 14 });
|
||||
assert.equal(split.page.buttonColors, 'off');
|
||||
assert.equal(split.terminal.buttonColors, undefined);
|
||||
assert.equal(split.terminal.fontSize, 14);
|
||||
});
|
||||
|
||||
@@ -0,0 +1,106 @@
|
||||
'use strict';
|
||||
const { test } = require('node:test');
|
||||
const assert = require('node:assert');
|
||||
const fs = require('node:fs');
|
||||
const path = require('node:path');
|
||||
|
||||
// Every label the toolbar draws has to be readable on a phone held outdoors,
|
||||
// which is the only place this page is ever used. WCAG AA asks 4.5:1 for text
|
||||
// this size, and one of these pairings shipped at 4.31:1 in the first draft -
|
||||
// gruvbox's bright_blue as a label on dark1 - which is a difference nobody
|
||||
// catches by looking at a screenshot on a desk.
|
||||
//
|
||||
// Read out of the stylesheet rather than restated here, so a colour changed
|
||||
// there is a colour checked here.
|
||||
|
||||
const CSS = fs.readFileSync(path.join(__dirname, '..', 'src', 'page.css'), 'utf8');
|
||||
|
||||
function declarationsIn(block) {
|
||||
const out = {};
|
||||
const re = /^\s*(--[a-z0-9-]+):\s*([^;]+);/gm;
|
||||
let m;
|
||||
while ((m = re.exec(block)) !== null) out[m[1]] = m[2].trim();
|
||||
return out;
|
||||
}
|
||||
|
||||
function blockFor(selector) {
|
||||
const start = CSS.indexOf(selector + ' {');
|
||||
assert.notEqual(start, -1, 'no ' + selector + ' block in page.css');
|
||||
const end = CSS.indexOf('\n}', start);
|
||||
return CSS.slice(start, end);
|
||||
}
|
||||
|
||||
// var(--x) chains down to a literal hex.
|
||||
function resolve(vars, value, depth) {
|
||||
depth = depth || 0;
|
||||
assert.ok(depth < 10, 'variable cycle resolving ' + value);
|
||||
const m = /^var\((--[a-z0-9-]+)\)$/.exec(value);
|
||||
if (!m) return value;
|
||||
assert.ok(vars[m[1]], 'undefined variable ' + m[1]);
|
||||
return resolve(vars, vars[m[1]], depth + 1);
|
||||
}
|
||||
|
||||
function luminance(hex) {
|
||||
const h = hex.replace('#', '');
|
||||
const parts = [0, 2, 4].map((i) => parseInt(h.slice(i, i + 2), 16) / 255);
|
||||
const lin = parts.map((c) => (c <= 0.04045 ? c / 12.92 : Math.pow((c + 0.055) / 1.055, 2.4)));
|
||||
return 0.2126 * lin[0] + 0.7152 * lin[1] + 0.0722 * lin[2];
|
||||
}
|
||||
|
||||
function contrast(fg, bg) {
|
||||
const a = luminance(fg);
|
||||
const b = luminance(bg);
|
||||
return (Math.max(a, b) + 0.05) / (Math.min(a, b) + 0.05);
|
||||
}
|
||||
|
||||
// Each tier's label against the surface it is drawn on. The nav tier is
|
||||
// outlined rather than filled, so its label sits on the ordinary key
|
||||
// background - which is precisely why its colour matters.
|
||||
const PAIRINGS = [
|
||||
['plain keys', '--key-fg', '--key-bg'],
|
||||
['the nav tier', '--key-nav-fg', '--key-bg'],
|
||||
['KBD', '--key-primary-fg', '--key-primary-bg'],
|
||||
['Enter', '--key-secondary-fg', '--key-secondary-bg'],
|
||||
['an armed latch', '--key-armed-fg', '--key-armed-bg'],
|
||||
['a locked latch', '--key-locked-fg', '--key-locked-bg']
|
||||
];
|
||||
|
||||
function checkBlock(selector) {
|
||||
const vars = declarationsIn(blockFor(selector));
|
||||
PAIRINGS.forEach(([what, fgVar, bgVar]) => {
|
||||
assert.ok(vars[fgVar], selector + ' does not set ' + fgVar);
|
||||
assert.ok(vars[bgVar], selector + ' does not set ' + bgVar);
|
||||
const fg = resolve(vars, vars[fgVar]);
|
||||
const bg = resolve(vars, vars[bgVar]);
|
||||
const ratio = contrast(fg, bg);
|
||||
assert.ok(
|
||||
ratio >= 4.5,
|
||||
what + ' in ' + selector + ' is ' + fg + ' on ' + bg + ' at ' +
|
||||
ratio.toFixed(2) + ':1, under the 4.5:1 a label this size needs'
|
||||
);
|
||||
});
|
||||
}
|
||||
|
||||
test('every toolbar label meets AA against what it is drawn on', () => {
|
||||
checkBlock(':root');
|
||||
});
|
||||
|
||||
test('turning the colours off does not turn legibility off with them', () => {
|
||||
// The grey scheme is a supported mode, not a fallback nobody looks at.
|
||||
checkBlock('body.mono-keys');
|
||||
});
|
||||
|
||||
test('the tiers are actually distinct, or the hierarchy is decoration', () => {
|
||||
const vars = declarationsIn(blockFor(':root'));
|
||||
const bg = (v) => resolve(vars, vars[v]);
|
||||
const primary = bg('--key-primary-bg');
|
||||
const secondary = bg('--key-secondary-bg');
|
||||
const plain = bg('--key-bg');
|
||||
assert.notEqual(primary, secondary, 'KBD and Enter are filled the same colour');
|
||||
assert.notEqual(primary, plain, 'KBD is filled the same as an ordinary key');
|
||||
assert.notEqual(secondary, plain, 'Enter is filled the same as an ordinary key');
|
||||
assert.notEqual(
|
||||
resolve(vars, vars['--key-nav-border']), resolve(vars, vars['--key-border']),
|
||||
'the nav tier is outlined the same as an ordinary key'
|
||||
);
|
||||
});
|
||||
@@ -10,7 +10,10 @@ Git workflow - do this even though nothing stops you from doing otherwise:
|
||||
branch-finishing advice from a skill cannot know that, and does not
|
||||
override it.
|
||||
- Stop at the push. Do not open a pull request, and do not merge anything -
|
||||
neither is part of this workflow. Report the branch name and stop.
|
||||
neither is part of this workflow. A `merge-guard.sh` hook and a shadow over
|
||||
the forge's own command both refuse a merge here, but treat that as the
|
||||
workflow rather than as a filter to route around. Report the branch name
|
||||
and stop.
|
||||
- Never push directly to {{blocked_branches}}, on any remote. A
|
||||
`git-push-guard.sh` hook enforces that as a backstop, but treat it as the
|
||||
workflow to follow rather than a filter to route around.
|
||||
|
||||
@@ -1,9 +1,14 @@
|
||||
# block_merge is off despite this being a pushing workflow: nothing here ever
|
||||
# reaches a forge's PR interface, so there is no merge command to block.
|
||||
requires =
|
||||
push = on
|
||||
blocked_branches = main master
|
||||
block_merge = off
|
||||
# This said "off" and gave a reason: nothing here ever reaches a forge's PR
|
||||
# interface, so there is no merge command to block. The premise is false. What
|
||||
# the briefing tells the agent to do and what the image puts on its PATH are
|
||||
# different things - select forge = gitea and `gitea-pr merge` is present
|
||||
# whatever the workflow says, because the CLI is installed by the forge, not
|
||||
# by the workflow. This workflow's own briefing says "do not merge anything",
|
||||
# and until now nothing held it to that.
|
||||
block_merge = on
|
||||
requires_worktree = on
|
||||
autonomy = push-branch
|
||||
briefing = briefing.md
|
||||
|
||||
@@ -3,7 +3,7 @@ Git workflow - do this even though nothing stops you from doing otherwise:
|
||||
anywhere: there is no remote destination configured for it, and
|
||||
`git-push-guard.sh` blocks pushes as a backstop.
|
||||
- Do not open pull requests and do not merge. Neither is part of this
|
||||
workflow.
|
||||
workflow, and a merge is refused here in any case.
|
||||
- Report what you committed and stop. If the work needs to reach a remote,
|
||||
say so plainly rather than attempting it - that is the operator's call and
|
||||
needs a different workflow.
|
||||
|
||||
@@ -3,7 +3,12 @@
|
||||
requires =
|
||||
push = off
|
||||
blocked_branches =
|
||||
block_merge = off
|
||||
# On for the same reason branch-push's is: this workflow may be selected
|
||||
# alongside a forge, its briefing says "do not open pull requests and do not
|
||||
# merge", and the forge's CLI is on PATH regardless of what the workflow tells
|
||||
# the agent to do. A briefing that states a rule while the manifest leaves the
|
||||
# guard off is asserting something nothing holds.
|
||||
block_merge = on
|
||||
requires_worktree = off
|
||||
autonomy = commit
|
||||
briefing = briefing.md
|
||||
|
||||
Reference in New Issue
Block a user