Skip to content

test(market-making): add MKT-1491 workflow e2e coverage - #112

Open
prd-carapulse[bot] wants to merge 3 commits into
mainfrom
hermes/mkt-1491-e2e-tests
Open

test(market-making): add MKT-1491 workflow e2e coverage#112
prd-carapulse[bot] wants to merge 3 commits into
mainfrom
hermes/mkt-1491-e2e-tests

Conversation

@prd-carapulse

@prd-carapulse prd-carapulse Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Why

The market-making bot needs a deterministic regression boundary before V0 is operated unattended. The prior workflow tests injected in-memory application ports, so they could not detect regressions in production composition, Router HTTP DTOs, SDK encoding/signing, Midnight transactions, or forked on-chain state.

Why now

MKT-1491 requires genuine E2E coverage before the V0 market-making workflow is relied on operationally.

What changed

  • replace the in-memory E2E implementation with Anvil tests pinned to Base block 48,900,000
  • add production ladder composition for live position/rate reads, offer construction, SDK signing, mempool publication, on-chain invalidation, and cleanup-aware shutdown
  • add a stateful Router HTTP fixture that indexes actual mempool transactions and reads real forked Midnight consumption state, including snapshot/reorg handling
  • exercise setup success plus isolated fork/provider failure for chain, maker, native balance, allowance, ratifier, books, reference, and offers
  • exercise bootstrap with no, partial, and full credit; production ladder publish/rest/recenter/abandon; cleanup disabled/enabled; and fail-closed credit-sale suppression when cost basis is unavailable
  • cap fresh lend room after current and cross-market credit, preserve intended rung rates across tick round-trips, and surface extra owned rungs for cleanup
  • verify the production-supported spread direction: prospective bootstrap buy against a real external sell, with strict crossing and equality rejected and the adjacent aligned safe tick accepted
  • harden the ladder adapter with explicit durable group ownership, bounded pagination, whole-book reads, replacement-aware multi-market capacity, shared-rung grouping, sparse-index recovery, exhaustive hard-halt cleanup, and uint32 fee validation
  • wire the production ladder into the default CLI, allowlist its durable groups in setup readiness, and derive aggregate room from the configured total exposure cap
  • retire the former in-memory Router and workflow-test implementations

Verification

  • canonical Morpho Base archive RPC: raw eth_chainId returned 8453 and block 48,900,000 was available
  • PATH=/home/hermes/.bun/bin:$PATH RPC_URL_8453=<canonical Morpho Base archive RPC> bun test bots/market-making/test/e2e/market-making.fork.e2e.test.ts bots/market-making/test/e2e/setup-check.e2e.test.ts12 passed, 0 failed, 108 assertions
  • PATH=/home/hermes/.bun/bin:$PATH RPC_URL_8453=<canonical Morpho Base archive RPC> bun test bots/market-making/test408 passed, 0 failed, 1,097 assertions
  • bun run --filter @morpho-org/market-making-bot typecheck — passed
  • bun run --filter @morpho-org/market-making-bot jsdoc:build — passed; 216 public declarations inventoried and HTML generated
  • bun lint — 0 warnings, 0 errors
  • bun knip — passed
  • bun format — passed; no working-tree changes
  • git diff --check origin/main...HEAD — passed
  • Semgrep security-audit scan of all 23 PR files — 0 findings (22 rules)

Linear: https://linear.app/morpho-labs/issue/MKT-1491/add-e2e-testing-for-each-step
TIB: https://github.com/morpho-org/morpho-bots/blob/main/docs/decisions/TIB-2026-07-27-midnight-market-making-bot.md

Requested by: @julien (Slack)

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Devin Review found 2 potential issues.

Open in Devin Review

Comment thread bots/market-making/test/e2e/mock-router.ts Outdated
Comment thread bots/market-making/test/e2e/mock-router.ts Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 53ed32453c

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread bots/market-making/test/e2e/mock-router.ts Outdated
Comment thread bots/market-making/test/e2e/mock-router.ts Outdated
Comment thread bots/market-making/test/e2e/market-making.e2e.test.ts Outdated
Comment thread bots/market-making/test/e2e/mock-router.ts Outdated
@prd-carapulse

prd-carapulse Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor Author

Current-head follow-up: hardened mock ladder fills against non-positive, over-published, and over-credit amounts; added partial/full rung-consumption coverage; counted individual rungs; and added strict-cross plus adjacent-safe spread cases.

Scope blocker: cleanup-enabled lifecycle coverage and existing-buy/prospective-sell coverage have no production path on the current branch. The composition root exposes setup-check and one-shot bootstrap only, with no startup/shutdown cleanup boundary and no composed production ladder make adapter. The prior direct mock hard-halt test was removed rather than presenting a test-only method as production E2E coverage.

Head: 63b9fa840864dc33edbda3fd4dd6ca1b383f6d28.

@julien-devatom

Copy link
Copy Markdown
Collaborator

@codex review

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. You're on a roll.

Reviewed commit: 63b9fa8408

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

@prd-carapulse

prd-carapulse Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor Author

<@U09LHAWUK3M> review

3 similar comments
@prd-carapulse

prd-carapulse Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor Author

<@U09LHAWUK3M> review

@prd-carapulse

prd-carapulse Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor Author

<@U09LHAWUK3M> review

@prd-carapulse

prd-carapulse Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor Author

<@U09LHAWUK3M> review

Comment thread bots/market-making/src/infrastructure/ladder/ladder-transaction.utils.ts Outdated
@julien-devatom

Copy link
Copy Markdown
Collaborator

@codex review

1 similar comment
@prd-carapulse

prd-carapulse Bot commented Jul 30, 2026

Copy link
Copy Markdown
Contributor Author

@codex review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 757f768ae0

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread bots/market-making/test/e2e/market-making.fork.e2e.test.ts Outdated
Comment thread bots/market-making/src/infrastructure/ladder/production-ladder.ts Outdated
Comment thread bots/market-making/src/infrastructure/ladder/production-ladder.ts Outdated
Comment thread bots/market-making/src/infrastructure/ladder/ladder-groups.utils.ts Outdated
Comment thread bots/market-making/src/infrastructure/ladder/ladder-offer.utils.ts Outdated
Comment thread bots/market-making/src/infrastructure/ladder/ladder-offer.utils.ts Outdated
Comment thread bots/market-making/src/infrastructure/ladder/ladder-make.service.ts Outdated
Comment thread bots/market-making/src/infrastructure/ladder/production-ladder.ts Outdated
Comment thread bots/market-making/src/infrastructure/ladder/production-ladder.ts Outdated
Comment thread bots/market-making/src/infrastructure/ladder/ladder-offer.utils.ts
@prd-carapulse
prd-carapulse Bot force-pushed the hermes/mkt-1491-e2e-tests branch from e825326 to 45856c1 Compare July 30, 2026 09:04
@prd-carapulse

prd-carapulse Bot commented Jul 30, 2026

Copy link
Copy Markdown
Contributor Author

@codex review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 45856c12f9

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread bots/market-making/src/infrastructure/ladder/ladder-capacity.utils.ts Outdated
Comment thread bots/market-making/src/infrastructure/ladder/production-ladder.ts
Comment thread bots/market-making/src/infrastructure/ladder/production-ladder.ts Outdated
@prd-carapulse

prd-carapulse Bot commented Jul 30, 2026

Copy link
Copy Markdown
Contributor Author

@codex review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: d2eb9dfba8

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread bots/market-making/src/infrastructure/ladder/ladder-capacity.utils.ts Outdated
Comment thread bots/market-making/src/infrastructure/ladder/ladder-offer.utils.ts Outdated
Comment thread bots/market-making/src/infrastructure/ladder/ladder-capacity.utils.ts Outdated
Comment thread bots/market-making/src/infrastructure/ladder/ladder-offer.utils.ts Outdated
@prd-carapulse

prd-carapulse Bot commented Jul 30, 2026

Copy link
Copy Markdown
Contributor Author

@codex review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 32c48ac602

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

JSON.stringify({
strategy: 'ladder',
maker: config.maker,
marketIds: config.marketIds.toSorted()

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Use a stable namespace for ladder ownership

When an operator adds a ladder market after publishing groups for an existing market, including the full marketIds list in this hash changes the state filename, so ownership.read() no longer returns the already-live groups. The default setup gate only allowlists groups read from the current namespace before constructing the ladder writer, so those live ladder groups become unknownNamespaces and the normal mm ladder path is blocked before it can replace or invalidate them; key ownership by a stable maker/strategy namespace, or read/migrate prior market-list namespaces.

Useful? React with 👍 / 👎.

market: parameters.market.params,
buy: side === 'higher',
maker: parameters.maker,
tick: tickAtRate(rung.rateBps, parameters.market, parameters.timestamp),

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Validate the rounded ladder tick against hard bounds

For lower-side rungs configured at or near minimumRateBps, TickLib.priceToTick rounds the target price up to the next accessible tick, which corresponds to an APR below the requested rung rate when the rate is not exactly on tick spacing. generateLadder only checked the pre-rounded rung.rateBps, and after this tick assignment there is no check that the encoded offer still satisfies the documented hard range (docs/decisions/TIB-2026-07-27-midnight-market-making-bot.md:446), so the bot can publish a ladder offer outside the operator's minimum rate bound.

Useful? React with 👍 / 👎.


const read = async (): Promise<LadderOwnedGroup[]> => {
try {
const parsed = JSON.parse(await readFile(path, 'utf8')) as Record<string, unknown>

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Reject insecure ladder ownership files

In environments where XDG_STATE_HOME or this state file is pre-created or shared, this reads and trusts the path without the regular-file, symlink, mode, and owner checks that the bootstrap ownership reader applies before parsing. A poisoned ladder state file can inject group IDs into both setup allowlisting and activeOwnedIds, hiding unknown groups from readiness and causing reconcile or hard-halt to target groups the ladder strategy did not persist itself; fail closed on insecure metadata before parsing.

Useful? React with 👍 / 👎.

parameters.currentCredit < parameters.creditSaleCapacityAssets
? parameters.currentCredit
: parameters.creditSaleCapacityAssets
const market = cash + credit

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Subtract current credit from market ladder room

When a ladder market already has accrued credit but still has wallet cash, this reports the target-market capacity as the new cash room plus sellable credit, without subtracting currentCredit from the per-market target exposure. Since generateLadder later also receives the static targetMarketExposureAssets, a market with 90 credit, a 100 target cap, 100 cash, and plenty of total room can still publish 100 higher-rate lend assets, letting fills push that market far over its configured cap; derive market room from the remaining target cap before exposing fresh lend capacity.

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant