Communitygithub.com

austin-starks/Public-Portfolio-Challenge

單次觸碰鎖盒——在設計凍結後,對從每個摺疊、掃描和搜尋中保留的視窗僅執行一次的最終反過擬合保留測試。用於在部署前確定競賽優勝者、將 A/B/C 基準設定為 OOS 橫條,或執行 S1.5 閘門一致性自動放寬。

Public-Portfolio-Challenge 是什麼?

此技能定義了「單次觸碰鎖盒」(Single-Touch Lockbox)概念,這是一個嚴格的保留資料視窗,在模型搜尋或摺疊過程中絕不被觸及,以防止日曆擬合選擇壓力。鎖盒與常用的「前向驗證 OOS 摺疊」不同,後者在搜尋期間可重複使用;鎖盒僅在設計完全凍結後觸碰一次。技能詳細說明了鎖盒的條件(例如 OOS 報酬需大於最差單一摺疊、最大回撤 ≤ 55%、部位清晰、廣度足夠),以及一旦檢視鎖盒結果後重新迭代設計就會「燒毀」鎖盒的規則。此外,它還涵蓋了三個用於比較的基準(A/B/C),其中 A 為權益買入持有、B 為簡化 LEAP 梯子、C 為凍結的現行標竿。最後,技能引入了 S1.5 階段的「閘門一致性自動放寬」機制:若 B 基準的部署比例過高(約 95%)導致新策略無法在 ≤55% 的倉位上限下超越 B,則系統會自動降低 B 的總預算,使其中位數日部署降至 ≤55%,再重新評分,使基準與策略可比較,而不放寬閘門本身。此技能主要用於 Claude Code、Cursor 或類似 AI 代理開發環境中,透過明確的規則和自動化檢查來強化嚴格的回測驗證流程。

相容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/austin-starks/Public-Portfolio-Challenge/tree/HEAD/skills/lockbox-holdout

在你喜歡的 AI 中提問

開啟一個已預先載入此 Agent Skill 的新對話。

說明文件

單次觸碰鎖盒與基準

鎖盒是一個最終的保留資料集,所有摺疊、掃描或搜尋都不得觸碰——這是對抗日曆擬合選擇壓力的最後一道防線。它與在前向驗證中反覆使用的前向驗證 OOS 摺疊(walk-forward-oos)截然不同;鎖盒僅被觸碰一次。

鎖盒

  • 是什麼: 前向驗證跨度在執行日期之前停止 lockbox_width_days = 126(約 6 個月)。該最終視窗 (執行日期 − 126 天) → 執行日期 即為鎖盒——從所有摺疊、所有掃描、所有搜尋中保留。
  • 如何運作: 只有已在每個閘門上都通過前向驗證總和且已組裝成部署形狀的組合書,才能在設計凍結後(S2 階段)恰好一次地在鎖盒上執行。
  • 通過條件(在 S0 階段凍結,看到結果後不得更改):
    • 鎖盒 OOS 報酬 ≥ 最差單一摺疊的前向驗證 OOS 報酬;
    • 鎖盒最大回撤 ≤ 55%;
    • 部位清晰(audit_backtest_posture,全部四個條件);
    • 廣度 ≥ 9 個合格標的(audit_backtest_breadth——參見 廣度審計)。

單次觸碰是絕對的

如果你查看了鎖盒結果然後迭代設計,該鎖盒就被燒毀了——在部署前將前向驗證跨度向後移動並保留一個新的尾部。鎖盒失敗被視為日曆擬合選擇壓力,意味著不部署,除非經過記錄在案的擁有者覆蓋並明確命名該鎖盒。

三個基準(A/B/C)作為 OOS 橫條(S1 階段)

透過 create_portfolio 從已提交的 snapshots/*.json 載入。使用當前引擎對 A 和 B 進行評分;直接複製 C 的已凍結公開數字作為超越標竿。

  • A — 權益買入持有(完整標的池)。僅為報酬橫條,絕非 Sortino 橫條——其 Sortino 反映了權益市場上漲的平滑性,這是槓桿化長偏多組合書無法比擬的。
  • B — 簡化 LEAP 梯子(標準規格:所有標的,無排序/篩選,14 天節奏,每個標的佔投資組合 8%,預算使用率 95% 以下,結構 = 第一個可負擔的梯級 [Δ0.50 買權 → Δ0.55/0.25 → Δ0.55/0.40 → Δ0.50/0.42 垂直價差],所有合約 180–365 天到期,單一退出點於到期天數 ≤ 45)。僅在廣度 ≥ 9/20 的摺疊中作為 Sortino 橫條。
  • C — 凍結的現行標竿,附有已發布的每個摺疊 OOS 數字,逐字複製(不要重新執行以「改進」它們)。

S1.5 — 閘門一致性自動放寬(確定性,無需擁有者往返)

在設計之前,檢查「超越基準 B」和 ≤55% 倉位上限是否可同時滿足——B 是一個約 95% 部署的組合書,因此受倉位上限限制的最終候選方案無法超越其部署程度。如果不可滿足,則自動放寬基準 B:降低 B 的 totalBudget 直到其中位數日部署 ≤ 55%,重新執行其 S1 評分,並記錄原始 B 與倉位匹配後的 B。這不是閘門放寬也不是擁有者決策——僅使基準變得可比較;閾值保持凍結。

Individual skills in this repo

This repo contains 11 individual skills — each has its own dedicated page.

austin-starks/Public-Portfolio-Challenge

Build alternative-data custom indicators on NexusTrade (Reddit/WSB mentions, congressional disclosures, insider filings, news-flow) and wire them into a certified book as a rank/tilt/filter signal. Use when adding alt-data to a strategy, building a CustomIndicator via compute sessions, auditing lookahead safety or per-ticker coverage, or deciding whether a data series is dense enough to drive a rank. Covers the compute-session workflow, the sparse-series rule, and source recipes (see references/). Invoke with the NexusTrade MCP connected.

austin-starks/Public-Portfolio-Challenge

Measure a NexusTrade options book's TRUE participation at a fixed cold-start capital base, defeating the compounded-NAV breadth illusion. Use whenever a book's headline \"holds N/21 names\" needs validating, when a live book collapses to a single name (the OSCR trap), when checking whether a SelectTop / per-name-allocation / total-budget change degraded simultaneous participation, or when a certification needs a breadth gate. Uses audit_backtest_breadth at held-fixed $25k.

austin-starks/Public-Portfolio-Challenge

The \"loudly declare\" protocol for platform, engine, or data bugs during a NexusTrade certification campaign — bugs are a first-class deliverable, not something to route around. Use whenever a NexusTrade tool errors, hangs, or returns numbers that contradict the config; whenever you're tempted to write \"probably an engine quirk\"; or when a discovered bug invalidates prior backtests and results must be quarantined. Includes the bug hand-off doc template (see references/BUG_TEMPLATE.md).

austin-starks/Public-Portfolio-Challenge

The GATED deploy + cleanup flow for a NexusTrade live book — clone the finalist, preview a delta reconcile, stage UNAPPROVED orders, verify fills. Use ONLY after the human explicitly says \"deploy + clean up\" and names a finalist. Covers the clone-before-reconcile ordering, the single-tick reconcile expectation, stale-pending-order hygiene, the signal-freshness gate, and why you can never approve orders yourself. Nothing here runs during certification.

austin-starks/Public-Portfolio-Challenge

The mandatory pre-flight contract checks (Stage S0) that must pass before trusting NexusTrade's certification engine for any strategy work. Use at the start of a bakeoff or certification campaign to prove the walk-forward engine runs end-to-end, windows don't leak, fold winners persist, and the engine doesn't fabricate values for dead/not-yet-listed names. Each check has a STOP-and-report failure mode; these runs do NOT count toward any certification minimum.

austin-starks/Public-Portfolio-Challenge

The hard structural constraints for the Public Portfolio Challenge momentum-LEAP options book — the spread-shape rule, the take-profit convexity-cap footgun, the affordability ladder, and the known losers not to re-test. Use whenever building or auditing an options strategy structure, checking spread-shape compliance before a certification, choosing DTE/strike rungs, or deciding whether a proposed structure change is even allowed. A violation is an automatic certification FAIL.

austin-starks/Public-Portfolio-Challenge

Orchestrate an out-of-sample certification of a NexusTrade trading strategy or live book — the master discipline behind the Public Portfolio Challenge. Use whenever you must decide PASS/FAIL on whether a portfolio holds up out of sample before deploying real money, replaying the Episode 10 runbooks, or running a \"certify my book\" / \"prove it out of sample\" / \"re-certify the fix\" task with the NexusTrade MCP connected. Pulls in walk-forward-oos, breadth-audit, sweep-reoptimization, options-structure-rules, bug-protocol, and deploy-gate.

austin-starks/Public-Portfolio-Challenge

The single entry point that executes a Public Portfolio Challenge episode or addendum runbook end-to-end, delegating each stage to the functional skills. Use when asked to run/execute/replay Episode 10, its bakeoff, or its addendum with the NexusTrade MCP connected. Reads the target runbook, pins its real artifacts (IDs, the incumbent bar), sequences the stages, and stops at the gated deploy. It orchestrates; the functional skills do the work.

austin-starks/Public-Portfolio-Challenge

Run a multi-family strategy bakeoff — the SEARCH→CERTIFY funnel that screens many candidate mechanisms down to a certified deploy winner without letting the cheap search layer issue a verdict. Use when replaying the Episode 10 bakeoff, when exploring several distinct strategy families before certifying, when deciding whether \"no deployable winner\" is even a legal conclusion, or when building the per-family certification ledger. Enforces verdict-integrity: only certification can end a campaign.

austin-starks/Public-Portfolio-Challenge

Re-optimize a NexusTrade strategy with a walk-forward SWEEP and label parameter provenance — the discipline that prevents deploying inherited knobs. Use whenever a structural change (sizing, rung depth, universe membership, DTE family, adding a rank signal) forces a re-sweep, when authoring gene_intents from get_sweep_surface, when choosing sweep over GA for a deploy cert, or when selecting the cross-fold-robust winner instead of the per-fold argmax. Invoke with the NexusTrade MCP connected.

austin-starks/Public-Portfolio-Challenge

Run and read a NexusTrade walk-forward out-of-sample study — the certification engine behind the Public Portfolio Challenge. Use when certifying a fixed portfolio (backtest_only) or re-optimizing one (sweep), when setting fold_count / anchored / validation / embargo params, when monitoring a run_walk_forward_study to completion, when reading per-fold OOS returns/Sortino/drawdown, or when a variant's fold calendar needs calendar-alignment against a base control. Invoke with the NexusTrade MCP connected.

相關技能