aboutsummaryrefslogtreecommitdiffstats
path: root/.agents/skills/results-analysis/examples/example-figure-catalog.md
diff options
context:
space:
mode:
authorsillylaird <sillyfanboy@gmail.com>2026-09-03 00:33:59 +0000
committersillylaird <sillyfanboy@gmail.com>2026-09-03 00:33:59 +0000
commit898b52edcb47bcb3e9d6106e74ca73e74ea01e70 (patch)
tree85c6ee5ad58b860144551184d4cf86b560c62b91 /.agents/skills/results-analysis/examples/example-figure-catalog.md
downloadwww-main.tar.gz
www-main.zip
import live www.sillylaird.ca webrootHEADmain
Diffstat (limited to '')
-rw-r--r--.agents/skills/results-analysis/examples/example-figure-catalog.md33
1 files changed, 33 insertions, 0 deletions
diff --git a/.agents/skills/results-analysis/examples/example-figure-catalog.md b/.agents/skills/results-analysis/examples/example-figure-catalog.md
new file mode 100644
index 0000000..d9222f1
--- /dev/null
+++ b/.agents/skills/results-analysis/examples/example-figure-catalog.md
@@ -0,0 +1,33 @@
+# Figure Catalog
+
+## Figure 1 — Main comparison
+- **Filename**: `figures/figure-01-main-comparison.pdf`
+- **Purpose**: Compare WER across Full fine-tuning, Subject Adapter, and Frozen Encoder.
+- **Data source**: `metrics/summary.csv`
+- **Plot type**: Bar + scatter overlay of seed-level points.
+- **Error bars**: 95% CI.
+- **Caption must include**:
+ - metric direction,
+ - number of seeds,
+ - meaning of error bars,
+ - whether significance markers are corrected.
+- **Key observation**: Subject Adapter closes most of the freezing gap.
+- **Interpretation checklist**:
+ - Is the adapter improvement consistent across seeds?
+ - Is the gap practically meaningful, not just statistically significant?
+ - Does the figure support a design decision?
+
+## Figure 2 — Convergence dynamics
+- **Filename**: `figures/figure-02-training-dynamics.pdf`
+- **Purpose**: Compare optimization stability over epochs.
+- **Data source**: `logs/train_curves.csv`
+- **Plot type**: Mean line + uncertainty ribbon.
+- **Caption must include**:
+ - smoothing rule if any,
+ - whether ribbon is std or CI,
+ - training/eval split.
+- **Key observation**: Frozen Encoder shows larger oscillation after epoch 8.
+- **Interpretation checklist**:
+ - Is instability transient or persistent?
+ - Does curve shape match final metric variance?
+ - Does this explain why one method is harder to tune?