1. 実データで見えた構造
総クエリ
3458
abbrev 2368 / fullname 1090
RCS マッチ
2795
no_match 663
マッチ中 aligned
1139
40.8%
wrong（全体）
692
abbrev 476 / fullname 216
- 略語の no_match が主問題。 abbrev の RCS 無マッチ 656 件。 同一構造の fullname はヒットしているのに abbrev が落ちるケースが 476 件 （うち fullname が aligned なのは 137）。→ 略語テーブル／略語展開の未網羅 が最大の欠陥。
- 略語の誤ヒットは高スコア混在。 abbrev wrong 476 件の多くは fuzzy/bm25 由来で、
VP→ventral posterior visual area（正: ventral pallidum）、DMS→dorsal migratory stream（正: dorsomedial striatum） など、同字面の別構造に吸われる。高スコア（≥0.75）でも wrong が目立つ。 - fullname は比較的健全だが「上位構造」判定が多い。 fullname aligned 419 / broader_parent 354。
これは RCS の階層親昇格ではなく、LLM 判定ラベル（top1 が解剖学的に親／広い）である。
親昇格（
_promote_common_parents）は v0.8.0 で廃止済み。 - 判定の安定性は高い。 vote 3-0 が 2,542 件、high certainty 3,050 件。 3-pass（Flash 0731）の多数決は改善ループの「審判」として十分使える。
2. 失敗ファミリ（abbrev wrong）
| family | 件数 |
|---|---|
| other | 325 |
| thalamus | 78 |
| striatum | 26 |
| spinal | 21 |
| brainstem | 16 |
| hippocampal | 9 |
| amygdala | 1 |
other は文脈依存の短い略語（VP/DMS/DLS/CP/PP/PV 等）が中心。同字面の別構造に吸われる「略語衝突」が本質。
3. 改善プロセス方針（LLM-based Recursive Improvement）
eval_harness.py は判定キャッシュ（query→top1）を持つので、
RCS が変わって top1 が変わった組だけ再判定すればよい。3-pass は Flash 0731 のみで統一。
Round 0 baseline（本レポート）… abbrev 改善余地が最大
│
Round 1 略語辞書拡充（最優先）
│ ├─ abbrev no_match & fullname hit 476 件 → abbrev テーブル追加
│ └─ abbrev wrong 高スコア衝突 → abbrev→正式名の一意化ルール
│ 期待: abbrev no_match 656 → 大幅減 / abbrev aligned ↑
│
Round 2 誤ヒット抑制
│ ├─ 同字面衝突（VP/DMS/DLS/CP/PP/PV…）に種別・文脈制約
│ └─ fullname 一致時は abbrev を fullname 展開で再スコア
│ 期待: wrong 692 ↓ / aligned 1,139 ↑
│
Round 3 fullname 側の精度（親昇格は既に廃止済み）
├─ broader_parent 354 = LLM が「top1 が親／広い」と判定した件数
│ （RCS が親を昇格させたわけではない）
├─ alias / specificity / region-anchor で具体名を top1 に押し上げる
└─ partial_or_narrower 243 の化合物・部分構造の扱いを整理
- 評価指標: aligned_rate（matched 中 aligned 割合）、abbrev_no_match、wrong_high_conf（score≥0.75 で wrong）を主 KPI。 broader_parent は「正しいが粗い」として aligned と別に追跡。
- 判定は固定（Flash 0731 ×3、pro なし）。審判を変えないことで改善量を素直に比較する。
- 回帰ガード: 既に aligned のペアが悪化しないよう、毎ラウンド差分レポート（improved/regressed）を必須化。
- コスト制御: 変化した query→top1 のみ再判定。fullname 側は安定なので abbrev 優先。
4. Round 1 の対象例 — abbrev no_match & fullname hit
| n_mentions | query | fullname |
|---|---|---|
| 134 | LH | lateral hypothalamus |
| 96 | dLGN | dorsal lateral geniculate nucleus |
| 94 | TRN | thalamic reticular nucleus |
| 90 | LHb | lateral habenula |
| 84 | DCN | dorsal cochlear nucleus |
| 84 | LS | lateral septum |
| 70 | LHA | lateral hypothalamic area |
| 68 | VLPAG | ventrolateral periaqueductal gray |
| 67 | LGN | lateral geniculate nucleus |
| 62 | POm | posterior medial thalamus |
| 62 | vHPC | ventral hippocampus |
| 56 | Sub | subiculum |
| 53 | MGB | medial geniculate body |
| 49 | PBN | parabrachial nucleus |
| 47 | HDB | horizontal diagonal band |
| 42 | vCA1 | ventral CA1 |
| 41 | MVN | medial vestibular nucleus |
| 38 | CPu | caudate putamen |
| 36 | RVLM | rostral ventrolateral medulla |
| 35 | dCA3 | dorsal CA3 |
5. Round 2 の対象例 — abbrev wrong（高スコア）
| n_mentions | query | top_name | score | pass1_reason |
|---|---|---|---|---|
| 118 | VP | ventral posterior visual area (ventral third visual area, V3V) | 1.0 | VP abbreviation for ventral pallidum matched to visual area V3V; anatomically different. |
| 102 | DMS | dorsal migratory stream | 1.0 | DMS intended as dorsomedial striatum; top1 'dorsal migratory stream' is a different structure. |
| 77 | DLS | (dorso)lateral sulcus | 1.0 | DLS is dorsolateral striatum, but top1 is lateral sulcus, an anatomically different structure. |
| 65 | PPN | parietopontine fibers | 1.0 | PPN given as pedunculopontine nucleus, but top1 is parietopontine fibers, a different structure. |
| 44 | CN | cerebral nuclei | 1.0 | Query 'CN' with fullname context 'cerebellar nuclei'; top1 'cerebral nuclei' is a different structure, not an accepted synonym. |
| 44 | MEC | caudal medial nucleus | 1.0 | Query 'MEC' with context 'medial entorhinal cortex'; top1 'caudal medial nucleus' is a different structure, not a synonym. |
| 30 | Gr | gracile fasciculus | 1.0 | Gr abbreviation maps to gracile nucleus, but top1 gracile fasciculus is a fiber tract, not the nucleus. |
| 28 | Cd | central dorsal nucleus of thalamus | 1.0 | Query Cd with fullname caudate nucleus; top1 central dorsal nucleus of thalamus is a different structure. |
| 28 | PP | peripeduncular nucleus | 1.0 | Query PP expands to piriform cortex; top1 peripeduncular nucleus is a distinct structure, not a synonym or subdivision. |
| 27 | CP | cortical plate of neocortex | 1.0 | Query CP corresponds to caudate putamen; top1 cortical plate of neocortex is a different structure. |
| 24 | PV | paraventricular nucleus of hypothalamus | 1.0 | Context indicates PV refers to principal trigeminal nucleus, but top1 is paraventricular nucleus of hypothalamus, a different structure. |
| 23 | VN | vomeronasal nerve | 1.0 | Query VN with context vestibular nucleus; top1 vomeronasal nerve is a different structure, off-target. |
| 20 | ANT | angular nucleus of thalamus | 1.0 | ANT is anterior nucleus of thalamus; top1 angular nucleus of thalamus is a different nucleus. |
| 20 | TH | medial division of PHC (area TH) | 1.0 | TH here is used as abbreviation for thalamus, but top1 is parahippocampal area TH, a different structure. |
| 18 | ICc | caudal limb of internal capsule | 1.0 | ICc is central nucleus of inferior colliculus; top1 is caudal limb of internal capsule, a different structure. |
| 15 | PRh | prepositus hypoglossal nucleus | 1.0 | PRh is perirhinal cortex, not prepositus hypoglossal nucleus. |
| 14 | SON | superior olivary nucleus | 1.0 | SON is ambiguous; fullname context indicates supraoptic nucleus, but top1 is superior olivary nucleus, a different structure. |
| 12 | LSC | lateral spinal nucleus in cervical spinal cord | 1.0 | Top1 is lateral spinal nucleus (spinal cord); LSC here denotes lateral superior colliculus (midbrain), so the structure is off-lobe. |
| 10 | Acb | anterior lobe of cerebellar cortex | 1.0 | Acb is nucleus accumbens; top1 is anterior lobe of cerebellar cortex, anatomically unrelated. |
| 10 | CeM | central medial nucleus of thalamus | 1.0 | CeM in this record is medial division of central amygdaloid nucleus; top1 is central medial nucleus of thalamus, a different structure. |
6. fullname 側の wrong（上位ヒット/別構造）
| n_mentions | query | top_name | score | pass1_reason |
|---|---|---|---|---|
| 170 | paraventricular nucleus | paraventricular nucleus of thalamus | 1.0 | PVN context indicates hypothalamus, but top1 is paraventricular nucleus of thalamus. |
| 27 | arcuate nucleus | arcuate nucleus of medulla oblongata | 0.786859 | Arcuate nucleus has multiple referents (hypothalamus vs medulla); top1 selects medulla, so query alone is ambiguous. |
| 20 | anterior nucleus of the thalamus | rostral division of pulvinar | 0.779723 | Pulvinar is posterior thalamus; anterior nucleus of thalamus is a different thalamic nuclear region. |
| 19 | central amygdala lateral | lateral nucleus of amygdala | 0.774127 | Top1 is lateral nucleus of amygdala, a different structure from central amygdala lateral. |
| 15 | medial inferior pulvinar | medial division of pulvinar | 0.860569 | PIm/medial inferior pulvinar is part of inferior pulvinar; medial division of pulvinar is a different major subdivision. |
| 7 | rostral dorsal lateral geniculate nucleus | dorsal (rostral) division of medial geniculate nucleus | 0.76821 | Rostral DLG is visual geniculate; medial geniculate is auditory, off-structure. |
| 6 | posterior nucleus of the ventral tegmental area | ventral tegmental nucleus (of Gudden) | 0.792678 | Posterior nucleus of ventral tegmental area is not the ventral tegmental nucleus of Gudden; these are distinct structures. |
| 5 | magnocellular preoptic nucleus | red nucleus, magnocellular division | 0.782981 | Magnocellular preoptic nucleus is in basal forebrain; red nucleus is midbrain. Distinct structures. |
| 4 | Efferent Vestibular Nucleus | vestibular nuclei in pons | 0.854167 | Efferent vestibular nucleus is a separate efferent nucleus, not part of the vestibular nuclear complex in pons; top1 is anatomically different. |
| 4 | dorsal aspect of the anterior pretectal nucleus | dorsal (posterior/sublentiform) pretectal nucleus | 0.783115 | Dorsal aspect of anterior pretectal nucleus (APTD) is not the dorsal/posterior/sublentiform pretectal nucleus; different structure. |
| 4 | CART+ Edinger-Westphal nucleus | pre-Edinger-Westphal nucleus | 0.767848 | pre-Edinger-Westphal nucleus is a distinct structure, not synonymous with CART+ Edinger-Westphal nucleus. |
| 3 | right caudal medullary | caudal (posterior, inferior) medullary velum | 0.935 | Right caudal medullary refers to medulla region; top1 is the caudal medullary velum, a different cerebellar/ventricular structure, and lacks laterality. |
| 3 | substantia nigra pars reticulata dorsal | substantia nigra, compact division, dorsal subdivision | 0.838466 | Query is pars reticulata dorsal, but top1 is pars compacta dorsal subdivision, a different anatomical division. |
| 3 | lateral division of the lateral habenula nucleus | interstitial (dorsal) division of lateral habenular nucleus | 0.806102 | Interstitial dorsal division is a distinct habenular subdivision, not the lateral division queried. |
| 3 | anteroventral dorsomedial nucleus | dorsomedial part of pontine nucleus | 0.785985 | Query is anteroventral dorsomedial nucleus; top1 is a pontine nucleus subdivision, an anatomically different structure. |
| 3 | internal lateral nucleus | lateral nucleus of amygdala | 0.769022 | internal lateral nucleus (PBil) is a parabrachial subdivision; top1 lateral nucleus of amygdala is a different structure. |
| 3 | posterior medial amygdala nucleus | posterior (caudal) cortical nucleus of amygdala | 0.760678 | MeP is posterior medial amygdala nucleus; top1 is posterior cortical nucleus of amygdala, a different nucleus. |
| 3 | lateral subnucleus of mediodorsal thalamus | lateral dorsal nucleus of thalamus | 0.75423 | Lateral dorsal nucleus of thalamus is a distinct nucleus, not the lateral subnucleus of mediodorsal thalamus. |
| 2 | lateral nucleus of the central amygdala | lateral nucleus of amygdala | 0.938221 | Top1 'lateral nucleus of amygdala' is likely the lateral amygdaloid nucleus, not the lateral subdivision of central amygdala (CEAl). |
| 2 | dorsal inferior reticular nucleus | dorsal reticular nucleus | 0.906614 | Dorsal reticular nucleus is a distinct nucleus from dorsal inferior reticular nucleus; missing 'inferior' changes the anatomical entity. |
7. abbrev wrong & fullname aligned（略語だけが外れる）
| n_mentions | query | top_name | score | pass1_reason |
|---|---|---|---|---|
| 118 | VP | ventral posterior visual area (ventral third visual area, V3V) | 1.0 | VP abbreviation for ventral pallidum matched to visual area V3V; anatomically different. |
| 65 | PPN | parietopontine fibers | 1.0 | PPN given as pedunculopontine nucleus, but top1 is parietopontine fibers, a different structure. |
| 44 | CN | cerebral nuclei | 1.0 | Query 'CN' with fullname context 'cerebellar nuclei'; top1 'cerebral nuclei' is a different structure, not an accepted synonym. |
| 44 | MEC | caudal medial nucleus | 1.0 | Query 'MEC' with context 'medial entorhinal cortex'; top1 'caudal medial nucleus' is a different structure, not a synonym. |
| 43 | preBötC | tuber cinereum | 0.307108 | Top1 is tuber cinereum, a hypothalamic structure, unrelated to the pre-Bötzinger complex. |
| 30 | Gr | gracile fasciculus | 1.0 | Gr abbreviation maps to gracile nucleus, but top1 gracile fasciculus is a fiber tract, not the nucleus. |
| 28 | Cd | central dorsal nucleus of thalamus | 1.0 | Query Cd with fullname caudate nucleus; top1 central dorsal nucleus of thalamus is a different structure. |
| 28 | PP | peripeduncular nucleus | 1.0 | Query PP expands to piriform cortex; top1 peripeduncular nucleus is a distinct structure, not a synonym or subdivision. |
| 24 | PV | paraventricular nucleus of hypothalamus | 1.0 | Context indicates PV refers to principal trigeminal nucleus, but top1 is paraventricular nucleus of hypothalamus, a different structure. |
| 20 | TH | medial division of PHC (area TH) | 1.0 | TH here is used as abbreviation for thalamus, but top1 is parahippocampal area TH, a different structure. |
| 18 | ICc | caudal limb of internal capsule | 1.0 | ICc is central nucleus of inferior colliculus; top1 is caudal limb of internal capsule, a different structure. |
| 16 | EP | ependyma of spinal cord | 0.315135 | EP in context is entopeduncular nucleus; ependyma of spinal cord is an unrelated structure. |
| 14 | SON | superior olivary nucleus | 1.0 | SON is ambiguous; fullname context indicates supraoptic nucleus, but top1 is superior olivary nucleus, a different structure. |
| 11 | NOT | general lamination of spinal cord (for users who do not know specific spinal segments) | 0.175921 | Query NOT is abbreviation for nucleus of optic tract; top1 is spinal cord lamination, unrelated. |
| 11 | VII | lobule VII (folium and tuber) | 0.298159 | Top1 is lobule VII of cerebellum, not facial nucleus (cranial nerve VII). |
| 10 | MR | marginal ramus of cingulate sulcus | 1.0 | MR in context is brainstem median raphe; top1 is marginal ramus of cingulate sulcus, different structure. |
| 10 | SpV | vein system of spinal cord | 1.0 | SpV should be spinal trigeminal nucleus; top1 is vein system of spinal cord, unrelated vascular structure. |
| 9 | AHA | amygdalohippocampal area | 1.0 | AHA intended as anterior hypothalamic area per context, but top1 is amygdalohippocampal area, a distinct region. |
| 9 | AP | ansa peduncularis | 1.0 | AP in context is area postrema, but top1 ansa peduncularis is a different structure. |
| 8 | ME | medial nuclear complex of amygdala | 1.0 | ME is median eminence per context; top1 is medial nuclear complex of amygdala, anatomically different structure. |
8. まとめ
- 最大の改善対象は abbrev の no_match 656 件（うち fullname はヒットする 476 件）。略語テーブル拡充が効く。
- 次点は abbrev wrong の高スコア衝突。同字面の別構造への誤マッチを、fullname 文脈と種別制約で絞る。
- 判定は Flash 0731 ×3 で固定。キャッシュ再利用で安く再テストし、
generate_report.pyで各ラウンドを同じUIで比較する。