Documentation Index

This folder tracks project decisions, experiments, and evolving ideas.

• decisions.md: design/architecture changes and rationales
• experiments.md: experiment runs and results
• ideas.md: future ideas and hypotheses

Conventions:

• Append new entries instead of overwriting old ones.
• Record exact config file and key overrides when possible.
• Keep metrics in the order: avg_ks / avg_jsd / avg_lag1_diff.

Tools:

• example/diagnose_ks.py for per-feature KS + CDF plots.
• example/run_all_full.py for one-command full pipeline + diagnostics.
• example/filtered_metrics.py for filtered KS after removing collapsed/outlier features. Notes:
• If use_quantile_transform is enabled, run prepare_data.py with full_stats: true to build quantile tables.

Current status (high level):

• Two-stage pipeline (GRU trend + diffusion residuals).
• Quantile transform + post-hoc calibration enabled for continuous features.
• Latest metrics (2026-01-27 21:22): avg_ks ~0.405 / avg_jsd ~0.038 / avg_lag1_diff ~0.145.