:PROPERTIES:
:ID: b8a9886a-d349-43e5-a745-817a148c1fd8
:END:

#+title: impl/datasets
#+filetags: :project: :knowledge: :datasets:

* impl/datasets

** KEEL Dataset Class Balance

Counts from =KeelDataset= loader. Ratio = false/true (imbalance factor).
Two datasets fail to load (likely missing env vars or files): =led7digit=, =page-blocks=.

| Dataset              | Total | True | False | Ratio | Runnable |
|----------------------+-------+------+-------+-------+----------|
| cleveland-0_vs_4     |   177 |   13 |   164 |  12.6 | NO       |
| ecoli-0-1_vs_5       |   240 |   20 |   220 |  11.0 | NO       |
| glass0               |   214 |   70 |   144 |   2.1 | YES      |
| glass1               |   214 |   76 |   138 |   1.8 | YES      |
| glass2               |   214 |   17 |   197 |  11.6 | YES      |
| glass4               |   214 |   13 |   201 |  15.5 | NO       |
| glass5               |   214 |    9 |   205 |  22.8 | NO       |
| glass6               |   214 |   29 |   185 |   6.4 | YES      |
| haberman             |   306 |   81 |   225 |   2.8 | YES      |
| iris0                |   150 |   50 |   100 |   2.0 | YES      |
| led7digit            |   N/A |      |       |       | NO       |
| new-thyroid1         |   215 |   35 |   180 |   5.1 | YES      |
| page-blocks          |   N/A |      |       |       | NO       |
| pima                 |   768 |  268 |   500 |   1.9 | YES      |
| vehicle2             |   846 |  218 |   628 |   2.9 | YES      |
| vowel0               |   988 |   90 |   898 |  10.0 | YES      |
| wisconsin            |   683 |  239 |   444 |   1.9 | YES      |
| yeast3               |  1484 |  163 |  1321 |   8.1 | YES      |

** Gotchas

- ISJ "Need more data" failure: cleveland (13 true), ecoli (20 true), glass4 (13), glass5 (9) — after 33% test split, too few samples in minority class for ISJ root-finding. Excluded from =run_all.sh=.
- glass2 (17 true) is borderline — watch for failures.
- led7digit and page-blocks fail to load entirely (missing dataset files or env vars).