EXAONE Tabular vs Kumo Tabular Small Benchmark
Empirical head-to-head evaluation of EXAONE Tabular (LG AI Research) versus Kumo Tabular Small (Kumo AI / NVIDIA) on identical, precomputed IID or non-IID splits across 21 diverse tabular datasets.
Model Specifications & Design Trade-offs
Comparing transformer architecture, Bayesian priors, sequence context windows, and browser execution runtime.
EXAONE Tabular
Large-scale tabular foundation model by LG AI Research designed for high-capacity tabular representation learning, handling mixed categorical and continuous variables across tabular domains.
Kumo Tabular Small
Kumo AI and NVIDIA's in-context tabular foundation model, pre-trained on diverse structured datasets for zero-shot classification and quantile regression.
TabICLv2 vs TabPFN-3 vs TabFM vs EXAONE: Which Model Can Run in the Browser?
Evaluating model weight size (MB vs GB), VRAM requirements, Python server infrastructure overhead, licensing terms, and WebGPU client-side execution compatibility.
21-Dataset Metric Evaluation Matrix
Empirical performance on deterministic, application-appropriate IID or non-IID splits: 1 - AUC for binary classification, Log-Loss for multiclass, and RMSE for regression (all metrics: lower is better).
| Dataset | Domain | Task | Rows | Splits?Repeats × folds. IID datasets use three folds with size-aware repeats, and the same row indices are used for every model. | Metric?Primary evaluation error loss: 1 - AUC for binary classification, Log-Loss for multiclass, RMSE for regression. All metrics: lower is better. | EXAONE Tabular Loss?EXAONE Tabular primary out-of-sample error loss (lower is better). | Kumo Tabular Small Loss?Kumo Tabular Small primary out-of-sample error loss (lower is better). | Margin (Δ)?Error loss difference. Negative (green) indicates EXAONE Tabular lead; positive (red) indicates Kumo Tabular Small lead. | Winner?Model achieving lower out-of-sample error loss on this benchmark split. | EXAONE Tabular Latency?Mean inference runtime in seconds per evaluation split for EXAONE Tabular. | Kumo Tabular Small Latency?Mean inference runtime in seconds per evaluation split for Kumo Tabular Small. |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Abalone ↗ | Agriculture, Forestry & Fishing | REG | 4,177 | 3×3 | RMSE | 2.03 | 2.02 | +0.01 | Kumo Tabular Small | 13.78s | 1.75s |
| Adult ↗ | Economics & Public Policy | BIN | 48,842 | 3×3 | 1 - AUC | 0.0680 | 0.0677 | +0.0003 | Kumo Tabular Small | 859.66s | 96.87s |
| Airfoil Self Noise ↗ | UCI | REG | 1,503 | 10×3 | RMSE | 1.16 | 1.02 | +0.14 | Kumo Tabular Small | 2.34s | 0.73s |
| Amazon Employee Access ↗ | Information Technology & Enterprise Security | BIN | 32,769 | 3×3 | 1 - AUC | 0.1232 | 0.1392 | -0.0159 | EXAONE Tabular | 203.54s | 48.40s |
| Bank Marketing ↗ | Finance & Banking | BIN | 45,211 | 3×3 | 1 - AUC | 0.1876 | 0.1880 | -0.0005 | EXAONE Tabular | 749.39s | 85.00s |
| Blood Transfusion Service Center ↗ | Healthcare & Biomedicine | BIN | 748 | 20×3 | 1 - AUC | 0.2480 | 0.2452 | +0.0028 | Kumo Tabular Small | 0.24s | 0.50s |
| Breast W ↗ | Healthcare & Life Sciences | BIN | 699 | 20×3 | 1 - AUC | 0.0054 | 0.0055 | ±0.00 | Tie | 0.30s | 0.53s |
| Car ↗ | Automotive & Fleet Management | MULTI | 1,728 | 10×3 | Log-Loss | 0.0346 | 0.0253 | +0.0093 | Kumo Tabular Small | 0.56s | 0.65s |
| Compas Two Years ↗ | Legal & Public Safety | BIN | 5,278 | 3×3 | 1 - AUC | 0.2612 | 0.2617 | -0.0005 | EXAONE Tabular | 4.33s | 2.74s |
| Credit G ↗ | Finance & Banking | BIN | 1,000 | 10×3 | 1 - AUC | 0.1964 | 0.1956 | +0.0008 | Kumo Tabular Small | 0.69s | 0.77s |
| Diabetes ↗ | Healthcare & Biomedicine | BIN | 768 | 10×3 | 1 - AUC | 0.1638 | 0.1621 | +0.0017 | Kumo Tabular Small | 0.30s | 0.54s |
| Employee Salaries ↗ | Human Resources & Workforce Analytics | REG | 9,228 | 3×3 | RMSE | 7,427 | 9,029 | -1,602 | EXAONE Tabular | 77.76s | 5.53s |
| Fitness Club ↗ | Fitness, Sports & Recreation | BIN | 1,500 | 10×3 | 1 - AUC | 0.1797 | 0.1792 | +0.0004 | Kumo Tabular Small | 0.49s | 0.76s |
| House Sales ↗ | Real Estate & Property Valuation | REG | 21,613 | 3×3 | RMSE | 99,520 | 98,512 | +1,007 | Kumo Tabular Small | 931.00s | 26.72s |
| Houses ↗ | Real Estate & Urban Planning | REG | 20,640 | 3×3 | RMSE | 39,971 | 37,670 | +2,301 | Kumo Tabular Small | 459.14s | 19.70s |
| Monks Problems 2 ↗ | Data Science & Artificial Intelligence | BIN | 601 | 20×3 | 1 - AUC | 0.0000 | 0.0000 | ±0.00 | Tie | 0.24s | 0.50s |
| Phoneme ↗ | Speech Processing & Acoustic Engineering | BIN | 5,404 | 3×3 | 1 - AUC | 0.0276 | 0.0246 | +0.0030 | Kumo Tabular Small | 2.54s | 2.29s |
| Spambase ↗ | Cybersecurity & IT Infrastructure | BIN | 4,601 | 3×3 | 1 - AUC | 0.0076 | 0.0073 | +0.0002 | Kumo Tabular Small | 12.63s | 4.98s |
| Telco Customer Churn ↗ | Telecommunications & Subscription Services | BIN | 7,043 | 3×3 | 1 - AUC | 0.1484 | 0.1595 | -0.0111 | EXAONE Tabular | 11.95s | 4.67s |
| Titanic ↗ | Maritime Safety & Actuarial Risk Analysis | BIN | 1,309 | 10×3 | 1 - AUC | 0.1146 | 0.1276 | -0.0130 | EXAONE Tabular | 0.58s | 0.84s |
| Vehicle ↗ | Automotive Engineering & Computer Vision | MULTI | 846 | 10×3 | Log-Loss | 0.2393 | 0.2244 | +0.0149 | Kumo Tabular Small | 0.53s | 0.53s |
Evaluate Foundation Models In Your Spreadsheets
Carla HQ brings TabICLv2 foundation models directly into Google Sheets via WebGPU. Run zero-trust predictions on private data without API keys or cloud pipelines.
Frequently Asked Questions: EXAONE Tabular vs Kumo Tabular Small
Common architectural and benchmarking questions comparing EXAONE Tabular and Kumo Tabular Small.
How does EXAONE Tabular compare to Kumo Tabular Small on tabular benchmarks?
Across the Carla benchmark suite, EXAONE Tabular and Kumo Tabular Small are evaluated head-to-head on identical, precomputed IID or non-IID splits using standardized error losses (1 - AUC for binary classification, Log-Loss for multiclass, and RMSE for regression). IID datasets use adaptive repeated 3-fold evaluation to reduce variance. TabICLv2 enables 100% private in-browser WebGPU execution, whereas server-side models like Kumo Tabular Small require heavy PyTorch infrastructure and cloud GPU backend servers.
Can EXAONE Tabular or Kumo Tabular Small run in the browser without server infrastructure?
Only TabICLv2 (via Carla HQ and nanotabicl ONNX Runtime WASM/WebGPU) is engineered to execute entirely client-side inside web browsers like Google Chrome. EXAONE Tabular requires full Python and PyTorch server infrastructure with high memory allocations.
What are the primary architectural differences between EXAONE Tabular and Kumo Tabular Small?
EXAONE Tabular uses multi-task columnar autoregressive tabular transformer, whereas Kumo Tabular Small leverages in-context tabular foundation model with cross-attention. TabICLv2 specifically utilizes prefix attention with KV cache reuse for real-time tabular evaluation in spreadsheets.