Skip to main content
CARLA HQ
PAIRWISE BENCHMARKAdaptive Repeated 3-Fold21 DatasetsMarkdown ↗

EXAONE Tabular vs Kumo Tabular Small Benchmark

Empirical head-to-head evaluation of EXAONE Tabular (LG AI Research) versus Kumo Tabular Small (Kumo AI / NVIDIA) on identical, precomputed IID or non-IID splits across 21 diverse tabular datasets.

HEAD-TO-HEAD WINS?Direct pairwise dataset matchup wins where the model achieved lower out-of-sample error loss (1 - AUC for binary, Log-Loss for multiclass, RMSE for regression).
EXAONE Tabular6
:
13Kumo Tabular Small
(2 ties) across 21 benchmarks
TOURNAMENT ELO?Global Bradley-Terry Elo rating computed across all evaluation-split matchups with 1,000 bootstrap resamples. Higher is better (baseline 1000).
EXAONE Tabular1015 (±82)
vs
Kumo Tabular Small1042 (±54)
Higher is better • 95% Bootstrap CI
MACRO IMPROVABILITY?Normalized average error regret relative to empirical suite ceilings across all 21 datasets. Lower is better (0.0% is optimal ceiling).
EXAONE Tabular0.88%
vs
Kumo Tabular Small1.23%
Lower is better • Error regret vs ceiling
MEAN SPLIT LATENCY?Average execution latency in seconds per persisted IID or non-IID evaluation split across all benchmarks. Lower is faster.
EXAONE Tabular158.67s
vs
Kumo Tabular Small14.52s
Lower is faster • adaptive split protocol
ARCHITECTURAL BLUEPRINTS

Model Specifications & Design Trade-offs

Comparing transformer architecture, Bayesian priors, sequence context windows, and browser execution runtime.

LG AI Research

EXAONE Tabular

GitHub / Paper ↗

Large-scale tabular foundation model by LG AI Research designed for high-capacity tabular representation learning, handling mixed categorical and continuous variables across tabular domains.

ArchitectureMulti-Task Columnar Autoregressive Tabular Transformer
Prior / PretrainingHybrid pre-training on synthetic datasets and diverse real-world tabular corpuses
Context WindowTokenized columnar context with sequence truncation
Runtime PlatformServer-side only (Requires Python runtime / PyTorch / CUDA)
LicenseSource: BSD-3-Clause-LG AI Research License (A license derived from the BSD 3-Clause License) | Weights: EXAONE AI Model License Agreement 1.2 - NC
Kumo AI / NVIDIA

Kumo Tabular Small

GitHub / Paper ↗

Kumo AI and NVIDIA's in-context tabular foundation model, pre-trained on diverse structured datasets for zero-shot classification and quantile regression.

ArchitectureIn-Context Tabular Foundation Model with Cross-Attention
Prior / PretrainingRelational & Structured Data Priors (SDM Recipe)
Context WindowConfigurable context rows with tiled row & ICL inference
Runtime PlatformNative WebGPU & WASM Browser Runtime (via ONNX Runtime)
LicenseOpen Source (Apache 2.0)
DEEP DIVE REPORTON-DEVICE RUNTIME ANALYSIS

TabICLv2 vs TabPFN-3 vs TabFM vs EXAONE: Which Model Can Run in the Browser?

Evaluating model weight size (MB vs GB), VRAM requirements, Python server infrastructure overhead, licensing terms, and WebGPU client-side execution compatibility.

HEAD-TO-HEAD BREAKDOWN

21-Dataset Metric Evaluation Matrix

Empirical performance on deterministic, application-appropriate IID or non-IID splits: 1 - AUC for binary classification, Log-Loss for multiclass, and RMSE for regression (all metrics: lower is better).

DatasetDomainTaskRows
Splits?Repeats × folds. IID datasets use three folds with size-aware repeats, and the same row indices are used for every model.
Metric?Primary evaluation error loss: 1 - AUC for binary classification, Log-Loss for multiclass, RMSE for regression. All metrics: lower is better.
EXAONE Tabular
Loss?EXAONE Tabular primary out-of-sample error loss (lower is better).
Kumo Tabular Small
Loss?Kumo Tabular Small primary out-of-sample error loss (lower is better).
Margin (Δ)?Error loss difference. Negative (green) indicates EXAONE Tabular lead; positive (red) indicates Kumo Tabular Small lead.
Winner?Model achieving lower out-of-sample error loss on this benchmark split.
EXAONE Tabular
Latency?Mean inference runtime in seconds per evaluation split for EXAONE Tabular.
Kumo Tabular Small
Latency?Mean inference runtime in seconds per evaluation split for Kumo Tabular Small.
Abalone ↗Agriculture, Forestry & FishingREG4,1773×3RMSE2.032.02+0.01Kumo Tabular Small13.78s1.75s
Adult ↗Economics & Public PolicyBIN48,8423×31 - AUC0.06800.0677+0.0003Kumo Tabular Small859.66s96.87s
Airfoil Self Noise ↗UCIREG1,50310×3RMSE1.161.02+0.14Kumo Tabular Small2.34s0.73s
Amazon Employee Access ↗Information Technology & Enterprise SecurityBIN32,7693×31 - AUC0.12320.1392-0.0159EXAONE Tabular203.54s48.40s
Bank Marketing ↗Finance & BankingBIN45,2113×31 - AUC0.18760.1880-0.0005EXAONE Tabular749.39s85.00s
Blood Transfusion Service Center ↗Healthcare & BiomedicineBIN74820×31 - AUC0.24800.2452+0.0028Kumo Tabular Small0.24s0.50s
Breast W ↗Healthcare & Life SciencesBIN69920×31 - AUC0.00540.0055±0.00Tie0.30s0.53s
Car ↗Automotive & Fleet ManagementMULTI1,72810×3Log-Loss0.03460.0253+0.0093Kumo Tabular Small0.56s0.65s
Compas Two Years ↗Legal & Public SafetyBIN5,2783×31 - AUC0.26120.2617-0.0005EXAONE Tabular4.33s2.74s
Credit G ↗Finance & BankingBIN1,00010×31 - AUC0.19640.1956+0.0008Kumo Tabular Small0.69s0.77s
Diabetes ↗Healthcare & BiomedicineBIN76810×31 - AUC0.16380.1621+0.0017Kumo Tabular Small0.30s0.54s
Employee Salaries ↗Human Resources & Workforce AnalyticsREG9,2283×3RMSE7,4279,029-1,602EXAONE Tabular77.76s5.53s
Fitness Club ↗Fitness, Sports & RecreationBIN1,50010×31 - AUC0.17970.1792+0.0004Kumo Tabular Small0.49s0.76s
House Sales ↗Real Estate & Property ValuationREG21,6133×3RMSE99,52098,512+1,007Kumo Tabular Small931.00s26.72s
Houses ↗Real Estate & Urban PlanningREG20,6403×3RMSE39,97137,670+2,301Kumo Tabular Small459.14s19.70s
Monks Problems 2 ↗Data Science & Artificial IntelligenceBIN60120×31 - AUC0.00000.0000±0.00Tie0.24s0.50s
Phoneme ↗Speech Processing & Acoustic EngineeringBIN5,4043×31 - AUC0.02760.0246+0.0030Kumo Tabular Small2.54s2.29s
Spambase ↗Cybersecurity & IT InfrastructureBIN4,6013×31 - AUC0.00760.0073+0.0002Kumo Tabular Small12.63s4.98s
Telco Customer Churn ↗Telecommunications & Subscription ServicesBIN7,0433×31 - AUC0.14840.1595-0.0111EXAONE Tabular11.95s4.67s
Titanic ↗Maritime Safety & Actuarial Risk AnalysisBIN1,30910×31 - AUC0.11460.1276-0.0130EXAONE Tabular0.58s0.84s
Vehicle ↗Automotive Engineering & Computer VisionMULTI84610×3Log-Loss0.23930.2244+0.0149Kumo Tabular Small0.53s0.53s
ZERO-SERVER CLIENT-SIDE EXECUTION

Evaluate Foundation Models In Your Spreadsheets

Carla HQ brings TabICLv2 foundation models directly into Google Sheets via WebGPU. Run zero-trust predictions on private data without API keys or cloud pipelines.

FREQUENTLY ASKED QUESTIONS

Frequently Asked Questions: EXAONE Tabular vs Kumo Tabular Small

Common architectural and benchmarking questions comparing EXAONE Tabular and Kumo Tabular Small.

How does EXAONE Tabular compare to Kumo Tabular Small on tabular benchmarks?

Across the Carla benchmark suite, EXAONE Tabular and Kumo Tabular Small are evaluated head-to-head on identical, precomputed IID or non-IID splits using standardized error losses (1 - AUC for binary classification, Log-Loss for multiclass, and RMSE for regression). IID datasets use adaptive repeated 3-fold evaluation to reduce variance. TabICLv2 enables 100% private in-browser WebGPU execution, whereas server-side models like Kumo Tabular Small require heavy PyTorch infrastructure and cloud GPU backend servers.

Can EXAONE Tabular or Kumo Tabular Small run in the browser without server infrastructure?

Only TabICLv2 (via Carla HQ and nanotabicl ONNX Runtime WASM/WebGPU) is engineered to execute entirely client-side inside web browsers like Google Chrome. EXAONE Tabular requires full Python and PyTorch server infrastructure with high memory allocations.

What are the primary architectural differences between EXAONE Tabular and Kumo Tabular Small?

EXAONE Tabular uses multi-task columnar autoregressive tabular transformer, whereas Kumo Tabular Small leverages in-context tabular foundation model with cross-attention. TabICLv2 specifically utilizes prefix attention with KV cache reuse for real-time tabular evaluation in spreadsheets.