arXivPaperNeeds Review
When Does Bigger Help? A Controlled Study of LLM Scale for Ontology Learning
A controlled ontology-learning study finds model size is a weak selector on its own. Dense 27B models beat larger sparse models on one task, while MoE models led another.
arXiv
Source Summary
The study controls retrieval, prompts, decoding, datasets, and metrics across **13 models** and four ontologies. Dense Qwen3.5 gains were largest from **9B to 27B**, mainly improving precision rather than recall.
Practical Implication
Choose models against the exact extraction task, not parameter count. Dense 27B variants led larger sparse models on term typing, while **Mixture-of-Experts models** produced the strongest open-weight taxonomy-discovery results.
Agent-Ready Context
The study controls retrieval, prompts, decoding, datasets, and metrics across **13 models** and four ontologies. Dense Qwen3.5 gains were largest from **9B to 27B**, mainly improving precision rather than recall. Choose models against the exact extraction task, not parameter count. Dense 27B variants led larger sparse models on term typing, while **Mixture-of-Experts models** produced the strongest open-weight taxonomy-discovery results. Scaling was neither monotonic nor consistent across domains. Non-taxonomic relation extraction remained difficult, and the material gives no latency or cost comparison for the tested models.
Context Map
modeldataresearch#model-selection#open-modelsUncertainty
Scaling was neither monotonic nor consistent across domains. Non-taxonomic relation extraction remained difficult, and the material gives no latency or cost comparison for the tested models.