From the source
LG AI Research introduces Segment-based Topic Allocation (SBTA), a method that assigns text segments to topics rather than entire documents, reducing topic contamination.
They also propose the Segment Intrusion benchmark for evaluating topic coherence.
Experiments show that LLMs using SBTA outperform traditional methods like LDA and BERTopic on the SemEval-STM benchmark.






