An MML embedded approach for estimating the number of clusters

Silvestre, Cláudia; Cardoso, Margarida; Figueiredo, Mário

http://hdl.handle.net/10400.21/15258

Use this identifier to reference this record.

Name:	Description:	Size:	Format:
IFCS2022-Programme.pdf		181.73 KB	Adobe PDF	Download

Send Feedback

Authors

Silvestre, Cláudia

Cardoso, Margarida

Figueiredo, Mário

Abstract(s)

Assuming that the data originate from a finite mixture of multinomial distributions, we study the performance of an integrated Expectation Maximization (EM) algorithm considering Minimum Message Length (MML) criterion to select the number of mixture components. The referred EM-MML approach, rather than selecting one among a set of pre-estimated candidate models (which requires running EM several times), seamlessly integrates estimation and model selection in a single algorithm. Comparisons are provided with EM combined with well-known information criteria – e.g. the Bayesian information Criterion. We resort to synthetic data examples and a real application. The EM-MML computation time is a clear advantage of this method; also, the real data solution it provides is more parsimonious, which reduces the risk of model order overestimation and improves interpretability.

Keywords

Finite mixture model Em algorithm Model selection Minimum message length Categorical data

URI

http://hdl.handle.net/10400.21/15258

Citation

Silvestre, C., Cardoso, M. & Figueiredo, M. (2022, julho, 22-23). An MML embedded approach for estimating the number of clusters. Paper presented at 17th Conference of the IFCS 2022– International Federation of Classification Societies: Classification and Data Science in the Digital Age. Porto, Portugal.