SOURCE-LINKED INTELLIGENCE

Training seeds and model-selection stability in recommender-system evaluation

arXiv · AI, language, vision and robotics · article · Sep 2, 2026 · UTC

Recommender-system experiments often rely on a single random training seed, assuming that run-to-run stochasticity has limited impact on evaluation conclusions. This assumption is risky, as a training seed may influence several algorithm-dependent mechanisms, including parameter initialization, mini-batch ordering, dropout, masking, latent sampling, and training-time negative sampling. We examine this assumption by fixing the data partition and varying the training seed across hyperparameter configurations. We analyze seed effects at three levels: user-level metric sensitivity, validation-base

Read original source ↗ Open in workspace

recordType

paper

region

Global