AI RESEARCH
How Many Trees in a Random Forest? A Revisited Approach with Plateau Search and Optuna Integration
arXiv CS.LG
•
ArXi:2606.03549v1 Announce Type: new Hyperparameter optimization (HPO) for Random Forest faces a specific difficulty in tuning the number of trees: the predictive score typically improves monotonically with ensemble size, so standard methods such as Tree-structured Parzen Estimator (TPE) and Hyperband require a predefined search range and often drive the estimate toward its right boundary. Early-stopping strategies avoid fixing such a range, but can be sensitive to score noise and prone to premature stopping.