The influence of training actives/inactives ratio on machine learning performance
Journal of Cheminformatics volume 5, Article number: P30 (2013)
In drug discovery, machine learning is widely used to classify molecules as active or inactive against a particular target. The vast majority of these methods (supervised learning) needs a training set of objects (molecules) to develop a decision rule that can be used to classify new entities (the test set) into one of the two mentioned classes .
A lot of studies, searching an optimal learning parameters and their impact on classification effectiveness were performed [2, 3]. Unfortunately, there is no data showing the influence of actives/inactives ratio, used to model training, on the efficiency of new active compounds identification. Therefore, the main goal of this study was to examine the impact of changing the number of inactives in the training set with fixed amount of actives. For a given ratio, the inactives were randomly selected from ZINC database (10-times to prevent an overestimations error). This concept was verified on three different protein targets (i.e. 5-HT1A, HIV-1 protease and matrix metalloproteinase) and a set of algorithms (SMO, Naïve Bayes, Ibk, J48 and Random Forest) implemented in WEKA package . To compounds representation, two types of molecular fingerprints were used (MACCS and hashed fingerprint), to determine their possible impact on machine learning performance.
Melville JL, Burke EK, Hirst JD: Machine learning in virtual screening. Comb Chem & High Thr Scr. 2009, 12: 332-343.
Ma XH, Wang R, Yang SY, Li R, Xue Y, Wei YC, Low BC, Chen YZ: Evaluation of virtual screening performance of support vector machines trained by sparsely distributed active compounds. J Chem Inf Mod. 2008, 48: 1227-1237. 10.1021/ci800022e.
Plewczynski D, Spieser SH, Koch U: Assessing different classification methods for virtual screening. J Chem Inf Mod. 2006, 46: 1098-106. 10.1021/ci050519k.
Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH: The WEKA data mining software: an update. SIGKDD Explorations. 2009, 11 (1): 10-18. 10.1145/1656274.1656278.
The study was supported by a grant PRELUDIUM 2011/03/N/NZ2/02478 financed by the National Science Centre.
About this article
Cite this article
Kurczab, R., Smusz, S. & Bojarski, A.J. The influence of training actives/inactives ratio on machine learning performance. J Cheminform 5 (Suppl 1), P30 (2013). https://doi.org/10.1186/1758-2946-5-S1-P30
- Machine Learning
- Decision Rule
- Drug Discovery
- Supervise Learning