Citation: WANG Zhi-Ming, HAN Na, YUAN Zhe-Ming, WU Zhao-Hua. Feature Selection for High-Dimensional Data Based on Ridge Regression and SVM and Its Application in Peptide QSAR Modeling[J]. Acta Physico-Chimica Sinica, ;2013, 29(03): 498-507. doi: 10.3866/PKU.WHXB201301042 shu

Feature Selection for High-Dimensional Data Based on Ridge Regression and SVM and Its Application in Peptide QSAR Modeling

WANG Zhi-Ming ^1,2,3 ,
HAN Na ^1,2 ,
YUAN Zhe-Ming ^1,2 ,
WU Zhao-Hua ³

1.
1 Hunan Provincial Key Laboratory of Crop Germplasm Innovation and Utilization, Changsha 410128, P. R. China;
2 Hunan Provincial Key Laboratory for Biology and Control of Plant Diseases and Insect Pests, Changsha, 410128, P. R. China;
3 College of Science, Hunan Agricultural University, Changsha 410128, P. R. China

Received Date: 24 September 2012
Available Online: 4 January 2013
Fund Project: 湖南省杰出青年科学基金(10JJ1005) (10JJ1005)教育部博士点基金(20124320110002)资助项目 (20124320110002)

Absolute weight values estimated from test data by ridge regression (RR) can reflect the significance of corresponding features. Based on RR and support vector machine (SVM), a new feature selection al rithm for high-dimensional data is proposed. Examples from bitter tasting thresholds (BTT) and cytotoxic T lymphocyte (CTL) epitopes are presented. All 531 physicochemical property parameters were employed to express each residue of one peptide, thus 1062 and 4779 descriptors were obtained for BTT and CTL, respectively. Each sample was divided into training and test sets, and weight estimates of all training set descriptors were generated by RR. According to the descending order of the weights, corresponding features were gradually selected until the mean square error (MSE) of leave-one-out cross validation (LOOCV) increased significantly. Based on smaller training datasets obtained from the previous step, the reserved features were available from multiple elimination rounds. 7 and 18 descriptors were selected by the new method for BTT and CTL, respectively. A quantitative structure-activity relationship (QSAR) model based on support vector regression (SVR) was established on extracted data with the reserved descriptors, and was then used for test data prediction. The fitting, LOOCV, and external prediction accuracies were significantly improved with respect to reported literature values. Because of the calculation speed, clear physicochemical meaning, and ease of interpretation, the new method is widely applicable to regression forecasting of high-dimensional data such as QSAR modeling of peptide or proteins.
- Quantitative structure-activity relationship,
- Support vector machine,
- Ridge regression,
- Feature selection,
- High-dimensional feature
1. [1]
  
  (1) Ding, J. L.; Ho, B. Drug Dev. Res. 2004, 62 (4), 317.
2. [2]
  (2) Anfinsen, C. B.; Haber, E.; Sela, M.; White, F. H., Jr. Proc.Natl. Acad. Sci . U. S. A. 1961, 47, 1309. doi: 10.1073/pnas.47.9.1309
3. [3]
  (3) Sneath, P. H. J. Theor. Biol. 1966, 12 (2), 157. doi: 10.1016/0022-5193(66)90112-3
4. [4]
  (4) Kidera, A.; Konishi, Y.; Oka, M.; Ooi, T.; Scheraga, H. A.J. Protein Chem. 1985, 4 (1), 23. doi: 10.1007/BF01025492
5. [5]
  (5) Hellberg, S.; Eriksson, L.; Jonsson, J.; Lindgren, F.; Sjöström,M.; Skagerberg, B.;Wold, S.; Andrews, P. Int. J. Pept. ProteinRes. 1991, 37 (5), 414.
6. [6]
  (6) Sandberg, M.; Eriksson, L.; Jonsson, J.; Sjöström, M.;Wold, S.J. Med. Chem. 1998, 41 (14), 2481. doi: 10.1021/jm9700575
7. [7]
  (7) Liang, G. Z.; Mei, H.; Zhou, P.; Zhou, Y.; Li, Z. L. ActaPhys. -Chim. Sin. 2006, 22, 388. [梁桂兆, 梅虎, 周鹏,周原, 李志良. 物理化学学报, 2006, 22, 388.] doi: 10.3866/PKU.WHXB20060327
8. [8]
  (8) Liang, G. Z.; Zhou, P.; Zhou, Y.; Zhang, Q. X.; Li, Z. L. ActaChim. Sin. 2006, 64 (5), 393. [梁桂兆, 周鹏, 周原, 张巧霞, 李志良. 化学学报, 2006, 64 (5), 393.]
9. [9]
  (9) Zhou, Y.; Mei, H.; Yang, L.; Zhou, P.; Yang, S. B.; Li, Z. L.Chem. J. Chin. Univ. 2007, 28 (7), 1263. [周原, 梅虎,杨力, 周鹏, 杨善斌, 李志良. 高等学校化学学报, 2007,28 (7), 1263.]
10. [10]
  (10) Yang, S. B.; Xia, Z. N.; Shu, M.; Mei, H.; Lü, F. L.; Zhang, M.;Wu, Y. Q.; Li, Z. L. Chem. J. Chin. Univ. 2008, 29 (11), 2213.[杨善彬, 夏之宁, 舒茂, 梅虎, 吕凤林, 张梅, 吴玉乾,李志良. 高等学校化学学报, 2008, 29 (11), 2213.]
11. [11]
  (11) Li, Z. L.; Li, G. R.; Shu, M.; Sun, J. Y.; Yang, S. B.; Mei, H.;Zhang, M. J.; Zhou, P.;Wu, S. R.; Chen, G. H.; Lü, F. L.; Lü, T.T. Sci. China Ser. B: Chem. 2008, 38 (8), 745. [李志良, 李根容, 舒茂, 孙家英, 杨善斌, 梅虎, 张梦军, 周萍, 吴世荣,陈国华, 吕凤林, 吕廷亭. 中国科学B 辑: 化学, 2008, 38 (8),745.]
12. [12]
  (12) Kawashima, S.; Pokarowski, P.; Pokarowska, M.; Kolinski, A.;Katayama, T.; Kanehisa, M. Nucl. Acids Res. 2008, 36 (1),D202.
13. [13]
  (13) Dash, M.; Liu, H. Intell. Data Anal. 1997, 1 (3), 131.
14. [14]
  (14) lub, T. R.; Slonim, D. K.; Tamayo, P.; Huard, C.;Gaasenbeek, M.; Mesirov, J. P.; Coller, H.; Loh, M. L.;Downing, J. R.; Caligiuri, M. A.; Bloomfield, C. D.; Lander, E.S. Science 1999, 286 (5439), 531. doi: 10.1126/science.286.5439.531
15. [15]
  (15) Kononerko, I. Estimating Attributes: Analysis and Extension ofRelief. In Lecture Notes in Computer Science, Proceedings ofEuropean Conference on Machine Learning, Catania, Italy,April 6-8, 1994; Bergadano, F., Raedt, L. D. Eds.; Springer:Heidelberg, 1994; pp 171-182.
16. [16]
  (16) Liu, H.; Setiono, R. A Probabilistic Approach to FeatureSelection-a Filter Solution. In Machine Learning, Proceedingsof the Thirteenth International Conference on MachineLearning, Bari, Italy, July 3-6, 1996; Saitta, L. Ed.; MorganKaufmann: San Fransisco, 1996; pp 319-327.
17. [17]
  (17) Kohavi, R.; John, G. H. Artif. Intel. 1997, 97 (1-2), 273.doi: 10.1016/S0004-3702(97)00043-X
18. [18]
  (18) Destrero, A.; Mosci, S.; De Mol, C.; Verri, A.; Odone, F.Comput. Manag. Sci. 2008, 6 (1), 25.
19. [19]
  (19) Vapnik, V. N. The Nature of Statistical Learning Theory;Springer-Verlag: New York, 1995; pp 87-189.
20. [20]
  (20) Hoerl, A. E.; Kennard, R.W. Technometrics 1970, 12, 55.doi: 10.1080/00401706.1970.10488634
21. [21]
  (21) Tan, X. S.; Yuan, Z. M.; Zhou, T. J.;Wang, C. J.; Xiong, J. Y.Chem. J. Chin. Univ. 2008, 29 (1), 95. [谭显胜, 袁哲明, 周铁军, 王春娟, 熊洁仪. 高等学校化学学报, 2008, 29 (1), 95.]
22. [22]
  (22) Chang, C. C.; Lin, C. J. ACM TIST 2011, 2 (3), 1.
23. [23]
  (23) Tropsha, A.; Gramatica, P.; mbar, V. K. QSAR Comb. Sci.2003, 22 (1), 69.
24. [24]
  (24) Cocchi, M.; Johansson, E. Quant. Struct. -Act. Relat. 1993, 12 (1), 1. doi: 10.1002/qsar.v12:1
25. [25]
  (25) Collantes, E. R.; Dunn,W. J., III. J. Med. Chem. 1995, 38 (14),2705. doi: 10.1021/jm00014a022
26. [26]
  (26) Mei, H.; Liang, G. Z.; Zhou, Y.; Li, Z. L. Chin. Sci. Bull. 2005,50 (16), 1703. [梅虎, 梁桂兆, 周原, 李志良. 科学通报,2005, 50 (16), 1703.] doi: 10.1360/982005-58
27. [27]
  (27) Mei, H.; Zhou, Y.; Sun, L. L.; Li, Z. L. Chemistry 2005, (7),534. [梅虎, 周原, 孙立力, 李志良. 化学通报, 2005, (7),534.] doi: 10.3870/zgzzhx.2012.01.022
28. [28]
  (28) Liang, G. Z. Construction of Representation Techniques andInvestigation on Structure-Activity Relationship for BiologicalSequences. Ph. D. Dissertation, Chongqing University,Chongqing, 2007. [梁桂兆. 生物序列表征体系构建及结构与功能关系研究[D]. 重庆: 重庆大学, 2007.]
29. [29]
  (29) Tan, X. S.;Wang, Z. M.; Tan, S. Q.; Yuan, Z. M.; Xiong, X. Y.Journal of System Simulation 2009, 21 (24), 7795. [谭显胜,王志明, 谭泗桥, 袁哲明, 熊兴耀. 系统仿真学报, 2009, 21 (24), 7795.]
30. [30]
  (30) Meek, J. L. Proc. Natl. Acad. Sci. U. S. A. 1980, 77 (3), 1632.doi: 10.1073/pnas.77.3.1632
31. [31]
  (31) Harpaz, Y.; Gerstein, M.; Chothia, C. Structure 1994, 2 (7), 641.doi: 10.1016/S0969-2126(00)00065-4
32. [32]
  (32) Chothia, C. Nature 1975, 254 (5498), 304. doi: 10.1038/254304a0
33. [33]
  (33) Rackovsky, S.; Scheraga, H. A. Macromolecules 1982, 15 (5),1340. doi: 10.1021/ma00233a025
34. [34]
  (34) Robson, B.; Suzuki, E. J. Mol. Biol. 1976, 107 (3), 327. doi: 10.1016/S0022-2836(76)80008-3
35. [35]
  (35) Parker, J. M. R.; Guo, D.; Hodges, R. S. Biochemistry 1986, 25 (19), 5425. doi: 10.1021/bi00367a013
36. [36]
  (36) Bundi, A.;Wüthrich, K. Biopolymers 1979, 18 (2), 285.
37. [37]
  (37) Mei, H.; Zhou, Y.; Liao, Z. H.; Li, Z. L. Acta Chim. Sin. 2006,64 (9), 949. [梅虎, 周原, 廖志华, 李志良. 化学学报,2006, 64 (9), 949.]
38. [38]
  (38) Frahm, N.; Korber, B. T.; Adams, C. M.; Szinger, J. J.; Draenert,R.; Addo, M. M.; Feeney, M. E.; Yusim, K.; San , K.; Brown,N. V.; SenGupta, D.; Piechocka-Trocha, A.; Simonis, T.;Marincola, F. M.;Wurcel, A. G.; Stone, D. R.; Russell, C. J.;Adolf, P.; Cohen, D.; Roach, T.; StJohn, A.; Khatri, A.; Davis,K.; Mullins, J.; ulder, P. J. R.;Walker, B. D.; Brander, C.J. Virol. 2004, 78 (5), 2187. doi: 10.1128/JVI.78.5.2187-2200.2004
39. [39]
  (39) Doytchinova, I. A.; Flower, D. R. J. Med. Chem. 2001, 44,3572. doi: 10.1021/jm010021j
40. [40]
  (40) Liang, G. Z.; Li, S. Z. Biopolymers 2007, 88 (3), 401. doi: 10.1002/bip.v88:3
41. [41]
  (41) Levitt, M. J. Mol. Biol. 1976, 104, 59. doi: 10.1016/0022-2836(76)90004-8
42. [42]
  (42) Tsai, J.; Taylor, R.; Chothia, C.; Gerstein, M. J. Mol. Biol. 1999,290 (1), 253. doi: 10.1006/jmbi.1999.2829
43. [43]
  (43) Biou, V.; Gibrat, J. F.; Levin, J. M.; Robson, B.; Garnier, J.Protein Eng. 1988, 2 (3), 185. doi: 10.1093/protein/2.3.185
44. [44]
  (44) Schwartz, R.; Istrail, S.; King, J. Protein Science 2001, 10 (5),1023.
45. [45]
  (45) Sueki, M.; Lee, S.; Powers, S. P.; Denton, J. B.; Konishi, Y.;Scheraga, H. A. Macromolecules 1984, 17 (2), 148. doi: 10.1021/ma00132a006
46. [46]
  (46) Chothia, C. Nature 1974, 248, 338. doi: 10.1038/248338a0
47. [47]
  (47) Naderi-Manesh, H.; Sadeghi, M.; Arab, S.; Moosavi Movahedi,A. A. Proteins 2001, 42 (4), 452. doi: 10.1002/1097-0134(20010301)42:4<>1.0.CO;2-N
1. [1]
  Shihui Shi , Haoyu Li , Shaojie Han , Yifan Yao , Siqi Liu . Regioselectively Synthesis of Halogenated Arenes via Self-Assembly and Synergistic Catalysis Strategy. University Chemistry, 2024, 39(5): 336-344. doi: 10.3866/PKU.DXHX202312002
2. [2]
  Peiran ZHAO , Yuqian LIU , Cheng HE , Chunying DUAN . A functionalized Eu³⁺ metal-organic framework for selective fluorescent detection of pyrene. Chinese Journal of Inorganic Chemistry, 2024, 40(4): 713-724. doi: 10.11862/CJIC.20230355
3. [3]
  Jun LUO , Baoshu LIU , Yunchang ZHANG , Bingkai WANG , Beibei GUO , Lan SHE , Tianheng CHEN . Europium(Ⅲ) metal-organic framework as a fluorescent probe for selectively and sensitively sensing Pb²⁺ in aqueous solution. Chinese Journal of Inorganic Chemistry, 2024, 40(12): 2438-2444. doi: 10.11862/CJIC.20240240
4. [4]
  Jing SU , Bingrong LI , Yiyan BAI , Wenjuan JI , Haiying YANG , Zhefeng Fan . Highly sensitive electrochemical dopamine sensor based on a highly stable In-based metal-organic framework with amino-enriched pores. Chinese Journal of Inorganic Chemistry, 2024, 40(7): 1337-1346. doi: 10.11862/CJIC.20230414
5. [5]
  Yuanpei ZHANG , Jiahong WANG , Jinming HUANG , Zhi HU . Preparation of magnetic mesoporous carbon loaded nano zero-valent iron for removal of Cr(Ⅲ) organic complexes from high-salt wastewater. Chinese Journal of Inorganic Chemistry, 2024, 40(9): 1731-1742. doi: 10.11862/CJIC.20240077
6. [6]
  Ling Zhang , Jing Kang . Turn Waste into Valuable: Preparation of High-Strength Water-Based Adhesives from Polymethylmethacrylate Wastes: a Comprehensive Chemical Experiments. University Chemistry, 2024, 39(2): 221-226. doi: 10.3866/PKU.DXHX202306075
7. [7]
  Wenliang Wang , Weina Wang , Lixia Feng , Nan Wei , Sufan Wang , Tian Sheng , Tao Zhou . Proof and Interpretation of Severe Spectroscopic Selection Rules. University Chemistry, 2025, 40(3): 415-424. doi: 10.12461/PKU.DXHX202408063
8. [8]
  Yunhao Zhang , Yinuo Wang , Siran Wang , Dazhen Xu . Progress in Selective Construction of Functional Aromatics from Nitrogenous Cycloalkanes. University Chemistry, 2024, 39(11): 136-145. doi: 10.3866/PKU.DXHX202401083
9. [9]
  Jiakun BAI , Ting XU , Lu ZHANG , Jiang PENG , Yuqiang LI , Junhui JIA . A red-emitting fluorescent probe with a large Stokes shift for selective detection of hypochlorous acid. Chinese Journal of Inorganic Chemistry, 2024, 40(6): 1095-1104. doi: 10.11862/CJIC.20240002
10. [10]
  Xilin Zhao , Xingyu Tu , Zongxuan Li , Rui Dong , Bo Jiang , Zhiwei Miao . Research Progress in Enantioselective Synthesis of Axial Chiral Compounds. University Chemistry, 2024, 39(11): 158-173. doi: 10.12461/PKU.DXHX202403106
11. [11]
  .
  CCS Chemistry | 超分子活化底物为自由基促进高效选择性光催化氧化
  . CCS Chemistry, 2025, 7(10.31635/ccschem.025.202405229): -.
12. [12]
  Zongpei Zhang , Yanyang Li , Yanan Si , Kai Li , Shuangquan Zang . Developing a Chemistry Experiment Center Employing a Multifaceted Approach to Serve High-Quality Laboratory Education. University Chemistry, 2024, 39(7): 13-19. doi: 10.12461/PKU.DXHX202404041
13. [13]
  Tianqi Bai , Kun Huang , Fachen Liu , Ruochen Shi , Wencai Ren , Songfeng Pei , Peng Gao , Zhongfan Liu . 石墨烯厚膜热扩散系数与微观结构的关系. Acta Physico-Chimica Sinica, 2025, 41(3): 2404024-. doi: 10.3866/PKU.WHXB202404024
14. [14]
  Min Gu , Huiwen Xiong , Liling Liu , Jilie Kong , Xueen Fang . Rapid Quantitative Detection of Procalcitonin by Microfluidics: An Instrumental Analytical Chemistry Experiment. University Chemistry, 2024, 39(4): 87-93. doi: 10.3866/PKU.DXHX202310120
15. [15]
  Jie ZHAO , Sen LIU , Qikang YIN , Xiaoqing LU , Zhaojie WANG . Theoretical calculation of selective adsorption and separation of CO₂ by alkali metal modified naphthalene/naphthalenediyne. Chinese Journal of Inorganic Chemistry, 2024, 40(3): 515-522. doi: 10.11862/CJIC.20230385
16. [16]
  Junjie Zhang , Yue Wang , Qiuhan Wu , Ruquan Shen , Han Liu , Xinhua Duan . Preparation and Selective Separation of Lightweight Magnetic Molecularly Imprinted Polymers for Trace Tetracycline Detection in Milk. University Chemistry, 2024, 39(5): 251-257. doi: 10.3866/PKU.DXHX202311084
17. [17]
  Peng YUE , Liyao SHI , Jinglei CUI , Huirong ZHANG , Yanxia GUO . Effects of Ce and Mn promoters on the selective oxidation of ammonia over V₂O₅/TiO₂ catalyst. Chinese Journal of Inorganic Chemistry, 2025, 41(2): 293-307. doi: 10.11862/CJIC.20240210
18. [18]
  Baitong Wei , Jinxin Guo , Xigong Liu , Rongxiu Zhu , Lei Liu . Theoretical Study on the Structure, Stability of Hydrocarbon Free Radicals and Selectivity of Alkane Chlorination Reaction. University Chemistry, 2025, 40(3): 402-407. doi: 10.12461/PKU.DXHX202406003
19. [19]
  Shanghua Li , Malin Li , Xiwen Chi , Xin Yin , Zhaodi Luo , Jihong Yu . 基于高离子迁移动力学的取向ZnQ分子筛保护层实现高稳定水系锌金属负极的构筑. Acta Physico-Chimica Sinica, 2025, 41(1): 2309003-. doi: 10.3866/PKU.WHXB202309003
20. [20]
  Ling Bai , Limin Lu , Xiaoqiang Wang , Dongping Wu , Yansha Gao . Exploration and Practice of Teaching Reforms in “Quantitative Analytical Chemistry” under the Perspective of New Agricultural Science. University Chemistry, 2024, 39(3): 158-166. doi: 10.3866/PKU.DXHX202308101

Get Citation

PDF

XML

Metrics

PDF Downloads(745)
Abstract views(1214)
HTML views(44)

通讯作者: 陈斌, bchen63@163.com

1.
沈阳化工大学材料科学与工程学院沈阳 110142