南京大学学报(自然科学版) ›› 2018, Vol. 54 ›› Issue (1): 148–.

• • 上一篇    下一篇

 序贯三支决策的代价敏感分类方法

 方 宇1,闵 帆1*,刘忠慧1,杨 新2   

  • 出版日期:2018-01-31 发布日期:2018-01-31
  • 作者简介:1.西南石油大学计算机科学学院,成都,610500;
    2.四川工商学院,成都,611745
  • 基金资助:
     基金项目:国家自然科学基金(41604114),西南石油大学科研启航计划(2014QHZ025),西南石油大学第二届中青年骨干教师项目
    收稿日期:2017-12-21
    *通讯联系人,E-mail:minfanphd@163.com

 Sequential three-way decisions based cost-sensitive approach to classification

 Fang Yu1,Min Fan1*,Liu Zhonghui1,Yang Xin2   

  • Online:2018-01-31 Published:2018-01-31
  • About author:1.School of Computer Science,Southwest Petroleum University,Chengdu,610500,China;
    2.Sichuan Technology and Business University,Chengdu,611745,China

摘要:  序贯三支决策体现了信息粒化和代价敏感学习的优势,其中信息粒化是人类认知和决策执行的基础,代价则是信息处理涉及的重要因素.提出针对代价敏感学习的序贯三支决策模型.首先,对信息粒化和决策代价之间的关系进行了定义和描述;然后,从序决策过程的视角,利用不同粒度层次的代价矩阵构建了代价函数;最后,为平衡决策结果代价和决策过程代价,提出了两个优化问题,并从理论上阐述了其意义,从实验结果分析上验证了算法的有效性,体现了序贯三支决策在代价敏感分类问题上的优势.

Abstract:  Sequential three-way decisions take the advantage of information granularity and various types of costs.Information granularity is the basis of human cognition and decision-making,while costs are usually considered as an important information processing related factor.In this paper,we propose a cost-sensitive sequential three-way decision(S3WD)model,the aim of which is to motivate,interpret and implement the three-way decision(3WD) through the notion of information granularity.We are essentially dealing with three difficulties while applying three-way decisions to cost-sensitive learning.The major difficulty is to construct a sequence of multi-level granularities for 3WD.Multi-granulation represents the information granularity with a partial ordering relation,which provides the semantics for the S3WD model.By constructing a family of equivalence classes of particular object with the change of the number of attributes,a series of coarsening-refinement granularities on information system is formalized.Therefore,we can obtain a complete description of a system with multi-granularity.The second difficulty involves the interpretations of evaluation and thresholds in S3WD.We study decision cost related to information granularity with sequential three-way decisions and focus on the formulations of the cost function according to the principle of coarsening-refinement granulating procedure of information acquirement.The decision cost is composed of the cost of decision result and the cost of decision process,which are two main costs in the cost-sensitive sequential three-way decision model.By utilizing the cost matrix,we construct a reasonable cost structure as evaluation metric for S3WD.The pair of thresholds(α,β)is also obtained.Theoretical analysis indicates that the cost structure has practical and meaningful interpretations of granularity-driven S3WD.The last,crucial difficulty is introducing the objective function to the cost structure.Since there is a trade-off between two costs,we define two optimization problems with the objective of either minimizing the cost of decision result or minimizing the cost of decision process.By solving the optimization problems,the minimal-result-cost S3WD and the minimal-process-cost S3WD are defined as finding optimized S3WD with a minimum cost of decision result or minimum cost of decision process respectively.Two heuristic approaches are designed correspondingly.For minimal-process-cost S3WD,the upper bound of cost of decision result is applied as an input parameter since the optimization problem is a combinational problem.Similar to the minimal-process-cost S3WD,we consider the upper bound of the cost of decision process as a user-defined input parameter for minimal-result-cost S3WD.The two optimization problems represent two risk attitudes of a decision maker in real world scenarios.The experimental results indicate that: 1)with the coarsening-refinement granulating,the cost of the decision result has non-monotonicity subsiding trend,and the cost of the decision process has surging monotonicity trend; 2)with the same number of attributes,the minimal-process-cost S3WD has a higher cost of the decision compared to the minimal-result-cost S3WD; 3)the upper bounds of the costs of the decision result and the upper bounds of the costs of the decision process have directly influence on the decision results; 4)the cost-sensitive S3WD is particularly appropriate for decision-making problems when information is unavailable and costly for on-demand details.

 [1] Hunt E B,Marin J,Stone P J.Experiments in induction.Oxford:Academic Press,1966,98-120.
[2] Turney P D.Cost-sensitive classification:Empirical evaluation of a hybrid genetic decision tree induction algorithm.Journal of Artificial Intelligence Research,1995,2(1):369-409.
[3] Yao Y Y.An outline of a theory of three-way decisions ∥ Proceedings of the 8th International Conference Rough Sets and Current Trends in Computing 2012.Springer Berlin Heidelberg,2012:1-17.
[4] Yao Y Y.Three-way decisions and cognitive computing.Cognitive Computation,2016,8(4):543-554.
[5] Yao Y Y.The superiority of three-way decisions in probabilistic rough set models.Information Sciences,2011,181(6):1080-1096.
[6] Deng X F,Yao Y Y.Decision-theoretic three-way approximations of fuzzy sets.Information Sciences,2014,279:702-715.
[7] Liu D,Li T R,Ruan D.Probabilistic model criteria with decision-theoretic rough sets.Information Sciences,2011,181(17):3709-3722. 
[8] Liu D,Liang D C,Wang C C.A novel three-way decision model based on incomplete information system.Knowledge-Based Systems,2016,91:32-45.
[9] Yao J T,Azam N.Web-based medical decision support systems for three-way medical decision making with game-theoretic rough sets.IEEE Transactions on Fuzzy Systems,2015,23(1):3-15.
[10] Yu H,Zhang C,Wang G Y.A tree-based incremental overlapping clustering method using the three-way decision theory.Knowledge-Based Systems,2016,91:189-203.
[11] Jia X Y,Liao W H,Tang Z M,et al.Minimum cost attribute reduction in decision-theoretic rough set models.Information Sciences,2013,219:151-167.
[12] Fujita H,Li T R,Yao Y Y.Advances in three-way decisions and granular computing.Knowledge-Based Systems,2016,91:1-3.
[13] Yao Y Y,Deng X F.A granular computing paradigm for concept learning ∥ Ramanna S,Jain L,Howlett R.Emerging Paradigms in Machine learning.Springer Berlin Heidelberg,2013:307-326.
[14] Yao Y Y.Granular computing and sequential three-way decisions ∥ Lingras P,Wolski M,CornelisC,et al.Rough Sets and Knowledge Technology.Springer Berlin Heidelberg,2013:16-27.
[15] Yao Y Y.A triarchic theory of granular computing.Granular Computing,2016,1(2):145-157.
[16] Min Fan,Zhu W.A competition strategy to cost-sensitive decision trees ∥ Li T R,Nguyen H S,Wang G Y,et al.Rough Sets and Knowledge Technology.Springer Berlin Heidelberg,2012:359-368.
No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!