RISE

Overview

Several well-developed approaches to inductive learning now exist, but each has specific limitations that are hard to overcome. Multi-strategy learning attempts to tackle this problem by combining multiple methods in one algorithm. This project unifies two of the most widely-used approaches: rule induction and instance-based learning. In the new RISE algorithm, instances are treated as maximally specific rules, and classification is performed using a best-match strategy. Rules are learned by gradually generalizing instances until no improvement in apparent accuracy is obtained. Theoretical analysis shows this approach to be efficient. In an extensive empirical study, RISE consistently achieves higher accuracies than state-of-the-art representatives of both its parent approaches (PEBLS and CN2), as well as a decision tree learner (C4.5). Lesion studies show that each of RISE's components is essential to this performance. Most significantly, in 14 of the 30 domains studied, RISE is more accurate than the best of PEBLS and CN2, showing that a significant synergy can be obtained by combining multiple empirical methods.

Publications

• Domingos. A Unified Approach to Concept Learning. Ph.D. Dissertation. 1997.
• Domingos. Context-Sensitive Feature Selection for Lazy Learners. In Artificial Intelligence Review. 1997.
• Domingos. From Instances to Rules: A Comparison of Biases. In Proceedings of the Third International Workshop on Multistrategy Learning. 1996.
• Domingos. Two-Way Induction. In International Journal on Artificial Intelligence Tools. 1996.
• Domingos. Using Partitioning to Speed Up Specific-to-General Rule Induction. In Proceedings of the AAAI-96 Workshop on Integrating Multiple Learned Models. 1996.
• Domingos. Unifying Instance-Based and Rule-Based Induction. In Machine Learning. 1996.
• Domingos. Two-Way Induction. In Proceedings of the Seventh IEEE International Conference on Tools with Artificial Intelligence. 1995.
• Domingos. Rule Induction and Instance-Based Learning: A Unified Approach. In Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence. 1995.
• Domingos. The RISE System: Conquering Without Separating. In Proceedings of the Sixth IEEE International Conference on Tools with Artificial Intelligence. 1994.