Showing posts with label Bayesian_models. Show all posts
Showing posts with label Bayesian_models. Show all posts

Sunday, 20 May 2018

Inductive reasoning 2.0

an article by Brett K. Hayes (University of New South Wales, Sydney, Australia) and Evan Heit (University of California, Merced, USA) published in WIREs Cognitive SCience Volume 9 Issue 3 (May/June 2018)

Abstract

Inductive reasoning entails using existing knowledge to make predictions about novel cases.

The first part of this review summarizes key inductive phenomena and critically evaluates theories of induction. We highlight recent theoretical advances, with a special emphasis on the structured statistical approach, the importance of sampling assumptions in Bayesian models, and connectionist modeling.

A number of new research directions in this field are identified including comparisons of inductive and deductive reasoning, the identification of common core processes in induction and memory tasks and induction involving category uncertainty.

The implications of induction research for areas as diverse as complex decision‐making and fear generalization are discussed.

Full text (PDF 13pp)



Wednesday, 11 April 2012

A new term-weighting scheme for naïve Bayes text categorization

an article by Marcelo Mendoza (Universidad Técnica Federico Santa María, Santiago, Chile) published in International Journal of Web Information Systems Volume 8 Issue 1 (2012)

Abstract

Purpose
Automatic text categorization has applications in several domains, for example e-mail spam detection, sexual content filtering, directory maintenance, and focused crawling, among others. Most information retrieval systems contain several components which use text categorization methods. One of the first text categorization methods was designed using a naïve Bayes representation of the text. Currently, a number of variations of naïve Bayes have been discussed. The purpose of this paper is to evaluate naïve Bayes approaches on text categorization introducing new competitive extensions to previous approaches.
Design/methodology/approach
The paper focuses on introducing a new Bayesian text categorization method based on an extension of the naïve Bayes approach. Some modifications to document representations are introduced based on the well-known BM25 text information retrieval method. The performance of the method is compared to several extensions of naïve Bayes using benchmark datasets designed for this purpose. The method is compared also to training-based methods such as support vector machines and logistic regression.
Findings
The proposed text categorizer outperforms state-of-the-art methods without introducing new computational costs. It also achieves performance results very similar to more complex methods based on criterion function optimization as support vector machines or logistic regression.
Practical implications
The proposed method scales well regarding the size of the collection involved. The presented results demonstrate the efficiency and effectiveness of the approach.
Originality/value
The paper introduces a novel naïve Bayes text categorization approach based on the well-known BM25 information retrieval model, which offers a set of good properties for this problem.