<?xml version="1.0" encoding="ISO-8859-1"?>
<!--
  This file uses MATHML. Internet Explorer does not support MATHML.
  You can use Mozilla to view this file. -->
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1 plus MathML 2.0//EN" "http://www.w3.org/TR/MathML2/dtd/xhtml-math11-f.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en" xmlns:math="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<head>
<title>Futility of Bias-Free Learning</title>
<meta name="AUTHOR" content="Jose M Vidal"></meta>
<meta name="GENERATOR" content="xslides.el, written by J.M. Vidal"></meta>
<link rel="next" href="summary.xml" title="Summary"/>
<link rel="previous" href="unbiasedlearner.xml"  title="Unbiased Learner"/>
<link rel="author" href="../../index.html" title="Jose M Vidal"/>
<link rel="parent" href="index.xml" title="Index"/>
<link rel="top" href="../index.html" title="Presentation List"/>

<link rel="stylesheet" type="text/css" href="../xslides-medwhite.css" title="White" media="all" />
 	    <link rel="alternate stylesheet" type="text/css" href="../xslides-medblue.css" title="Blue" media="all" />
 	    <link rel="alternate stylesheet" type="text/css" href="../xslides-usc.css" title="USCTheme" media="all" />
<script language="javascript" type="text/javascript" src="../scripts/stylehelper.js"></script>
</head>
<body>
<div class="navbar">
<p>
<a onclick="javascript:this.href=getURL('unbiasedlearner.xml');return true;" rel="prev" href="unbiasedlearner.xml" accesskey="P" title="Unbiased Learner">&larr;</a>
<a rel="index" href="index.xml" onclick="javascript:this.href=getURL('index.xml');return true;" accesskey="I" title="Index Page">^</a>
<a rel="next" href="summary.xml" onclick="javascript:this.href=getURL('summary.xml');return true;" accesskey="N" title="Summary">&rarr;</a>
</p>
</div>
<h1 class="slide">Futility of Bias-Free Learning</h1>
<div class="slidebody">
      <ul>
	<li><em>A learner that makes no a priori assumptions regarding
	the identity of the target concept has no rational basis for
	classifying any unseen instances.</em> </li>

	<li>So, what is the inductive bias? </li>

	<li>Given an algorithm <math xmlns="http://www.w3.org/1998/Math/MathML">
<mi>L</mi>

</math> and a set of training instances
	<math xmlns="http://www.w3.org/1998/Math/MathML">
<msub><mi>D</mi> <mi>c</mi></msub>
<mo>=</mo><mo>{</mo><mo>&langle;</mo><mi>x</mi><mo>,</mo><mi>c</mi><mo>(</mo><mi>x</mi><mo>)</mo><mo>&rangle;</mo><mo>}</mo>
</math>, let <math xmlns="http://www.w3.org/1998/Math/MathML">
<mi>L</mi>
<mo>(</mo><msub><mi>x</mi> <mi>i</mi></msub><mo>,</mo><msub><mi>D</mi> <mi>c</mi></msub><mo>)</mo>
</math> be the
	classification given to <math xmlns="http://www.w3.org/1998/Math/MathML">
<msub><mi>x</mi> <mi>i</mi></msub>

</math> by <math xmlns="http://www.w3.org/1998/Math/MathML">
<mi>L</mi>

</math> after training on
	<math xmlns="http://www.w3.org/1998/Math/MathML">
<msub><mi>D</mi> <mi>c</mi></msub>

</math>. The <dfn>inductive bias</dfn> of <math xmlns="http://www.w3.org/1998/Math/MathML">
<mi>L</mi>

</math> is any minimal set
	of assertions <math xmlns="http://www.w3.org/1998/Math/MathML">
<mi>B</mi>

</math> for any target concept <math xmlns="http://www.w3.org/1998/Math/MathML">
<mi>c</mi>

</math> and examples <math xmlns="http://www.w3.org/1998/Math/MathML">
<mi>D</mi>

</math>
	s.t.
	  <math xmlns="http://www.w3.org/1998/Math/MathML" mode="display">
<msub><mo>&forall;</mo> <mrow><msub><mi>x</mi> <mi>i</mi></msub>
<mo>&Element;</mo><mi>X</mi></mrow></msub>
<mi>B</mi><mo>&wedge;</mo><msub><mi>D</mi> <mi>c</mi></msub><mo>&wedge;</mo><msub><mi>x</mi> <mi>i</mi></msub><mo>&rarr;</mo><mi>L</mi><mo>(</mo><msub><mi>x</mi> <mi>i</mi></msub><mo>,</mo><msub><mi>D</mi> <mi>c</mi></msub><mo>)</mo>
</math>
	</li>

	<li>For example, the inductive bias of the
	  Candidate-Elimination algorithm (with voting) is the
	  assumption that the target concept is contained in the
	  hypothesis space. </li>

	<li>That is, if we make that assumption then the
	classification <em>follows logically (by
	deduction)</em>. </li>
      </ul>
    </div><hr class="bottom"/>
<table class="footer" cellspacing="0" cellpadding="0" border="0" width="97%" summary="footer">
<tr valign="bottom">
<td><p class="author"><a href="../../index.html">Jos&eacute; M. Vidal</a>
<a class="remote" href=" http://validator.w3.org/check?uri=http://jmvidal.cse.sc.edu/talks/conceptlearning/futilityofnobias.xml">.</a></p>
</td>
<td align="right"><p class="index">30 of 31</p></td>
</tr>
</table>
</body>
</html>