Little o notation: Difference between revisions

From Citizendium
Jump to navigation Jump to search
imported>Aleksander Stos
(suspended until found in refs)
imported>Aleksander Stos
(reinstate traditional notation)
Line 2: Line 2:
The '''little o notation''' is a mathematical notation which indicates that the decay (respectively, growth) rate of a certain function or sequence is faster (respectively, slower) than that of another function or sequence. It is often used in particular applications in [[physics]], [[computer science]], [[engineering]] and other [[applied sciences]].  
The '''little o notation''' is a mathematical notation which indicates that the decay (respectively, growth) rate of a certain function or sequence is faster (respectively, slower) than that of another function or sequence. It is often used in particular applications in [[physics]], [[computer science]], [[engineering]] and other [[applied sciences]].  


More formally, if ''f'' and ''g''  are real valued functions of the real numbers then the notation <math>f(t)=o(g(t))</math> indicates that  
More formally, if ''f'' and ''g''  are real valued functions of the real numbers then the notation <math>f(t)=o(g(t))</math> indicates that for every real number <math>\epsilon>0</math> there exists a positive real number <math>T(\epsilon)</math> (note the dependence of ''T'' on <math>\epsilon</math>) such that <math>|f(t)|\leq \epsilon |g(t)|</math> for all <math>t>T(\epsilon).</math>  
<!-- :<math> \lim_{t\to\infty} \frac{f(t)}{g(t)} = 0.</math>
This means that ''f'' becomes infinitely small with respect to ''g'' when ''t'' increases. In mathematical terms, -->for every real number <math>\epsilon>0</math> there exists a positive real number <math>T(\epsilon)</math> (note the dependence of ''T'' on <math>\epsilon</math>) such that <math>|f(t)|\leq \epsilon |g(t)|</math> for all <math>t>T(\epsilon).</math>  


Similarly, if <math>a_n</math> and <math>b_n</math> are two numerical sequences then <math>a_n=O(b_n)</math> means that for any <math>\varepsilon>0</math> and ''n'' big enough one has <math>|a_n|\leq \epsilon |b_n|.</math>
When the function ''g'' does not vanish this may be rewritten simply as
<!--the fraction <math>\frac{|a_n|}{|b_n|}</math> tends to 0 when <math>n</math> tends to infinity.-->
:<math> \lim_{t\to\infty} \frac{f(t)}{g(t)} = 0,</math>
a widely used formulation.
 
Similarly, if <math>a_n</math> and <math>b_n</math> are two numerical sequences then <math>a_n=O(b_n)</math> means that for any <math>\varepsilon>0</math> and ''n'' big enough one has <math>|a_n|\leq \epsilon |b_n| </math> (in the case when <math>b_n</math> is not zero, this means the limit of the fraction <math>a_n/b_n</math> is 0)


The little o notation is also often used to indicate that the absolute value of a real valued function goes to zero around some point at a rate faster than at which the absolute value of another function goes to zero at the same point. For example, suppose that ''f'' is a function with <math>f(t_0)=0</math> for some real number <math>t_0</math>. Then the notation  <math>f(t)=o(g(t-t_0))</math>, where ''g(t)'' is a function which is [[continuity|continuous]] at ''t=0'' and with ''g(0)=0'',  denotes that for every real number <math>\epsilon>0</math> there exists a [[topological space#Some topological notions|neighbourhood]] <math>N(\epsilon)</math> of <math>t_0</math> such that <math>|f(t)|\leq \epsilon |g(t-t_0)|</math> holds on <math>N(\epsilon)</math>.  
The little o notation is also often used to indicate that the absolute value of a real valued function goes to zero around some point at a rate faster than at which the absolute value of another function goes to zero at the same point. For example, suppose that ''f'' is a function with <math>f(t_0)=0</math> for some real number <math>t_0</math>. Then the notation  <math>f(t)=o(g(t-t_0))</math>, where ''g(t)'' is a function which is [[continuity|continuous]] at ''t=0'' and with ''g(0)=0'',  denotes that for every real number <math>\epsilon>0</math> there exists a [[topological space#Some topological notions|neighbourhood]] <math>N(\epsilon)</math> of <math>t_0</math> such that <math>|f(t)|\leq \epsilon |g(t-t_0)|</math> holds on <math>N(\epsilon)</math>.  

Revision as of 06:04, 13 October 2007

This article is a stub and thus not approved.
Main Article
Discussion
Related Articles  [?]
Bibliography  [?]
External Links  [?]
Citable Version  [?]
 
This editable Main Article is under development and subject to a disclaimer.

The little o notation is a mathematical notation which indicates that the decay (respectively, growth) rate of a certain function or sequence is faster (respectively, slower) than that of another function or sequence. It is often used in particular applications in physics, computer science, engineering and other applied sciences.

More formally, if f and g are real valued functions of the real numbers then the notation indicates that for every real number there exists a positive real number (note the dependence of T on ) such that for all

When the function g does not vanish this may be rewritten simply as

a widely used formulation.

Similarly, if and are two numerical sequences then means that for any and n big enough one has (in the case when is not zero, this means the limit of the fraction is 0)

The little o notation is also often used to indicate that the absolute value of a real valued function goes to zero around some point at a rate faster than at which the absolute value of another function goes to zero at the same point. For example, suppose that f is a function with for some real number . Then the notation , where g(t) is a function which is continuous at t=0 and with g(0)=0, denotes that for every real number there exists a neighbourhood of such that holds on .

See also

Big O notation