Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

Am studying the basic concepts of RKHS and the representer theorem: In $f(x_i)=<f,k(x_i,\mathbb{.})>$, what does $ f$ on the r.h.s denote? What is its structure-is it a vector? I was thinking that $k(x_i,\mathbb{.})$ would be a vector and $f$ should be one. Some formal-yet simplified explanation would help me get a head-start in my reading!

share|improve this question
    
Can you add some more context? Usually, yes $\langle u,v\rangle$ denotes the scalar product of vectors (ie. elements of the Hilbert space). –  Berci Oct 20 '12 at 20:24
    
I have been reading this cs.berkeley.edu/~bartlett/courses/281b-sp08/8.pdf - I find it very interesting- but the notation that is getting missed for me- is blocking my read! Do look at the notation in here. –  qlinck Oct 20 '12 at 20:31
    
Also, I was assuming that $k(x_i,\mathbb{.})$ is a vector formed by the placeholder taking in each entry in a vector $x$ except for $x_i$. Is my understanding right about this? –  qlinck Oct 20 '12 at 20:33

1 Answer 1

up vote 2 down vote accepted

I might be misunderstanding the question here, but it seems that you're a bit confused about what $<f,k(x_i,\cdot)>$ means. Yes, $f$ is a vector, but it's not necessarily a column vector like you might be used to from linear algebra. It is a vector in some Hilbert space, and the inner product there could likely be something like an integral (e.g., $<f,k(x_i,\cdot)> = \int_{-\infty}^{\infty} f(x) k(x_i,x) dx$).

Maybe an example might help. Consider the space $H^1(\mathbb{R})$, which is the space of functions $\{f \in L^2: f' \in L^2\}$ which has an inner product$$<f,g>_{H^1} = \int_{-\infty}^{\infty} f(x) \bar{g}(x)dx + \int_{-\infty}^{\infty} f'(x) \bar{g'}(x) dx$$

Note that the vectors in this space are functions, and not just a simple column vector. This space has a reproducing kernel, namely $k(x,y) = \frac{1}{2} e^{|x-y|}$. The reproducing property tells us that we can 'sample' $f$ at any point we want by taking the inner product of $f$ with $k(x,\cdot)$. That is, if you give me a function $f$ and you want to know its value at some point, say $2$, then the reproducing property tells us that:

$$f(2) = <f,k(2,\cdot)>_{H^1} = \int_{-\infty}^{\infty} f(y) \frac{1}{2} e^{-|2-y|} + f'(y) \frac{d}{dy} \frac{1}{2} e^{-|2-y|} dy$$

For a reference, check out Scattered Data Approximation by Holger Wendland, chapter 10.

share|improve this answer
    
Thanks!!!!!!!!! –  qlinck Oct 20 '12 at 21:42

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.