# Notation: Representer Theorem for Reproducing kernel hilbert spaces

Am studying the basic concepts of RKHS and the representer theorem: In $f(x_i)=<f,k(x_i,\mathbb{.})>$, what does $f$ on the r.h.s denote? What is its structure-is it a vector? I was thinking that $k(x_i,\mathbb{.})$ would be a vector and $f$ should be one. Some formal-yet simplified explanation would help me get a head-start in my reading!

-
Can you add some more context? Usually, yes $\langle u,v\rangle$ denotes the scalar product of vectors (ie. elements of the Hilbert space). – Berci Oct 20 '12 at 20:24
I have been reading this cs.berkeley.edu/~bartlett/courses/281b-sp08/8.pdf - I find it very interesting- but the notation that is getting missed for me- is blocking my read! Do look at the notation in here. – qlinck Oct 20 '12 at 20:31
Also, I was assuming that $k(x_i,\mathbb{.})$ is a vector formed by the placeholder taking in each entry in a vector $x$ except for $x_i$. Is my understanding right about this? – qlinck Oct 20 '12 at 20:33

I might be misunderstanding the question here, but it seems that you're a bit confused about what $<f,k(x_i,\cdot)>$ means. Yes, $f$ is a vector, but it's not necessarily a column vector like you might be used to from linear algebra. It is a vector in some Hilbert space, and the inner product there could likely be something like an integral (e.g., $<f,k(x_i,\cdot)> = \int_{-\infty}^{\infty} f(x) k(x_i,x) dx$).
Maybe an example might help. Consider the space $H^1(\mathbb{R})$, which is the space of functions $\{f \in L^2: f' \in L^2\}$ which has an inner product$$<f,g>_{H^1} = \int_{-\infty}^{\infty} f(x) \bar{g}(x)dx + \int_{-\infty}^{\infty} f'(x) \bar{g'}(x) dx$$
Note that the vectors in this space are functions, and not just a simple column vector. This space has a reproducing kernel, namely $k(x,y) = \frac{1}{2} e^{|x-y|}$. The reproducing property tells us that we can 'sample' $f$ at any point we want by taking the inner product of $f$ with $k(x,\cdot)$. That is, if you give me a function $f$ and you want to know its value at some point, say $2$, then the reproducing property tells us that:
$$f(2) = <f,k(2,\cdot)>_{H^1} = \int_{-\infty}^{\infty} f(y) \frac{1}{2} e^{-|2-y|} + f'(y) \frac{d}{dy} \frac{1}{2} e^{-|2-y|} dy$$