The map $\alpha:R[x,y]\to R[x,y]$ defined by $\alpha(f)=f(0,0)$ is a homomorphism of rings that fixes $R$, and indeed $\alpha(f)\in R$ for all $f$. The kernel $K$ is easy to compute; it is the set of all $f\in R[x,y]$ with zero constant term. The restriction of a homomorphism to a subring is always a homomorphism, so this gives us a homomorphism $\alpha:A\to R$ that fixes $R$. The kernel is $J=K\cap A$, the set of all polynomials contained in $A$ with zero constant term, and this is the ideal we seek.
Not only is there an ideal such that $A/J\simeq R$, but there is a homomorphism $\epsilon:A\to A$ such that $\epsilon(f)\in R$ for all $f\in A$ and if $r\in R$ then $\epsilon(r)=r$. Thus $A$ retracts onto $R$, and $\epsilon$ is a homomorphism of $R$-algebras.