I am a calculus 1 student. I was wondering that if Riemann sums only give us an approximation(either over-estimate or under-estimate) the area under the curve, Why do we celebrate Riemann sums(considering it came out in the 19th century) when we can actually find the exact area using integrals.
A Riemann Integral is by definition a precise limit of Riemann sums. One can use this to justify which functions are (or aren't) integrable, and to further derive the two fundamental theorems of calculus. All subsequent properties of Riemann Integrals (substitution, breaking into a sum of two integrals, etc.) are in fact derived through looking at limits of Riemann Sums.
2) Not all functions have an explicit anti-derivative.
There are tons of functions that do not have an explicit anti-derivative. These either occur in some compact form like $\exp(-x^2)$, or more generally tend to arise as data measurements from some experiment. In the latter case, the measurements are discrete approximations of a non-discrete function.
So the second-best approach is to approximate the integral via Riemann Sums. More precisely, Quadratures are used, as vanilla Riemann Sums might not converge quickly.
The Riemann sums are used to construct the integral, to define the object. When the functions to be integrated are "nice enough" you have learned a simple formula to compute the integral (involving primitives), but this rule does not define the integral, nor does it allow to compute every integral.
The Riemann sums definition of the integral are used in the fundamental theorem of calculus to prove that the anti-derivative is the area under the curve.
If all you care about is "getting the answer" then you can forget about most of what you learned in the Riemann sum discussion.