# Soft: Understanding the difference between machine/statistical learning and parameter estimation

Say we have a known model $$M$$ with unknown parameters and more specifically, $$M$$ is a parametric model.

Parameter estimation on $$M$$ is applying an appropriate method for estimating the parameters.

My question is: If we know the form/shape of the model $$M$$ up to unknown parameters, and applying a machine learning algorithm such as gradient descent, does this fall under machine/statistical learning?

Or is it still only parameter estimation using a borrowed method since the model form is known?

It seems the former question is yes since we are "learning" the parameters rather than just doing some algebraic/calculus manipulation to get suitable estimators directly.

My confusion comes from that what reading I have done on machine learning/statistical learning is that the goal is to estimate the model itself or rather the function $$f$$ which gives the model. Of course, parameter estimation is something utilized in machine/statistical learning but seems the situation I described is a instance of machine/statistical learning, perhaps this instance would be more specifically referred to as parametric machine/statistical learning

• You can use and often do use statistics/machine learning to estimate parameters of a model. Dec 13, 2022 at 19:25
• @Henry do you know if there is a term to distinguish between machine learning in which the form of model is known but the parameters are not and the model is itself unknown? Perhaps this is trivial but the term 'machine learning' seems to be often used in quite vague terms. Dec 13, 2022 at 20:27
• "Machine learning" is vague: some people say it is the use of computers to make predictions , others that it is statistics rediscovered by computer programmers who did not do a statistics course so used different terminology for the same thing. The terminology includes "model selection", "model tuning" and "model training" as different steps so if you impose the model before seeing the data rather than have the machine decide it, you simply skip the first step. Dec 13, 2022 at 23:54
• Thank you that makes it more clear, sometimes you just need someone else to explain a concept in their words for it to make sense. Dec 14, 2022 at 1:12