Are there any proper research-level mathematics problems that have come out of the activity known as "data science"?

I put the quotes because it really is not so clear what "data science" is to me; I am a data science sketpic if you will.

  • 1
    $\begingroup$ What is the definition of 'Serious' mathematical problems? $\endgroup$ – Nilotpal Kanti Sinha Jan 29 at 4:40
  • $\begingroup$ A problem which a mathematician would say is a research level mathematics problem. $\endgroup$ – T_M Jan 29 at 4:43
  • 1
    $\begingroup$ Well then you could have just said 'research' level problem to make things simpler, why complicate :-) $\endgroup$ – Nilotpal Kanti Sinha Jan 29 at 4:46
  • $\begingroup$ In machine learning the problem of designing efficient models is very hard to formalize and away from trivial cases it seems almost impossible to solve, amazingly this is in complete contradiction with the fact animal and human intelligence do solve it in a quite efficient way. $\endgroup$ – reuns Jan 29 at 5:14
  • $\begingroup$ Not convinced this is a well-posed question -because of too open. Data science includes Machine Learning, which, you can bet, leads to plenty of "research level problems" $\endgroup$ – MASL Jan 29 at 5:25

Without any exaggeration, every solution to any fundamental problem of data science is actually a serious mathematical problem because these solution are put into practical real life use in industries where the stakes are in the order of millions and billions of dollars. So the stakes are much higher than research for pure academic purpose. Let's look at some examples from.

Problem statement: An airport terminal has many stands or gate where an incoming aircraft can be landed and parked. At a given time, which of these gates is my best to park an incoming aircraft?

I will post the solution approach later (I am preparing it) but I would like to state that this simple looking problem this is actually an extremely complicated optimization problem in aviation that has taken major airlines years to solve and costing several million dollars and they have only achieved partial solution. The complication is because of the hundreds of practical factors related to commercial flying that an airline has consider to arrive at a solution due to which the number of solutions from which you can search for the best option is more than the number of atoms in the known universe.

  • $\begingroup$ OK, well what's an example of a fundamental problem of data science? $\endgroup$ – T_M Jan 29 at 5:59
  • 1
    $\begingroup$ There are four main fundamental problems (1) classification - to which class or category thus this object below (2) regression - what is the predicted numerical value of something (3) optimization - what is the best combination so as a maximize or minimize something (4) making sense of unstructured data - look at social media/internet data/video and find the opinion of the public about something. Almost all data science problems can eventually be broken down into these four fundamental problems. $\endgroup$ – Nilotpal Kanti Sinha Jan 29 at 6:48
  • $\begingroup$ But each of these four have hundreds of methods for solution, not all method work well with all data or all scenario so new algorithms based on math are invented all the time.E.g. 200 years back Gauss invented linear regression and applied it on the data collected by astronomers to predict the location and timing of Encke comet. Today, we get better accuracy with something called XGBoost. $\endgroup$ – Nilotpal Kanti Sinha Jan 29 at 6:48

It wasn't clear to me if you were asking specifically for mathematical research problems that have their origin in the so-called data science. The problem is, this term is relatively recent. Nevertheless, the following reference clears my doubts about my answer of Topological Data Analysis as a valid one.

You can find several review and research papers on this topic in the site http://cunygc.appliedtopology.nyc/pages/reading.html. A lean overview can be found on Wikipedia.

To summarize my point, here I'll quote from *BULLETIN (New Series) OF THE AMERICAN MATHEMATICAL SOCIETY Volume 46, Number 2, April 2009, Pages 255–308, by Gunnar Carlson -available at that page as well: http://www.ams.org/journals/bull/2009-46-02/S0273-0979-09-01249-X/S0273-0979-09-01249-X.pdf

An important feature of modern science and engineering is that data of various kinds is being produced at an unprecedented rate. This is so in part because of new experimental methods, and in part because of the increase in the availability of high powered computing technology. It is also clear that the nature of the data we are obtaining is significantly different. For example, it is now often the case that we are given data in the form of very long vectors, where all but a few of the coordinates turn out to be irrelevant to the questions of interest, and further that we don’t necessarily know which coordinates are the interesting ones. A related fact is that the data is often very high-dimensional, which severely restricts our ability to visualize it. The data obtained is also often much noisier than in the past and has more missing information (missing data). This is particularly so in the case of biological data, particularly high throughput data from microarray or other sources. Our ability to analyze this data, both in terms of quantity and the nature of the data, is clearly not keeping pace with the data being produced. In this paper, we will discuss how geometry and topology can be applied to make useful contributions to the analysis of various kinds of data.

This paper will deal with a number of methods for thinking about data using topologically inspired methods. We begin with a discussion of persistent homology, which is a mathematical formalism which permits us to infer topological information from a sample of a geometric object, and we show how it can be applied to particular data sets arising from natural image statistics and neuroscience. Next, we show that topological methods can produce a kind of imaging of data sets, not by embedding in Euclidean space but rather by producing a simplicial complex associated to certain initial information about the data set. We then demonstrate that persistence can be generalized in several different directions, providing more structure and information about the data sets in question. We then show that the philosophy of functoriality can be used to reason about the nature of clustering methods, and we conclude by speculating about theorems one might hope to prove and discussing how the subject might develop more generally.

Obviously, this example doesn't exhaust the mathematical research topics related to and, specially, originated in data science. For instance, searching for Statistical Learning should yield more examples.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.