1
vote
0answers
21 views

feature selection for continuous variables

I wonder how exactly "feature selection" should be performed in case of continuous feature values. When feature values are discrete it is very straitforward to apply feature selection, but what to do ...
1
vote
0answers
46 views

Estimating conditional probability as a function of time

My question relates to estimating from a time series a time dependent conditional probability without having a prior parametric model of anything. Suppose I have two variables: r and I, and each can ...
0
votes
0answers
37 views

Online machine learning algorithm for dynamical system

I have a complex dynamical system which takes input as x1, x2, x3 and gives output as y1, y2, y3. I don't have any mathematical model of the system. x(k) is the present input to the system and y(k) is ...
0
votes
1answer
69 views

Is a traditional Multi Layer Perceptron Network capable of non-linear regression? Which activation function should be used for that purpose?

I need to use a Multi Layer Perceptron Network in order to perform some non-linear regression. Any ideas if it's possible to perform a task like that and how? Which activation function should be used ...
0
votes
1answer
11 views

Classification cost in growing a classification tree

This question is based in machine learning, but is heavily mathematic so I am posting here. This equation is used to estimate the class conditional probabilities of a certain leaf of data D in a ...
1
vote
0answers
198 views

Modern mathematical theory on Neural Networks, Cellular Automata, Neuroscience

Is it possible for someone to do research on Neural Networks/Cellular Automaton/Neuroscience as an applied mathematician, for its theoretical development, especially based on some modern mathematics, ...
1
vote
1answer
119 views

Gradient descent/ nonlinear optimization intuition needed

all. I'm taking an introductory AI class, and we're using the gradient descent algorithm to find the optimized/ lowest cost of a set of thetas (variable coefficients) to best fit a regression line. In ...
19
votes
3answers
624 views

Mathematical preparation for postgraduate studies in Linguistics

I am an undergraduate student in Mathematics and I would like to continue my postgraduate studies in the harder, more mathematical aspects of Linguistics. What exactly would that include is unknown ...
1
vote
0answers
86 views

i,j,k values of the theta matrix in neural networks

SO I'm looking at these two neural networks and walking through how the ijk values of Theta correspond to the layer, the node number, and either there are redundant values or I'm missing how the ...
0
votes
2answers
116 views

Memory of a neural network: is it forever?

As far as I remember a neural network cannot forget anything. Does this mean that no matters how evolved the network is, it's always going to throw me back the right output if I feed it an input? And ...