0
votes
0answers
17 views

Derivative of sigmoid function in backpropagation

I never took an advanced Math course so please excuse my lack of comprehension. I've been thinking about the back propagation algorithm and I'm confused about a few things... So in backpropagation ...
0
votes
0answers
30 views

Online machine learning algorithm for dynamical system

I have a complex dynamical system which takes input as x1, x2, x3 and gives output as y1, y2, y3. I don't have any mathematical model of the system. x(k) is the present input to the system and y(k) is ...
0
votes
1answer
53 views

Is a traditional Multi Layer Perceptron Network capable of non-linear regression? Which activation function should be used for that purpose?

I need to use a Multi Layer Perceptron Network in order to perform some non-linear regression. Any ideas if it's possible to perform a task like that and how? Which activation function should be used ...
0
votes
1answer
10 views

Classification cost in growing a classification tree

This question is based in machine learning, but is heavily mathematic so I am posting here. This equation is used to estimate the class conditional probabilities of a certain leaf of data D in a ...
1
vote
0answers
164 views

Modern mathematical theory on Neural Networks, Cellular Automata, Neuroscience

Is it possible for someone to do research on Neural Networks/Cellular Automaton/Neuroscience as an applied mathematician, for its theoretical development, especially based on some modern mathematics, ...
0
votes
0answers
23 views

Some doubts related to statistic entropy concept in ID3 machine learning algorithm

I am studying the statistic entropy concept used by ID3 machine learning algorithm For a domain exemplified by the learning set S (that is the set of the examples that I use to build a decision ...
0
votes
0answers
38 views

Some theoretical question about ID3 machine learning algorithm

I am studying the ID3 algotithm for an universitary exame and I have some problems to understand how is select the best attribute to create new subtrees having fewer attributes in their root (until ...
0
votes
0answers
91 views

Gradient descent/ nonlinear optimization intuition needed

all. I'm taking an introductory AI class, and we're using the gradient descent algorithm to find the optimized/ lowest cost of a set of thetas (variable coefficients) to best fit a regression line. In ...
17
votes
3answers
488 views

Mathematical preparation for postgraduate studies in Linguistics

I am an undergraduate student in Mathematics and I would like to continue my postgraduate studies in the harder, more mathematical aspects of Linguistics. What exactly would that include is unknown ...
1
vote
0answers
71 views

i,j,k values of the theta matrix in neural networks

SO I'm looking at these two neural networks and walking through how the ijk values of Theta correspond to the layer, the node number, and either there are redundant values or I'm missing how the ...
0
votes
2answers
104 views

Memory of a neural network: is it forever?

As far as I remember a neural network cannot forget anything. Does this mean that no matters how evolved the network is, it's always going to throw me back the right output if I feed it an input? And ...