Given two random variables $X, Y$, what is the joint distribution $P(X,Y)$ that maximizes entropy $H(X,Y)$, subject to given marginal probabilities $P(X), P(Y)$ and given values along the diagonal of the probability matrix (i.e, $P(X=i,Y=i) = d_i$)?
A little background: I'm a PhD student writing a course final paper exploring measures on a finite-domain, discrete-time, definitely-not-Markovian process. (In particular, it's the app that is open on someone's phone at a moment in time.) I started by focusing on mutual information between moments at varying time separations - much like autocorrelation but instead of correlation it's mutual information. (By the way, if someone knows a name for or has a paper reference to either that or anything slightly related, let me know - I'm enjoying the mathematics a lot, but I'm sorely underqualified to do this kind of stuff.)
I'd like to be able to break down each slice of the autocorrelation - each moment of 'predictability' (mutual information) - into information gained from when the samples have the same app (e.g. you're still browsing Facebook ten minutes later) and when app usage 'clusters' (e.g, a mobile game means you're at home relaxing which means Facebook is more likely than Outlook). My intuition is to use the principle of maximum entropy on the joint distribution subject to the important constraints (marginals and 'diagonal' probabilites) to find this amount. Hence the question above!