Take the 2-minute tour ×
Mathematics Stack Exchange is a question and answer site for people studying math at any level and professionals in related fields. It's 100% free, no registration required.

In information theory, how do I calculate the probability of an erroneous transmission? Let's take for instance a binary symmetric channel with an error probability $ 1-d=0.25 $ and send codewords of length 6 coded in a Hamming code able to correct up to 1 error.

share|improve this question
    
I don't know any Hamming codes of length 6? AFAIK the length of a Hamming code is one less than a power of two. No matter - the question is still answerable, if it is about a single-error-correcting code of length six. –  Jyrki Lahtonen Aug 31 '12 at 10:20
    
@JyrkiLahtonen That's a good remark, addressed by a previous comment unfortunately already deleted. It must be one of the Hamming code's variations. Thats the version I was taught at my University and the fact it is a non-standard version indeed caused me some confusion. I would be thankful if someone told me what are the objectives and the theory behind this modification. –  infoholic_anonymous Aug 31 '12 at 15:42
    
I was the one who deleted my comment asking which shortened Hamming code was under consideration. I have posted a detailed answer about how shortened Hamming codes work in an answer to another question by the OP. I don't think the question is fully answerable without knowing more about the code. –  Dilip Sarwate Aug 31 '12 at 20:23
add comment

1 Answer 1

up vote 1 down vote accepted

We assume independence of bit errors. This is a somewhat dubious assumption, since errors often occur in bursts.

The probability of erroneous interpretation (or inability to decode) of a codeword of length $6$ is the probability that $2$ or more bits are incorrectly transmitted. The probability that $0$ bits are wrong is $(0.75)^6$. The probability that exactly $1$ bit is wrong is $6(0.25)(0.75)^5$. Add these two numbers, subtract the result from $1$.

share|improve this answer
    
Actually, you have found the probability $P(C)$ of correct decoding. For shortened Hamming codes, the complementary probability $1 - P(C)$ is the sum of the error probability $P(E)$ (meaning the output is the wrong codeword) and the failure probability $P(F)$ (meaning the decoder is unable to decode the received word into a valid codeword because a detectable but undecodable error pattern has occurred. My answer to this question describes how such decoder failures occur, and they do depend on how the shortening was done. –  Dilip Sarwate Aug 31 '12 at 20:30
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.