How to calculate entropy of a specific cryptosystem?

sa flag

I want to calculate the entropy of a specific cryptosystem such as the Caesar cipher or Vernam cryptosystem etc but I don't quite understand how to do so. Any help?

poncho avatar
my flag
What does 'entropy of a specific cryptosystem' mean?
poncho avatar
my flag
Do you mean the entropy of the key? The entropy of the ciphertext (assuming a fixed plaintext)?
Konstantina Mil avatar
sa flag
Yes the entropy of the key of a cryptosystem
Paul Uszak avatar
cn flag
Then I suggest that it's impossible to obtain a bitwise entropy value of a single key since they're derived from passwords like "secret".
sa flag


The entropy of a cryptographic key $K$ cannot be computed in isolation for a single key. It is the property of the generation mechanism for the key.


Entropy is a function of a probability distribution. Assuming you mean the most common entropy measure, Shannon Entropy, given a key $K\in \{0,1\}^b$ which has been randomly generated from the set of $b-$bit strings according to some probability distribution $$ P(x)=Prob\{K=x\},\quad x\in \{0,1\}^b $$ then the entropy of a key drawn from this distribution is $$ H(X)=\sum_{x \in \{0,1\}^b} -P(x) \log_2 P(x)\quad\textrm{bits}. $$ If the distribution of $K$ is uniform then this entropy is $b$ bits.

If the key comes from some randomly chosen SEED and is generated by means of some deterministic algorithm or function, the entropy of the key that is output is the same as the entropy of the SEED.

PS: One can define the uncertainty in a single object, such as a key, by means of Kolmogorov Complexity, which is a theoretical measure. It is defined as the program length of a universal Turing machine (UTM) that will output that key, and halt (stop). This complexity is uncomputable, but can be approximated.


Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.