DBM301Xuất hiện trong 1 đề thi
Let $w$ be a word and $X_w$ be a binary random variable that indicates whether $w$ appears in a text document in the corpus. Assume that the probability $P(X_w=1)$ is estimated by $\dfrac{\operatorname{Count}(w)}{N}$, where $\operatorname{Count}(w)$ is the number of documents that $w$ appears in and $N$ is the total number of documents in the corpus. \nYou are given that "the" is a very frequent word that appears in 99% of the documents and that "photon" is a very rare word that occurs in 1% of the documents. Which word has a higher entropy?
Các lựa chọn
A"the"
B"photon"
CBoth words have the same entropy