Multiple choices questions in NLP, Natural Language Processing solved MCQ, HMM is a generative model, Why HMM is referred as generative model?
Natural Language Processing MCQ - Hidden Markov Model (HMM) is a generative model
|
Next > |
1. A Hidden Markov
Model (HMM) is a _____ which means that the model is specified by ______.
a) Discriminative
model, P(X, Y)
b) Discriminative
model, P(Y|X)
c) Generative
model, P(X, Y)
d) Generative
model, P(Y|X)
|
Answer:
(c) Generative model, P(X, Y) Hidden Markov Model (HMM) is a generative model. Generative models capture the joint
probability p(X, Y). Generative models calculate the conditional probability P(y|x)
using the joint probability as follows; P(y|x) = P(x,y) / P(x) = joint probability / prior probability
of x A generative model includes the distribution of the data
itself, and tells you how likely a given example is. For example, models that
predict the next word in a sequence are typically generative models because
they can assign a probability to a sequence of words. Discriminative models, in contrast, use no knowledge about the
probability distributions that underlie a data set. They directly calculate the conditional probability, p(y|x), for a data set. They focus
on discriminating between classes, as their name suggests, by analyzing the
data to calculate decision boundaries between classes. |
|
Next > |