Dialogue modelling
type: Named individual
type: Operation
type: Concept
broader: Language Modelling

Language Modelling
type: Concept
type: Named individual
type: Operation
comment: The construction of statistical or Machine Learning language models
alternative label: Language Modeling
alternative label: LM
broader: Support operation
definition: A Statistical Language Models predicts a word given a sequence of already known words (i.e. the history). Ist can also be applied to other sequences of symbols (e.g. DNA). Very often the history contains just the previous two words. This is called a trigram. The parameters of statistical language models are estimated from a set of training examples. Data sparsity and smoothing of the estimates is one of the core problems. The best smoothing technique known so far is Kneser-Ney-Smoothing. Maximum-Entropy techniques are also under investigation and may be the method of choice for long-range language models (beyond trigram). Language models are used in text-compression, speech recognition, information retrieval and information extraction.
in scheme: Operation Taxonomy
narrower: Training of language models
narrower: Training of Machine Learning models
narrower: Dialogue modelling
narrower: Statistical Language Modelling
narrower: Training of NMT models

Operation
type: Class

Operation Taxonomy
type: Named individual
type: ConceptScheme

Statistical Language Modelling
type: Named individual
type: Operation
type: Concept
broader: Language Modelling

Support operation
type: Named individual
type: Operation
type: Concept
narrower: Language Modelling

Support operation Collection
type: Named individual
type: Operation
type: Collection
member: Language Modelling

Training of language models
type: Named individual
type: Operation
type: Concept
broader: Language Modelling

Training of Machine Learning models
type: Named individual
type: Operation
type: Concept
broader: Language Modelling

Training of NMT models
type: Named individual
type: Operation
type: Concept
broader: Language Modelling

Named individual
type: Class