Toro

DistilGpt2Config

Configuration values used by a DistilGPT-2 causal language model.

Record fields

NameDescription
BosTokenId
EmbeddingSize
EosTokenId
IntermediateSize
LayerNormEps
MaxPositionEmbeddings
NumAttentionHeads
NumHiddenLayers
VocabSize

DistilGpt2Config module

Validation operations for DistilGPT-2 configurations.

FunctionDescription
validate configValidate dimensions and constants required by the implemented architecture.

validate

validate config

Validate dimensions and constants required by the implemented architecture.

Parameters

  • config : DistilGpt2Config

DistilGpt2Input

Tensor inputs accepted by DistilGPT-2.

DistilGpt2Output

Tensor outputs produced by DistilGPT-2.