Toro

KvCache

Constructors

NameDescription
KvCache(dim)

Instance members

NameDescription
this.CurrentSeqLen
this.Dim
this.append (k, v)
this.currentData ()
this.reset ()