大模型-微调技术（六）：MAM Adapter（统一框架）（统一Adapter-Tuning、Prefix-Tuning、LoRA）【冻结大模型参数，微调新插入的参数层】

悠悠 2023-10-12 17:02 28阅读 0赞

[《Towards a Unified View of Parameter-Efficient Transfer Learning》][Towards a Unified View of Parameter-Efficient Transfer Learning]

[《Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models》][Delta Tuning_ A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models]

[《Sparse Structure Search for Parameter-Efficient Tuning》][Sparse Structure Search for Parameter-Efficient Tuning]

![fdd146e612f246798be1a24395b1e137.png][]

![478df0f81b31404f8de15ff980ee0f37.png][]

![b71771d98f61419bafd8cc0b82694cc3.png][]

[Towards a Unified View of Parameter-Efficient Transfer Learning]: https://arxiv.org/abs/2110.04366
[Delta Tuning_ A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models]: https://arxiv.org/abs/2203.06904
[Sparse Structure Search for Parameter-Efficient Tuning]: https://arxiv.org/abs/2206.07382
[fdd146e612f246798be1a24395b1e137.png]: https://img-blog.csdnimg.cn/fdd146e612f246798be1a24395b1e137.png
[478df0f81b31404f8de15ff980ee0f37.png]: https://img-blog.csdnimg.cn/478df0f81b31404f8de15ff980ee0f37.png
[b71771d98f61419bafd8cc0b82694cc3.png]: https://img-blog.csdnimg.cn/b71771d98f61419bafd8cc0b82694cc3.png