wargreymon@sh.itjust.works to Machine Learning@lemmy.ml · 1 year agoCan gpt generate a gpt model?message-squaremessage-square5linkfedilinkarrow-up19arrow-down13file-text
arrow-up16arrow-down1message-squareCan gpt generate a gpt model?wargreymon@sh.itjust.works to Machine Learning@lemmy.ml · 1 year agomessage-square5linkfedilinkfile-text
minus-squareAudalin@lemmy.worldlinkfedilinkEnglisharrow-up5·1 year agoYou can generate synthetic data matching the distribution your transformer learned. You can use this dataset to train another model. As of now, that’s about it.
minus-squareBaldur Nil@programming.devlinkfedilinkarrow-up2·1 year agoYep, this is called model distillation.
You can generate synthetic data matching the distribution your transformer learned. You can use this dataset to train another model. As of now, that’s about it.
Yep, this is called model distillation.