sriniiyer88 haozhangml First off thanks for your awesome work! Sorry for the misunderstanding here, I think with metaseq it’s definitely easier with the provided model parts! Here I’m mostly referring to Alpa’s conversion code that requires FSDP shards.
Posted 1 year ago (10 February 2023)