vchiley
Follow
Pinned
459 contributions in the last year
Contribution activity
May 2023
Created 9 commits in 1 repository
Created 1 repository
- vchiley/llm-foundry Python
Created a pull request in mosaicml/llm-foundry that received 3 comments
convert examples v004 state dict to llm-foundry state dict
Abhi tried it on the final 7B model.
+207
−0
•
3
comments
Opened 7 other pull requests in 1 repository
Reviewed 12 pull requests in 2 repositories
mosaicml/llm-foundry
11 pull requests
- Adding loss to MPTForCausalLM fwd if labels arg is not None
- update readme and updt __init__
- Update README.md
- Add LLaMa and MPT HFCausalLM support
- Restructure top level folders
- Rename MosaicGPT to MPT
- Make ICL configurations more concise
- updt model config; add attn config
- refac how init configuration is set
- Add ICL datasets, plus functionality for subcategories in datasets
-
Fix
ComposerHFCausalLMinitialization