Pinned

1. learning-at-home Public

   "Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implementation

   Jupyter Notebook 34

2. learning-at-home/hivemind Public

   Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

   Python 1.3k 81

3. yandex-research/DeDLOC Public

   Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)

   Jupyter Notebook 96 4

4. yandex-research/graph-glove Public

   PyTorch code for the EMNLP 2020 paper "Embedding Words in Non-Vector Space with Unsupervised Graph Learning"

   Python 39 4

5. efficient-dl-systems Public

   Efficient Deep Learning Systems course materials (HSE, YSDA)

   Jupyter Notebook 175 20

6. bigscience-workshop/petals Public

   🌸 Run 100B+ language models at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

   Python 1.7k 43