PyTorch

PyTorch Lightning & Lightning Hydra Template are neat. Tensor Puzzles is great intro.

TorchScale is nice library for making Transformers efficiently. BackPACK is interesting too.

Link