deep-learning

An Introduction To HuggingFace Transformers for NLP

An Introduction To HuggingFace Transformers for NLP

0
In this article, we will be covering what HuggingFace is, how and why it came to exist, and how to best utilize it for your machine learning workflows. We’ll also touch on the different use cases covered by the various HuggingFace packages in the ecosystem. Link
Reinforcement Learning from Human Feedback, InstructGPT, and ChatGPT

Reinforcement Learning from Human Feedback, InstructGPT, and ChatGPT

0
In this post, we will dive into the inner workings of ChatGPT and how it is trained. However, before we get into the specifics of ChatGPT, it’s important to first review some relevant prior works and concepts to give us a strong foundation. Once we have a solid understanding of these foundations, we can move on to exploring ChatGPT in depth. Link
TRANSFORMER MODELS: AN INTRODUCTION AND CATALOG

TRANSFORMER MODELS: AN INTRODUCTION AND CATALOG

0
In the past few years we have seen the meteoric appearance of dozens of models of the Transformer family, all of which have funny, but not self-explanatory, names. The goal of this paper is to offer a somewhat comprehensive but simple catalog and classification of the most popular Transformer models. The paper also includes an introduction to the most important aspects and innovation in Transformer models. Link
The Annotated Transformer

The Annotated Transformer

0
The Transformer has been on a lot of people’s minds over the last year five years. This post presents an annotated version of the paper in the form of a line-by-line implementation. It reorders and deletes some sections from the original paper and adds comments throughout. This document itself is a working notebook, and should be a completely usable implementation. Code is available here. Link
Incredibile pyTorch

Incredibile pyTorch

0
This is a curated list of tutorials, projects, libraries, videos, papers, books and anything related to the incredible PyTorch. Feel free to make a pull request to contribute to this list. Link