CUDA basics CUDA Basic Syntax for defining a kernel with a grid size and thread blocks Host Code: Code that runs on CPU Device Code: Code that runs on GPU Grid: collection of all threads launch...

From Seq-to Seq RNN to Attention & Transformers This posts address the premise of attention starting from sequence to sequence RNN and builds up all the way to transformer models. These are my...

Hi All! This blog will help installing CUDA on Ubuntu 22.04 in the shortest way possible without having to go through the driver hassles. This blog assumes that the system doesn’t have any pre-...