gpu's
Mostly from :
https://timdettmers.com/2023/01/30/which-gpu-for-deep-learning/
and : same author but shorter
https://www.quora.com/Why-are-GPUs-well-suited-to-deep-learning/answer/Tim-Dettmers-1
CPU vs GPU
First of all, you have to understand that CPUs are latency optimized while GPUs are bandwidth optimized. You can visualize this as a CPU being a Ferrari and a GPU being a big truck. The task of both is to pick up packages from a random location A and to transport those packages to another random location B. The CPU (Ferrari) can fetch some memory (packages) in your RAM quickly while the GPU (big truck) is slower in doing that (much higher latency). However, the CPU (Ferrari) needs to go back and forth many times to do its job (location A \(\rightarrow\) pick up 2 packages \(\rightarrow\) location B ... repeat) while the GPU can fetch much more memory at once (location A \(\rightarrow\) pick up 100 packages \(\rightarrow\) location B ... repeat).