is an acronym
nit, a term first introduced by nVidia
to make a parallel with CPUs. It originally referred to the processor of the GeForce3 graphic card, and now stands for processors present in all recent graphic cards.
GPU can also mean Global Processing Unit and refer to distributed computing projects.