Think about how traditional language models work.
They gobble up sentences word-by-word, crunching through complex calculations on each word equally. But let's be honest, not every word deserves the VIP treatment. Some are keys to the whole conversation, others are filler.
This seems wasteful.
…and expensive!
On April 2, 2024 Google DeepMind released their