Blog

Just things I like to talk about and wanted to share.

• LayerSkip: Early Exiting Grows up for LLMs

  Why do decoder-only language models still run every token through every layer?

• BERxiT: Early Exiting Beyond Entropy

  Why should BERT trust its own confidence scores to decide when to stop thinking?

• DeeBERT: Teaching BERT When to Stop Thinking

  Why does BERT need twelve layers to classify “I love this movie” as positive?

• Early Exiting: The Under-Hyped Compression Method

  Why are we burning GPU hours to answer “2 + 2 = 4”?