Jules Belveze
Blog
Notes on machine learning systems, model efficiency, and the engineering work around them.
-
LayerSkip: Early Exiting Grows up for LLMs
Why do decoder-only language models still run every token through every layer?
-
BERxiT: Early Exiting Beyond Entropy
Why should BERT trust its own confidence scores to decide when to stop thinking?
-
DeeBERT: Teaching BERT When to Stop Thinking
Why does BERT need twelve layers to classify “I love this movie” as positive?
-
Early Exiting: The Under-Hyped Compression Method
Why are we burning GPU hours to answer “2 + 2 = 4”?