Opinion
My highly unqualified opinions on contemporary stuff in the world.
2024
- No, fractional reserve banking doesn't create money
- Does DeBERTa have infinite context length, and how large is the receptive field of a token?
- How does HuggingFace's from_pretrained() know which weights in a checkpoint go where?
- How to create your own Python packages and dependencies
- Bits-per-character and its relation to perplexity
- The Fish and the Other Acquarium: On pointing out inaccuracies in truth claims
- BPE-knockout: Pruning Pre-existing BPE Tokenisers with Backwards-compatible Morphological Semi-supervision
