Tech — Work — Ramblings

by Mike Kalvas

I see you're not using JavaScript (which is awesome!) on one of my pages that uses it to provide a better experience. If you see something not working right, please let me know. My site should work exactly the same without it apart from any exceptions noted here.

I use prism.min.js to do syntax highlighting. It clocks in at 23kb total in size. Since the majority of the writing I do involves coding, I personally find this to be a worthwhile trade off. If you choose to keep this disabled, rest assured, the code examples are still there, they just may have some extra whitespace and obviously no syntax highlighting.

I do no tracking at all and am a zealot about keeping my pages as small as possible. If you're reading a page of mine that transfers more than about 250kb over the wire (including my most gratuitous indulgence — fonts) I've messed up.

So, if you'd like to have a slightly richer experience, consider enabling javascript for my site and I promise your trust won't be misplaced.

202608241033 Token caching and LLM internals

#microblog #link

I'm posting this link to Sam Rose's blog post on ngrok titled Prompt caching: 10x cheaper LLM tokens, but how? which — despite the name — is actually one of the best written resources on how LLMs work in general so that I can reference it in the future. It's a good high-level overview with interesting visuals and yet it dives to enough depth that things aren't left as magic boxes that mean nothing to the reader at the end.

Links to this note

202208270000 Microblog