Why AI counts tokens, not words
What a token is, why it differs from a word, and why models use them.
Read note ↗Build logs, ideas, and useful fragments. Things I’m still thinking through.
What a token is, why it differs from a word, and why models use them.
Read note ↗Loose observations, quotations, and ideas worth keeping.
Read note ↗