ML/AI posts

Machine learning, NLP, and applied AI in production

Wrigley’s, 1937 - Charles Green Shaw - www.nga.gov
Wrigley’s, 1937 - Charles Green Shaw - www.nga.gov
in TECH on

Lost in Translation: How a Ported Dictionary Inflated Every 'Authority' Score

I stress-tested my newest, riskiest metric for weeks and shipped none for an old, boring one — a moral-foundations word list. A single mistranslated word had been inflating one whole moral dimension by about 2× for every speaker. The bug was not in the code. It was in the dictionary. A ported word list is code — test it like code.

  • #nlp
  • #moral-foundations
  • #spacy
  • #lexicon
  • #i18n
  • #testing
in TECH on

NLI: The Architecture Hiding Inside Your Embeddings (and a Zero-Shot Classifier You Already Have)

Natural Language Inference trains the sentence embeddings everyone uses. It also works as a classifier that needs zero labeled examples. Here is the architecture, its history, and three very different results when I put it into production.

  • #nli
  • #natural-language-inference
  • #zero-shot-classification
  • #sentence-embeddings
  • #text-classification
  • #machine-learning