llm annotation | Andy Halterman

llm annotation

What codebook is your LLM using?

Asking an LLM to classify protests without a codebook means that they apply an implicit, opaque, and unstable definition. Good conceptualization and measurement requires careful definitions.