LLM Classification Is Feature Engineering

Using an LLM directly as a classifier gives you poor calibration and no threshold control. The author reframes the LLM verdict as one feature fed into a logistic regression or XGBoost, fixing these issues with a small training set. Tested on the SemEval 2018 irony detection dataset with Gemini 3.1 Flash Lite.