Introducing Gacha Decoding 🎲: we show how to diversify LM responses, beating prior work by >11x in sample efficiency. Reroll your LM for va…