How much harder are discrete bandits?