Minimal continuous poker
Sunday, November 13th, 2011Consider the following poker-like game, played with two players: Alice and Bob. Bob posts a blind of 1. Both players are dealt a single, continuous hand chosen uniformly at random from . Alice can fold, call, or raise any amount (calling means ). Bob either calls or folds.
My original plan was to work out the Nash equilibrium for this game, and therefore derive interesting smooth curves describing the optimal way for Alice to bluff and generally obscure her hand. It didn’t quite work out that way, but the result is still interesting.
Let be the optimal expected payoff for Alice, the optimal expected payoff given Alice’s specific hand x. Clearly A(x) is a weakly increasing function of x; if x’ > x but A(x’) < A(x), Alice can improve A(x’) to A(x) by pretending she has hand x and using the same strategy. If A(x) > 0 for some x, so that Alice’s optimal strategy is better than folding, then Alice will never fold since any nonzero probability of folding would reduce her utility. Thus there is a threshold hand below which Alice always folds (technically, always “might as well” fold, but we’ll gloss over this detail for the moment), and above which Alice always calls but might vary the amount she raises by. A similar argument applied to Bob gives a threshold function s.t. Bob folds if and calls if .
These and other similar preliminaries aside, I spent a while banging my head against the wall before temporarily giving up and picking a simpler game. Specifically, make the bet a fixed constant. If , Bob always checks, and Alice’s optimal strategy is (unsurprisingly) to call if . This gives a payoff of . If , Bob’s function is a constant. The values of , , and at the Nash equilibrium turn out to be
A few notes: for any , , since Bob knows Alice’s threshold and gains nothing by calling with hands only slightly over . Interestingly, Alice’s payoff remains unchanged if she varies her threshold anywhere satisfying ; the particular value of is only prevents Bob from increasing his utility with a different value of . However, the most important property of this result is that is a decreasing function of . If the bet is fixed, Alice would prefer it to be zero so that .
Now back the general game, where Alice chooses the bet. We have , since Alice can choose to always call or fold. Can she do better, varying the bet in some exotic fashion so as to milk more money out of Bob while keeping her hand disguised? Well, no. Update: After disproving a conjecture (see below), the answer is maybe.
Let’s see what happens if Bob follows the optimal strategy from the fixed game, calling if and folding otherwise. Since Bob’s strategy is fixed, Alice can maximize her utility without any extra randomness, and we need only consider bets which are a deterministic function of . For she folds and , for she bets with payoff
Differentiating w.r.t. ,
If , this becomes
so if , Alice’s bet doesn’t matter. If , we have
which is negative as and zero at .
Thus iff , or
Unfortunately for Bob, at iff iff . Thus Alice can beat by increasing her bet whenever . Abandoning hand calculation and turning to Mathematica, it turns out Alice’s optimal strategy achieves .
So, we haven’t found the Nash equilibrium yet, but at least our minimal poker game isn’t (necessarily) incredibly boring. More analysis is required. For pretty pictures’ sake, here’s a plot of Alice’s outcome as and vary:
