You need to win a total of 20 times at gambling with Hiroku. Those wins don't need to be consecutively and don't get reset by getting the rewards for previous wins.
Obtained from Hiroku at the top right corner of the south fort. (Map no. 7)
Win a total of 20 times at the gambler Hiroku.