This is essentially the number of gems you start the game with. You may enter palace 7 as soon as you run out of gems (even if you never had any). This is a double edged sword: fewer gems means you will not get as many experience bonuses at the end of palaces.