I have this problem too. The sign by the expensive stones says if you dig out the expensive tiles "you won't make your way easier by solving the puzzle".
I dug out the first expensive tile before solving the puzzle. I think that turned off the puzzle reward for the rest of the expensive stones.
