Be a stoic.

    Deny yourself any indulgences at all, go ahead.

    While you're at it, you'd better stop playing this frivolous game.

    I'll take the liberty of denying you any points.