Despite the increasing amount of literature on the legal and political questions triggered by a commitment to liberty of conscience, an explanation of the normative significance of conscience remains elusive. We argue that the few attempts to address this fail to capture the reasons people have to respect the consciences of others. We offer an alternative account that utilizes the resources of the contractualist tradition in moral philosophy to explain why conscience matters.