Therefore, if we would walk simply, and have our conversation in the world in this grace, let us labour especially for faith to depend upon God's promises, to approve ourselves to him, to make him our last and chief end, and our communion with him, and to direct all our courses to that end. This is indeed to set him up a throne in our hearts, and to make him a God, when rather than we will displease him or his vicegerent, his vicar in us, which is conscience (that he hath placed in us as a monitor and as a witness), we will venture the loss of the creature, of anything in the world, rather than we will displease that vicar which he hath set in our hearts. This, I say, is to make him a God; and he will take the care and protection of such a man. St Paul here, in all the imputations, in all crosses in the world, he retires home, to himself, to his own house, to conscience; and that did bear him out, that 'in simplicity he had his conversation in the world.
In his commentary on 2 Corinthians 1:12