At this point it may be proper to notice the relation of the propitiatory death of Christ to children who die in infancy. So far as now appears, such children are put in no practical relation to the atonement, unless it be by the secret and renewing work of the Spirit. Assuming, as we must, that this life is the only period of grace for mankind as sinners, and that the death of Christ was in some way for all our race, it follows that dying infants are regenerated by the Holy Spirit given by Christ (p.230).
–Alvah Hovey, Manual of Systematic Theology And Christian Ethics, Boston: Henry A. Young & Co.1877.