Asa Gray Occupied Quotations

Is it philosophical, is it quite allowable, to assume without evidence from fossil plants that the family or any of the genera was once larger and wide spread? and occupied a continuous area?