I grew up Presbyterian, just a basic Protestant upbringing. There were years in my life when I would go to church every Sunday and to Sunday school. Then I just phased out of it.
The only issue is there is not a big group of officials available early in the day. I think all schools would like to try to go to afternoon games at some point, but with the availability of officials, it probably won't happen.