Parts of London do this borough-wide and it works very well.

My city recently did 15mph for neighborhood residential roads and 20mph for the wider through roads connecting to them. I feel much safer now when walking and biking in the neighborhood. The roads here were never intended for cars to be parked up and down both sides.