falling from grace

Is not going to church (any Christian church) falling from grace? Are we in eternal damnation for not going? If we fail to go a couple of Sundays and then go back to church, are we back in grace? If we stop going for a long time and then return, are we once again in grace? Does all this matter at all?