When does snoring become a problem?

When should we worry that our snoring might be the sign of a larger problem?