Ken,
I am not sutre what you described should be considered a "time waster." Time with students is very important and you should keep doing what your doing. You may want to look for ways to be a little more efficient with them, but guard against giving the impression you are in a hurry.
Students probably come to you because you take time to instruct them.