That sounds fine especially if you have a car. if not there are buses to take you to callanish and surrounding area and I assume other places( the broch, black house etc). Although if you feel like doing some walking and enjoying the peace you may like to stay longer.
have a great time
love carolionexx