Read more: Keep Birds Visiting Your Yard During Winter With A Roosting Box Another possible option is to add a heater to your bird bath to help prevent the water from freezing in cold temperatures.