When making adjustments while playing a file, does the filter re-filter immediately or do you have to hit stop / toggle the EQ button or something?

During playback edits can be made and the change will be heard after the filter updates. The time it takes to update depends upon the speed of your machine and the complexity of the filter. When the filter is updating an animation is displayed in the status bar.