It can be noticeable during regular playback on a modern display, under the right conditions. Anime is one of those due to the high contrast in the picture.

It was also weird to pause an interlaced video on VHS and watch it alternate between frames. Any objects in motion would jump back and forth.