gui design - What is the preferred behavior of form validation?

What is really the preferred behavior of form validation? When should the validation take place?

• When the user clicks "save"


• When the input field is out of focus


• As the user types

Is the preferred way the same on long vs. short forms, wizards and so on? What do you think?

(The form will be on desktop platform only)