What is the difference between Web Application & Web Forms Application in Visual Studio 2012?

The clue is in the word 'Empty'.
The first (highlighted in your image) option is a blank project.
Subsequent options set up a Web Forms, MVC3 or MVC4 project with appropriate directory structure and a default set of pages and supporting code.