I have a symfony2 application also supporting REST.
I'll assume you mean you have created RESTful data-driven api in Symfony that uses xml/json or some other data-centric non-html format? If not than I'm confused by this introduction since all websites overlap with REST in a generic way.
I would like to hear if it would be a good idea to go over the learning curve of angularjs or stick with jQuery and twig.
By far the simplest approach (if you are already familiar with Symfony) is to leverage Twig to render your views and pepper it with jQuery for the client-side dynamic/async rendering. Angular adds more conceptual layers than Twig. For instance it duplicates model management in the client. Twig has very low impedance for mapping views to models whereas Angular views will require much more code to manage this mapping. In some cases this decoupling views from data can be a huge boon, if architected correctly. It depends on the needs of your team.
My recommendation would be to implement a small slice of your functionality in both Twig and Angular and keep in mind they have dramatically different runtime considerations and real world mechanics. The most important difference is that Angular ships as client-side only rendering and Twig ships as server-side only rendering. These are fundamentally different concepts. It should be noted there is no reason you can't pre-render Angular on on the server or have the browser render using Twig. These are advanced and non-standard approaches that aren't currently native features of either Twig or Angular, but are entirely possible as optimization steps.
The "snappiness" you attribute to Angular is largely an arbitrary function of specific html + css complexity in a given context and the magnitude of difference between state changes. Wether you put the primary burden of view rendering on the server or client you can properly optimize that solution to be unobtrusive to your user. The issue is which side of the equation do you want to put your optimization efforts?
It seems like twig already has some nice features similar to those in angularjs such as filters and stuff. Also if l use angular it will break symfony's MVC since I will most probably have less views.
In general the design of Angular and Symfony are incongruent by analogy with the exception of the semantics of their view rendering, which may be misleading you. The best way to decide which is better for you and your team is to try them both.
You are not breaking Symfony's MVC in the slightest by using Angular. In essence a view is just a representation of data according to a format so whether your server sends JSON data to Angular or having Twig render HTML on the server you're still doing the "V" of Symfony's approach to MVC.
On the other hand I like the responsiveness of angular and it's like the new trend. Can you list some pros and cons in using angular in this scope?
If your user interface is very document/hypertext driven (in other words transparency for search engines matters to you) and you use less than a dozen async calls sitewide you'll almost certainly tend towards twig + jquery.
If your user interfaces require a level of complexity approaching a "desktop" application you'll almost certainly tend towards angular.
Many applications appearing on the market live between the two scenarios outlined. The closer you get to one the more clear your decision will become.
The one thing I can say is that if you have any doubt than you'll probably want to stick with twig/jquery, simply because they are very well understood and proven techniques and require a lot less of a learning curve if you're already building with Symfony.