The noun chagrin can be countable or uncountable.

In more general, commonly used, contexts, the plural form will also be chagrin.

However, in more specific contexts, the plural form can also be chagrins e.g. in reference to various types of chagrins or a collection of chagrins.