The noun comfort can be countable or uncountable.

In more general, commonly used, contexts, the plural form will also be comfort.

However, in more specific contexts, the plural form can also be comforts e.g. in reference to various types of comforts or a collection of comforts.