The noun dictatorship of the proletariat can be countable or uncountable.
In more general, commonly used, contexts, the plural form will also be dictatorship of the proletariat.
However, in more specific contexts, the plural form can also be dictatorships of the proletariat e.g. in reference to various types of dictatorships of the proletariat or a collection of dictatorships of the proletariat.