The noun People of the Book is plural only.
The singular form of People of the Book is also People of the Book.