I was reading the "Sunnah way of the Sufis" book by Sheikh Abdul Fattah al-Ghudda(RH) and it mentioned the topic of the jama'a and mentioned that it does not mean the "majority" and it is incorrect to understand that it means the majority and that we should follow the jama'a even if only one person follows. The book goes on the quote scholars such as Sheikh Ibn Hazm and Sheikh Ibn Qayyim Jawziyya as proof

So what are the views of the different scholars then??