Why all the Gorkhas are labelled as Nepalese from Nepal in most part of India?

It is a colloquial term generally used to mention, just like all south Indians are referred as 'Madrasis', irrespective of their state of origin.