How do i stand up for myself?

People always take advantage of me. The same people will always make really rudy, nasty comments to me in the hallways, and give me dirty looks. From where im from if you say something, girls will want to fight you, and plain and simple i dont fight. So how can i stand up for myself without getting hit ? thanks!