To be clearer, the shape of buff icons is an arrow pointing up while debuff icons is an arrow pointing down.

Also, some debuffs cannot be erased particularly from boss fights. You will get used to it After a while