Very likely, yes.

The ~ key is where the Japanese keyboard (the actual physical thing, that is) has a key to switch between input modes, so that is probably why you were able to switch that way.

Fair warning though, some punctuation marks may also end up in different places. My (very much Dutch) keyboard behaves like a Japanese one when connected to the PS3.