Yes, you should try to get gear that is your level. If it's above your level, the only thing you get from armor is defense, weapons only give their attack power, and even then those stats are severely nerfed. As was said, they also get damaged much faster AND because they are higher level they cost a lot more to repair at a npc.

If you are looking for gear and can't find any on the wards, go to one of the adventurers guilds and check out the NPCs there. They are marked on the map by a bag with a star (labeled "Shop for Beginners"). You can find armor and weapons up to the low 20s for cheap.