That's just how the system was designed, every individual person will theoretically get x8 contribution just by being in a full party, everything your party members do will count towards your contribution, everything you do will count towards theirs. You likely saw a torrent of people asking for invite in shout chat, just ask as well and you will get full contribution, you don't even have to talk to your party.

Hunts work the same way.