It's not exactly as I remember it, but I stand by my point. Lyse provides an excuse for the 7 other people you're going to be with, and Alisaie says that it's a silly excuse, then they both may as well wink at the camera.
To circle back around to the main topic though, Lyse does confirm there that you have an 'awful lot of adventurer friends.'
It stands to reason that the people who attack you when you're on your own also know that you have an awful lot of adventurer friends, and because of the sheer absurdity of the idea, don't believe you routinely defeat demi-gods without them.