4 mil is not a high amount, unless you're sitting in your moghouse waiting for stuff to fall into your lap. Which is indeed the average joe approach, so you are right there. AJs are lazy.
Anyone can get that amount in a week, two if they are unlucky. Ofcourse, question remains if you can actually BUY that many of the AH even if you have the money.
Increasing droprates of geodes would help, but SE also needs to remove the geode recipes and/or replace them with avatarites. (Remove gems from geode HQ3, add them as avatarite HQ3) Otherwise goldsmiths just buy the geodes right from under your nose.