When a farmer leaves some unharvested crops in the field, they are not "wasted." Real waste would be found in efforts to use up every last physical resource, no matter how costly those efforts might be.
We don’t let just anyone repair our homes or perform surgery. So why do we let everyone vote, and, theoretically, let just anyone rule? Jason Brennan’s recommendation is epistocracy: the rule of the knowledgeable.