Outer diameter should be essentially the same. Range killer with the larger wheels is predominately weight increase. There is probably some inefficiency too with the stiffer sidewalls on the larger tires, but not nearly as significant factor.
It's all about rotational mass and moment of inertia. Metal weighs more than rubber and with larger diameter wheels, the rotational mass moves out further from the rotation centerline. Under steady state speeds, i.e.highway, this difference isn't too significant. Stop and go traffic or city driving is where this difference will be much more prevalent. It will use more energy to start the wheel rolling. Heavier wheel would help with regen, but will expend more than is recouped.
So yes, a lighter 22" wheel would not have near a penalty, but will most likely always still be slightly more inefficient. Laws of physics can't be violated. I suppose it is theoretically possible to have a larger wheel with lower moment of inertia, but would be highly unusual.