Aside from the two issues @sdwilsh found, the last bit was convincing pex to not remove sys.prefix from sys.path.