We know we are using Python 3, so drop the tests using buffer() and always run those using memoryview().