Did you ever see this picture by Edward Adelson?
The squares marked A and B are the same shade of grey. Want to see proof?
It kind of illustrates my point about the significance of the observer, doesn't it? After all, it is our brain that leads us to believe we're seeing black and white.