Allow access to the underlying stream

The use case here is to allow methods like `set_read_timeout` to be
called.