distinguished from a length 0 token.
buffer_get_token for getting n bytes till finding a termination char or EOF/error.