portaudio is an audio I/O library that has better support for some functionalities and is lighter-weight than SDL2. It also includes ASIO implementation. But it does not support hot-plug detection.
libsoundio is another audio I/O library that supports hot-plug detection.