Fix default features test (#2881)

## Motivation and Context
<!--- Why is this change required? What problem does it solve? -->
<!--- If it fixes an open issue, please link to the issue here -->

## Description
The default features test is actually broken and failed during the
release dry run

## Testing
- ~Added the default features test to CI~ got a linker error


----

_By submitting this pull request, I confirm that you can use, modify,
copy, and redistribute this contribution, under the terms of your
choice._