Master reset filter

I have the variations displayed on the product archive page. This works well. However, when is used together with sorting function, it doesn’t work.

The reset button shows even when no variables is selected. When the reset button is clicked, it doesn’t reset anything, it added a “#” to the slug /?orderby=date#. When the sorting function is activated, the variable value is not clickable nor accepted.

Added an image for illustration purpose

I’ve also explored several plugins but none of them is able to resolve this issue. Not sure if my thought process is correct, I wonder if there is a way to have a master reset to clear all filters on the product archive page?