Prevent serviceworker from changing Referer header

Every fetch request intercepted by the serviceworker have the Referer header (original url of the page from which the request originated) changed to the serviceworker url.

The Referer header of the fetch request cannot be rewritten when inside the serviceworker, as it is one of the forbidden headers.

So, is there any option to prevent this header from changing when intercepted? I need to log in my server the original Referer values.