Load Video Buffer Fast HTML JS

I have a node server that sends an mp4 video stream and a front-end that consumes this video through an xmlhttprequestto load the video buffer, but this solution became slower on lower internet connections compared to normal method of the tag (which makes a few-byte ‘media’ request in the network tab). Is there any way to improve the loading of videos without using the internal element of ?