Google maps API: When going to the site with www and without, the Google maps doesn’t load consistently

When going to the site with www and without, the Google maps doesn’t load consistently.

I am using the google maps api on my site and getting the “This page didn’t load Google Maps correctly. See the JavaScript console for technical details.” error, but only in certain scenarios.

Going to https://www.[site].com/ the Google maps sections shows the error.
Going to https://[site].com/ the google maps pages does show with no error.

I am getting “Uncaught TypeError: can’t access property “prototype”, d is undefined” in the console (for the www only) … see attached image.

Because it does load sometimes I do not believe it is an issue with the key, but I could be wrong.

Console Error Image: