Google maps marker update from updated input fields

I have a google map that finds a user’s position by ip and then also if location is allowed on browser, more accurately. This is done from 2 variables for lat and lon.

The user can then complete a google places field that updates 2 hidden input fields with lat and lon. I have set these fields to update variables that is used with the above marker lat and lon positions.

There is a problem that I seem to not overcome and that is that all the values change and the map is updated, BUT ONLY AFTER ONE CLICKS ON THE MAP. The map for some reason needs some interaction to update based on the changed values. Is this a bug on this componant? Or is there a way to force the update by setting something in the code?