No error messages shown in log when Debug off. It should be like that?

I just noticed that when 500 errors happen for any reason ( “A server error occurred, etc.”) there are no records of this event shown in the app log, if Debug mode disabled.

I actually don’t remember if it was always like this.
How is it actually supposed to be?