[R] How can I fix extreme softmax values in my model?

Follow the full discussion on Reddit.
Hello everyone, I am currently working on a project using a visual question answering model. The way it works in a nutshell is: It takes as input an image and a question and as an output uses a text generator to provide the answer. I am trying to get the confidence of my models outputs by using softmax.