Firstly do bear in mind the "temp" is the battery sensor temp.
The actual internals maybe hotter.

Have you tested for processes with top?
Have you tested for CPU usage with powertop?
Have you tried the device with standard clock speeds 250-600?