If you want the image to be displayed all the time at the bottom right, pls have a look at the implementation of the back-to-top button that comes up at the bottom right. The CSS for this should help. You can have a look at the element #go-to-top at line number 1836 in style.css file in the theme directory. Thanks