Sorry, I missed the SSL port for the setting. I updated it now and resent a test mail which was delivered though to SPAM inbox.
I tested the contact pages and all looks good.
But there is another concern, the email delivered was not properly formatted. No line spacing.
Please see the attached screenshot.
I noticed similar issue when a confirmation email was sent after registering on the website.
Another issue: When a user registers, a confirmation email sent has no activation link in it.