There is no difference in the installer for Xeams Community and Enterprise Edition. It will run as if you have purchased the Enterprise Edition for the first 30 days. It will then get converted to Community Edition unless a license is purchased.
HTTPS is a prerequisite for STARTTLS in SMTP, POP3 and IMAP servers. Go to Server Configuration and specify a value for Secure Web Server Port. Once done, restart Xeams and see if that works.