Did you add an A record for mail.mydomain.com ?
Once you're done adding both A and MX records, you should be able to run the following commands from any computer:
nslookup mail.mydomain.com
AND
nslookup -q=mx mydomain.com
The first command should return the public IP address of your network. The second command should return mail.mydomain.com.