Unfortunately, there is no conf file to modify regarding this. This feature cannot be achieved without code modification. There is a technical reason for it. When binding to a socket, the low-level APIs either take a NULL (meaning it will bind to every IP) or a single IP.

Do you have other SMTP servers on the other IP? Can those be moved on a different VM?