If you have made those changes in the listener then the Acknowledgement should not be received. I have verified at my end.
Did you check-in the changes before testing?
May be there is some step or configuration to send the email in the Service activity called in Service method of the listener. You can identify this by tracing the listener, if any Send email activity is getting called.