That’s all fine and dandy until your IP address and/or email address gets blacklisted. Hosting the server is the easy part. Properly dealing with anti-spam measures so you don’t get flagged as a spammer or scammer is the hard part. And before you think that’s unlikely, one of the ways of getting flagged is to run an email service on a consumer ISP network (e.g. comcast).
Fine, don’t believe someone that’s done it before. Google “why you shouldn’t host your own email server” and research before you say anything else.