This question is asked a lot, and it is weird that Google Calendar doesn’t allow for this, given you can add alternate email addresses to your calendar.
If you want the RSVP to come from your alternate email then you need to respond directly from that email, not from the main or default email.
Got more questions? Get in touch to find out how I can help you with your G Suite and Google related issues and drive better business outcomes.