You would need to talk about what happens after. Who decides when to end - you or him? Are you going to want to get together with him after - what will you do if you want to or don't want to. What if one of you wants to and one doesn't?
What are you allowed to do say during?
How do you handle the other woman leaving or staying?
These are the things that occur to me.