Boyfriend wants to watch Superbowl without me

My boyfriend is a die hard Eagles fan. I don’t really like football but I’ve been going to a fan bar every Sunday to support him and the team. I do enjoy the environment. It’s a fun crowd. I did say once that I go there for him and I don’t like being there but I was upset about other things. He said that I shouldn’t feel obligated to watch the Super Bowl with him because he doesn’t want me to feel uncomfortable with the rowdy crowds. Should I let him watch it without me? I’m a bit upset he said I don’t have to go if I don’t want too.