I think you can. I´m married to Abigail, but also continue giving gifts to everyone. With the marriageble characters I have heart events.
Not sure how wide it goes with being marriaged. You can divorce.
I have not ascertained that the spouse gets mad.