No, you don't have to go to everything - no-one keeps tabs on you, but if it's some kind of scientific society who funds your conference fee (IF you can find funding - it can be very difficult) they'll probably ask you to write a short report when you get back.
I don't think it's silly not wanting to go on your own - I have the same problem since I'm in a very small group. Ask the conference organisers if they have a registration fee for an "accompanying person" - I've seen that some conferences (usually the bigger ones) do this, and will organise a whole programme of activities for your accompanying person while you're at the presentations.