Painful reaction to alcohol?

I hardly ever drink, I have had three drinking binges in a year and everytime I go on these nights out I suffer the same painful reaction to alcohol which always ends my night. I get this severe sharp pain under my rib cage that trickles out to my chest and stomach, but mainly stays under the rib cage, it can get so painful, I find myself finding it hard to breathe. At this point i call it a night and head home, once I have stopped drinking and get ready for bed, the pain subsides as though it was never there. I went out last night, I was not drunk but I was drinking with the intention, the pain was its worst I had ever felt it, I thought I was going to pass out. Like I mentioned before, I rarely drink now as it has put me off completely. If I have a glass of wine or something after work (which has happened maybe 6 times in the past year) I never get the pain, it's only been when I have had the intention to get drunk so have bought a few drinks, though I don't have to be drunk. Would anyone know what this is? I turn my nose up at alcohol quite a lot so I never experience the pain. If it was the liver, surely I would get pain drinking or not? Maybe it's a reaction? Is it worth going to the doctors since I've had this pain three times in a year? I'm sure he would say to not drink which I hardly do anyway but I'd still like to know what it is. Anyone else had the same thing? It's the morning after the night out now, I didn't get drunk so only had four drinks, I got that pain but there is no sign of it now like it never happened. It's so weird, anyone had the same thing?