I was sort of like you Orca, starting out with the 21 mg patch but I forgot to put it on about day 2 or 3 of my quit. Things didn't seem so bad for the rest of that day so I just decided to ditch the patches and get the nicotine out as soon as possible. I'm not sure if that was the right decision or not as going cold turkey from there on was no picnic, that's for sure. The bonus is that once I was probably a month or so in, I didn't have to face what you are dealing with now - getting the nic out of my system and dealing with a secondary withdrawal after I was just getting comfortable with my quit.
In retrospect, I'm glad I did it the way I did but everyone is different and has to find their own comfort zone and know what they personally can handle in terms of the nasty withdrawal symptoms. What ever works for YOU is the right choice Stick with it and pull yourself through this second set of challenges. You have the tools at the ready to get this done. I can't imagine any discomfort you're feeling now will last all that long. You have already begun to reprogram your brain in terms of dealing with those smoking triggers so now it's just getting the nicotine out.