Hi,
There's a couple of screws hiding on the back side of the pull-handle. I think it was a rubber or such cover you need to pull off first. You'd need a stubby screwdriver or maybe even just the 'bit' from one to get the handle off.
You would do well to have a fresh switch on-hand prior. If it's causing you grief like that, it's not going to get any better - just change it out and you'll be right as rain.
Removing the entire door panel, there's a couple of screws vertical, in that same 'hand grip' area, just under a layer of rubber. You should also have a screw behind the door light at the bottom. Pull the light assembly, find the screw (it will be towards the forward part of that opening).
You don't need a hammer and chisel, matter of fact, just get a 'panel clip tool', make one, or if you happen to have small hands, starting at the bottom, you can usually tug the panel free a bit at a time.
Work your way to the top, double check you got 'em all, and the entire door panel can be lifted -up- and off, minding all the wiring of course. You certainly don't need to pull the entire panel to access that switch.
Good luck! HTH!
Gord