From defender's POV, you're at -4 to everything (-2 defences), and:
It's got your torso grappled with two arms.
Note: you can swing a sword, but see upthread for the long weapon in close combat penalty. Or you can whack him with the hilt, or knee, etc.
From attacker's POV:
Jibril has Wrestling-14, btw (which will help resisting takedowns). If you drop your torch and/or sword you could grapple back and then throw him down.