The cave is dark and gremlins are damaged by the Light spell and wands of light. An amulet of light, a torch, adequate castings of the Light spell or many wands of light are necessary simply to see and navigate the cave. The spell or wands can also be used to kill gremlins. If the PC is fairly buff, the Gremlin Cave can be used to train weapon skills, since a potentially infinite number of gremlins will be generated. They are not particularly difficult for a mid-level PC to kill until the PC has killed thousands.
Since there are a potentially endless number of gremlins available, it is also possible to use the Pick Pockets skill indefinitely. This will both train the skill and satisfy Yergius regarding the PC's proficiency as a thief. Bear in mind also the always-present possibilty of pickpocketing a truly outstanding item. While it is very rare, artifacts have been pickpocketed this way.
Note that it is in no way necessary to enter this cave to complete the game. It is simply a source of an expendable artifact which can be sacrificed, given to the demented ratling or sold. The climbing set is also useful of course, especially if the PC has missed the opportunity to enter the Pyramid.