To see the bug room:
1. Go to Alaric's room.
2. Exit his room to the right and wander over to the abyss.
3. Stand on the ledge overlooking the abyss and go left as far as you can (only one or two paces).
4. Return to Alaric's room and position yourself one pace from the western wall.
Unfortunately all you can do is see it. I've heard no reports of anyone getting there.