>>9435592(cont)
"Now, the Stalfos are most likely age old guards, long dead, who still protect this castle. And who are the four female ghosts? Their portraits are on the walls, with the exception of Meg, although the images burned off, charred black. It makes me believe they were four ladies of the nobility. Why do they persist to haunt the FT? Something traumatic must have happened for them to want to kill Link. Considering the invaders were most likely male, as soldiers were mostly male, these four women might have been raped, tortured, and murdered. Thus, they continue to live, waiting to exact their revenge (which happens to be on poor old Link).
The invaders gone, the people residing in the castle all dead, the ghosts beginning to rise from the dead, the FT is finally abandoned. Overgrowth starts forming on the walls, perhaps ivy. The staircase to the actual FT is destroyed, either through weather or the invaders attempting to close off the castle forevermore. Many many years later, the ghosts eventually disappear as Saria appeases them (although how a little girl entered is still beyond me). After Ganondorf comes into power, he releases the spirits once again, who immediately turn on Saria, and even keep her in the boss lair, the nobleman's torture room.
And thus, we have Link enter, oblivious to all the horrors behind the Forest Temple, what I personally consider the most disturbing place in the game.
Of course, this is purely speculative."