Go north into the purple glowing portal. Follow the paths until you see a glowing portal. Eventually you will run into two Gladiolus and a third one will appear while you are fighting the other two. Once you defeat them break the memory stones for some health and then go up the stairs. There is another one to fight.