Well, there is sm64 PC port which is a MIPS decompiler that wraps the game data. There is dolphin project which would be the nearest GCN equivalent. GCN uses PowerPC architecture so it would help to know that instruction set as well.