After moving closer to the ancient ruins, you are able to uncover a stone tablet covered in numbers. There are too many to be the exit code but maybe you'll find something else nearby to help decipher this.