Discussion about this post

User's avatar
Algon33's avatar

"A Couple of Worlds" sounds like its referring to Mangled Worlds. https://mason.gmu.edu/~rhanson/mangledworlds.html

"Such a Thing doesn’t have to be one of those uncool beep boop silicon machines that can’t ever give rise to subjective experience oh no no way, it can be a cool bio-optical morphogenetic Yoneda-Friston entangled tubulin resonance processor. Whatever)." I'm laughing at this.

Lavander's avatar

Unclear why this mind formed, with this preference / way of behaving. Was it a coincidence?

Also, it's weird to postulate really large pile of compute for this, it sounds adjacent to an error people make by making their perpetual motion designs too complex. Is there a reason that it's planet full of fungus, not a one island full of fungus, or one jug of fungus?

I have no objection to how you describe uhh mixed-symbolic program enumeration. In fact some people already do this, by synthesizing programs for OEIS, fast ones and short ones and proving their correspondence.

Also, it should be noted that it's a risky thing to simulate random stuff while not being yourself very good strategic agent, your simulation might take over over you, and you simulate stuff no longer.

And there might be another thing, it might be detrimental to look at reckless agents, who might run searches for infohazards such that it would be absolutely catastrophic if they themselves, or anyone else knew them. Good luck checking that there are no such things, without red teaming yourself. They might be toxic to look at too closely.

Also I find this anthropic explanation for why I'm me to be extremely dubious both on prior of how underdeveloped this field is and object level.

3 more comments...

No posts

Ready for more?