That's correct - Guest is special and is not in the "Everyone" group. To give guest user access to any objects other than ones in the the Guest Home you need to explicitly Invite the Guest user to the space/content.
I expect you would have to modify the configuration to add Guest to the Everyone group.
We have fixed an issue (for RC2) whereby if you tried to give out a URL to a space/document that was not guest accessable, you no longer an "AccessDenied" exception, instead you get redirected to the login page.
Thanks,
Kevin