How can I set up custom authentication in Alfresco, what are the typical steps to achieve this? Any pointers/help or related articles would be highly appreciated.
Against what or how would you like your authentication? If you need something exotic, you can use an apache server in front of tomcat to perform authentication. Apache has module for a lot of authentication systems.