The supervisor-PhD student relationship is one of the most important factors in the success of a PhD. No doubt about it! However, passion for your subject and your project can take you a long way. As you hinted it also very much depends exactly what the issue with your supervisor is. As long as your supervisor is not obstructive and that you have access to the training you need from other sources, you can get also support on a day-to-day basis from others: fellow students, post docs, research assistants, research technicians, your second supervisor...
If the situation is really bad, it would be worth talking to your supervisor (do not call them lousy to their face!) or other people at your institution to find out how you can get support. Your last resort would be to start exploring the possibility of changing supervisor altogether.
The following article addresses some of the student-supervisor issues:
Best of luck