Take on board the advice about references being a formality, I can't imagine that the other applicants are getting references like- 'this bloke will change the world and win a nobel prize'.
The thing that universities will be most interested in is your qualifications, experience and personal statement. Then they will judge you at interview.
Remember, most references are short and almost pointless, so this isn't just exclusive to you, everyones references are like this, so you are not at a disadvantage