I've had to waste loads of time today grappling with the forces of reliability testing for a questionnaire system of measurement. Anyway, for demonstrating test-retest reliability, I finally settled on intraclass correlation co-efficients, Lin's Co-efficient of Concordance and a decided to go a bit descriptive with doing a Bland and Altman Limits of Agreement Plot. Now, I'm pretty sure the first two are fine - even though they are ordinal and strictly speaking...but everyone does it (papers galore use the same approach and I don't want to be left out with naff non-parametric tests that only null hypothesis fetishists use. But then there's the Bland and Altman plot - someone has said that it's naughty to use it on non-normally distributed data - and I've used convenience sampling and it's non-parametric. I was sweating at this point and thought about how I can justify it and there's a very strong argument for treating ordinal scales with 5 or more points as interval level data. And then a master of the psychometric dark arts has said that although strictly speaking it is naive to treat ordinal level data as interval (and so parametric), it can pragmatically be useful. And then people in the behavioural and social sciences do it. Sorry, I'll get to my point... So, I'm thinking I should go with using a Bland and Altman plot for agreement and not worry about the fact that I've used parametric statistics for ordinal level data, since it is popular and I can justify it. I have a pragmatic research world view anyway - and it's about the ends justifying the means. And I've spent a/wasted 2/3 of a day having to look into this. For anyone who knows about this stuff or is interested in this post, does that sound fair? Or is it a complete (turkey)?
I thought this was going to be about car insurance and was going to be able to put to use my knowledge of the industry.
I'm also a statistician but after two days of learning about Access, it's a bit much to understand, I'll have a look tomorrow if nobody else has replied.
I also thought it was going to be about insurance! Then again I'm not a statistician, and reading the message left me completely baffled :p
I like Bland-Altman plots. :)
Can't think why they can only be used on parametric data though. Then again there seems to be a lot of rules around stats...think I'll be breaking a lot of them in my thesis...
PostgraduateForum Is a trading name of FindAUniversity Ltd
FindAUniversity Ltd, 77 Sidney St, Sheffield, S1 4RG, UK. Tel +44 (0) 114 268 4940 Fax: +44 (0) 114 268 5766
An active and supportive community.
Support and advice from your peers.
Your postgraduate questions answered.
Use your experience to help others.
Enter your email address below to get started with your forum account
Enter your username below to login to your account
An email has been sent to your email account along with instructions on how to reset your password. If you do not recieve your email, or have any futher problems accessing your account, then please contact our customer support.
or continue as guest
To ensure all features on our website work properly, your computer, tablet or mobile needs to accept cookies. Our cookies don’t store your personal information, but provide us with anonymous information about use of the website and help us recognise you so we can offer you services more relevant to you. For more information please read our privacy policy
Agree Agree