MARS - mobile application rating scale

Thank you for using the Hand Therapy app and for taking time to provide feedback.

The Mobile Application Rating Scale (MARS) is a validated tool used to evaluate the quality of Mobile Health apps. Completing this survey will give the app a rating which will enable comparison with other Health apps.

Your personal data

Completing the survey is voluntary, but by doing so you are agreeing for us to collect, store and use the information that you provide. We will do so in a way that ensures confidentiality of what you tell us and we will comply with the relevant EU GDPR and other data protection laws.

Question Title

* 1. Is the app fun/entertaining to use?

Dull, not fun or entertaining at all

Mostly boring

Ok fun enough to entertain user for a brief time (< 5 mins)

Moderately fun and entertaining, would entertain user for some time (5-10 mins total)

Highly entertaining and fun, and would stimulate repeat use

Question Title

* 2. Is the app interesting to use?

Not interesting at all

Mostly interesting

Ok, neither interesting or uninteresting; would engage user for a brief time (< 5 mins)

Moderately interesting; would engage for sometime (5-10 mins total)

Very interesting; would engage user in repeat use

Question Title

* 3. Does it provide/retain all necessary settings/preferences for app features?

Does not allow any customisation or requires setting to be input every time

Allows insufficient customisation

Allows basic customisation to function adequately

Allows numerous options for customisation

Allows complete tailoring to individuals characteristics/preferences/retains all settings

Question Title

* 4. Does it allow user input, provide feedback, contain prompts?

No interactive features and/or no response to user interaction

Insufficient interactivity, or feedback, or user input options, limiting functions

Basic interactive features and function adequately

Offers a variety of interactive features/feedback/user input options

Very high level of responsiveness through interactive features/feedback/user input options

Question Title

* 5. Is the app content (visual information, language, design) appropriate for your target audience?

Completely inappropriate/unclear/confusing

Inappropriate/unclear/confusing

Acceptable but not targeted. May be inappropriate/unclear/confusing

Well-targeted, with negligible issues

Perfectly targeted, no issues found

Question Title

* 6. How accurately/fast do the app features (functions) and components (buttons/menus) work?

App is broken; no/insufficient/inaccurate response (eg crashes/bugs/broken features etc)

Some functions work, but lagging or containing major technical problems

App works overall. Some technical problems need fixing/Slow at times

Mostly functional with minor/negligible problems

Perfect/timely response; no technical bugs found

Question Title

* 7. How easy is it to learn how to use the app; how clear are the menu labels/icons and instructions?

No/limited instructions; menu labels are confusing; complicated

Useable after a lot of time/effort

Useable after some time/effort

Easy to learn how to use the app (or has clear instructions)

Perfectly logical, easy, clear and intuitive screen flow through out, or offers short cuts

Question Title

* 8. Is moving between screens logical/accurate/appropriate/uninterrupted; are all necessary screen links present?

Different sections within the app see logically disconnected and random/confusing/navigation is difficult

Usable after a lot of time/effort

Usable after some of time/effort

Easy to use or missing a negligible link

Perfectly logical, easy, clear and intuitive screen flow throughout, or offers shortcuts

Question Title

* 9. Are interactions (taps/swipes/pinches/scrolls) consistent and intuitive across all components/screens?

Completely inconsistent and confusing

Often inconsistent and confusing

OK with some inconsistencies/confusing elements

Mostly consistent, intuitive with negligible problems

Perfectly consistent and intuitive

Question Title

* 10. Is arrangement and size of buttons/icons/menus/content on the screen appropriate or zoomable if needed?

Very bad design, cluttered, some options impossible to select/locate/see/read device display not optimised

Bad design, random unclear, some options difficult to select/locate/see/read

Satisfactory, few problems with selecting/locating/seeing/reading/ items or with minor screen size problems

Mostly clear, able to select/locate/see/read items

Professional, simple, clear, orderly, logically organised, device display optimised. Every design component has a purpose

Question Title

* 11. How high is the quality/resolution of graphics used for buttons/icons/menus/content?

Graphics appear amateur, very poor visual design – disproportionate, completely stylistically inconsistent

Low quality/low-resolution graphics; low quality visual design disproportionate, stylistically inconsistent

Moderate quality graphics visual design (generally consistent in style)

High quality /resolution graphics visual design mostly proportionate, stylistically consistent

Very high quality /resolution graphics visual design mostly proportionate, stylistically consistent throughout

Question Title

* 12. How good does the app look?

No visual appeal, unpleasant to look at, poorly designed, clashing/mismatched colours

Little visual appeal – poorly designed, bad use of colour, visually boring

Some visual appeal – average, neither, pleasant, nor unpleasant

High level of visual appeal – seamless graphics, consistent and professionally designed

As above + very attractive, memorable, stands out; use of colour enhances app features/menus

Question Title

* 13. Accuracy of app description (in app store): Does the app contain what is described?

Misleading. App does not contain the described components/functions. Or has no description

Inaccurate. App contains very few of the describe components/functions

OK. App contains some described components/functions

Accurate. App contains most the described components/functions

Highly accurate description the app components/functions

Question Title

* 14. Does the app have specific, measurable and achievable goals (specified in app store description or within the app itself)?

N/A Description does not list goals, or app goals are irrelevant to research goal

App has no chance of achieving its stated goals

Description lists some goals, but the app has very little chance

Ok. App has clear goals, which may be achievable

App has clearly specified goals, which are measurable and achievable

App has specific and measurable goals, which are highly likely to be achieved.

Question Title

* 15. Quality of information: Is app content correct, well written, and relevant to the goal/topic of the app?

N/A There is no information within the app

Irrelevant/inappropriate /incoherent/incorrect

Poor. Barely relevant/appropriate/maybe incorrect

Moderately/relevant/appropriate/coherent/appears correct

Relevant/appropriate/coherent/correct

Highly relevant, appropriate, coherent, correct

Question Title

* 16. Quantity of information: Is the extent of coverage within the scope of the app; and comprehensive but concise?

N/A There is no information within the app

Minimal or overwhelming

Insufficient and possibly overwhelming

OK but not comprehensive and concise

Offers a broad range of information, has some gaps or unnecessary detail; or has no links to more information and resources

Comprehensive and concise; contains links to more information and resources

Question Title

* 17. Is visual explanation of concepts – through charts/graphs/images/videos, etc. – clear, logical, correct?

N/A there is not visual information within the app (e.g. it only contains audio)

Completely unclear/confusing/wrong necessary but missing

Ok. but often unclear/confusing/wrong

Mostly unclear/confusing/wrong

Mostly clear/logical/correct with negligible issues

Perfectly clear/logical/correct

Question Title

* 18. Does the app come from a legitimate source (specified in app store description or within the app itself)?

Source identified but legitimacy/trustworthiness of source is questionable (e.g. commercial business with vested interest)

Appears to come from a legitimate source, but it cannot be verified e.g. had no webpage)

Developed by a small NGO/institution (hospital/centre)/ specialised commercial business, funding body

Developed by government, university or as above but larger in scale

Developed using nationally competitive government or research funding (e.g. Research Council, NHMRC)

Question Title

* 19. Evidence base: Has the app been trialed/tested; must be verified by evidence (in published scientific literature)?

N/A The app has not been trialled/tested

The evidence suggests the app does not work

App has been trialled (e.g. acceptability, usability, satisfaction ratings) and has been partially positive outcomes in studies that are not randomised controlled trials (RCT’s) or there is little or no contradictory evidence

App has been trialled (e.g. acceptability, usability, satisfaction ratings) and has positive outcomes in studies that are not RCT’s and there is no contradictory evidence

App has been trialled and outcome tested in 1-2 RCT’s indicating positive results

App has been trialled and outcome tested in > 3 high quality RCT’s indicating positive results

Question Title

* 20. Would you recommend this app to people who might benefit from it?

Not at all - I would not recommend this app to anyone

There are very few people I would recommend this app too

Maybe - There are several people whom I would recommend this app to

There are many people whom I would recommend this app to

Definitely - I would recommend this app to everyone

None of the above

Question Title

* 21. How many times do you think you would use this app in the next 12 months if it was relevant to you?

None

1-2

3-10

11-50

>50

Question Title

* 22. Would you pay for this app?

Maybe

Yes

Question Title

* 23. What is your overall star rating of the app?

One of the worst apps I have used

Average

One of the best apps I have used

One of the worst apps I have used

Average

One of the best apps I have used