#688129 - Wed Feb 08 2012 05:04 AM
Question Quest - Are Modified Qs Replayed?
|
Enthusiast
Registered: Sat Dec 15 2007
Posts: 338
Loc: Gerrard's Ghyll Cumbria UK
|
At the top of the Accepted Submissions page there is a note that says, amongst other things "If a question turned out to be way too hard, for example, feel free to submit a correction requesting a change to make it more approachable."
I have done this with several of my older more obscure questions and just wanted to know if these modified questions go back into the New Questions game?
_________________________
I have a photographic memory, but keep forgetting to remove the lens cap...
|
|
Top
|
|
|
|
#688231 - Wed Feb 08 2012 12:15 PM
Re: Question Quest - Are Modified Qs Replayed?
[Re: agony]
|
Multiloquent
Registered: Wed Feb 03 2010
Posts: 3773
Loc: Florida USA
|
Is the level of modification any part of the equation? Meaning, if there are just minor spelling or grammar issues to correct, can the editors decide to keep it out of re-evaluation. I have had one change I know of that never returned to the battlefield of player rating. It had to have the Interesting Info expounded upon because one player noted other instances of the same info occurence (ex: I said Elvis wore blue outfit for the show - which doesn't rule out his wearing other colors in other parts of the show - and I had to update my info to reflect the other colors) After the info update, the Q never got more evaluations.
_________________________
"...Tomorrow's come a long way to help you." Tim Davis 'Your Saving Grace' Steve Miller Band (1969) "...Yesterday's at least a mile back." Dale Peters 'Dreaming in the Country' James Gang (1971)
|
|
Top
|
|
|
|
#688245 - Wed Feb 08 2012 12:54 PM
Re: Question Quest - Are Modified Qs Replayed?
[Re: mehaul]
|
Multiloquent
Registered: Tue Jan 20 2009
Posts: 2305
Loc: Briar Hill Victoria Australia
|
I am not sure how the system decides about the recycling. If an editor decides the correction is something they cannot make themselves, and take it out to send to the author for fixing, I would assume it goes back into the new mix when it goes online again.
Most of the corrections I see are for typos or other minor errors that can be handled by the editor, and the author never sees them, unless they regularly read through all their questions and see the change. And for some questions the correction is not valid, so the question just gets re-saved as is. I have no idea how the system decides in that case - possibly recycles for a change to the actual question, and leaves where it is if it is only the extra information, because that will not affect the difficulty? Just guessing, though.
_________________________
(Editor, Humanities, Literature and Books For Children) That's all, folks!
|
|
Top
|
|
|
|
#688302 - Wed Feb 08 2012 02:37 PM
Re: Question Quest - Are Modified Qs Replayed?
[Re: looney_tunes]
|
Enthusiast
Registered: Sat Dec 15 2007
Posts: 338
Loc: Gerrard's Ghyll Cumbria UK
|
I am referring specifically to the instruction to modify questions to make them "more approachable" - i.e. more likely to achieve the ideal 55-95% range for correct guesses.
For modifying one's own questions, once they have been accepted, one sends a correction notice with the proposed alterations. This may be as minor as adding a word to the question, or as major as almost completely rewriting it - I have done both! Editors, not authors, make the actual changes to the questions.
The implication of the instruction is that these modified questions will re-enter the new questions pool and be played again. If this is not the case, then there seems little point in modifying questions.
Or am I missing something?
_________________________
I have a photographic memory, but keep forgetting to remove the lens cap...
|
|
Top
|
|
|
|
#688314 - Wed Feb 08 2012 03:38 PM
Re: Question Quest - Are Modified Qs Replayed?
[Re: highfells]
|
Multiloquent
Registered: Tue Jan 20 2009
Posts: 2305
Loc: Briar Hill Victoria Australia
|
Even if they don't reenter the New Question pool, they will be in the hourly games and getting plays, albeit possibly more slowly, which do affect their difficulty rating, so it is not pointless.
_________________________
(Editor, Humanities, Literature and Books For Children) That's all, folks!
|
|
Top
|
|
|
|
#688365 - Wed Feb 08 2012 05:17 PM
Re: Question Quest - Are Modified Qs Replayed?
[Re: looney_tunes]
|
Enthusiast
Registered: Sat Dec 15 2007
Posts: 338
Loc: Gerrard's Ghyll Cumbria UK
|
Even if they don't reenter the New Question pool, they will be in the hourly games and getting plays, albeit possibly more slowly, which do affect their difficulty rating, so it is not pointless. Thanks for that information.  I have just had a look at the stats on one of my modified questions and realised that they have changed very slightly.
_________________________
I have a photographic memory, but keep forgetting to remove the lens cap...
|
|
Top
|
|
|
|
#775208 - Fri Mar 02 2012 02:08 PM
Re: Question Quest - Are Modified Qs Replayed?
[Re: Midget40]
|
Enthusiast
Registered: Sat Dec 15 2007
Posts: 338
Loc: Gerrard's Ghyll Cumbria UK
|
Just a point for consideration for authors that want to 'modify' their own questions: There is no way to tell that this is a question that is being replayed so people (like me) who remember questions will see it and think "that's not an original question" and mark it accordingly - I personally mark questions that are not original as poor. So you could end up losing some ratings as well. (If only I could remember the answers like I do the questions I'd be set LOL)
That seems a rather harsh attitude. Are there others who would act in a similar way? If so, there seems little point in following that part of the Question Quest instructions that specifically encourages revisiting questions that may not have good ratings "to make them more approachable".
_________________________
I have a photographic memory, but keep forgetting to remove the lens cap...
|
|
Top
|
|
|
|
#775234 - Fri Mar 02 2012 03:56 PM
Re: Question Quest - Are Modified Qs Replayed?
[Re: highfells]
|
Multiloquent
Registered: Tue Jan 20 2009
Posts: 2305
Loc: Briar Hill Victoria Australia
|
Just a point for consideration for authors that want to 'modify' their own questions: There is no way to tell that this is a question that is being replayed so people (like me) who remember questions will see it and think "that's not an original question" and mark it accordingly - I personally mark questions that are not original as poor. So you could end up losing some ratings as well. (If only I could remember the answers like I do the questions I'd be set LOL)
That seems a rather harsh attitude. Are there others who would act in a similar way? If so, there seems little point in following that part of the Question Quest instructions that specifically encourages revisiting questions that may not have good ratings "to make them more approachable". I have seen that comment made by others. It's probably not worth rewriting a question just to make it more popular, given that some of the new opinions would be worse. It is still worthwhile reworking a question to make it easier for players, if the correct percentage is lower than you want. As well as some who may rank it lower because they think they've sen it before, there will be new players who will rate it with fresh eyes. And you might make it into the target zone for level of difficulty.
_________________________
(Editor, Humanities, Literature and Books For Children) That's all, folks!
|
|
Top
|
|
|
|
#775252 - Fri Mar 02 2012 04:36 PM
Re: Question Quest - Are Modified Qs Replayed?
[Re: looney_tunes]
|
Enthusiast
Registered: Sat Dec 15 2007
Posts: 338
Loc: Gerrard's Ghyll Cumbria UK
|
It is still worthwhile reworking a question to make it easier for players, if the correct percentage is lower than you want. As well as some who may rank it lower because they think they've sen it before, there will be new players who will rate it with fresh eyes. And you might make it into the target zone for level of difficulty. It was the difficulty rating that I assumed the editors meant by the term "approachable". But I must say that I find the concept of "marking down" a question rather bizarre. One does not generally penalise someone for trying again... 
_________________________
I have a photographic memory, but keep forgetting to remove the lens cap...
|
|
Top
|
|
|
|
#775268 - Fri Mar 02 2012 05:07 PM
Re: Question Quest - Are Modified Qs Replayed?
[Re: highfells]
|
Multiloquent
Registered: Tue Jan 20 2009
Posts: 2305
Loc: Briar Hill Victoria Australia
|
But I must say that I find the concept of "marking down" a question rather bizarre. One does not generally penalise someone for trying again... The point is that players don't realise you are trying again to improve the question, they just see a question that they think is a lot like something they have seen before, and not original and creative. I personally would not mark it as poor on that basis - it may be an improvement on the other questions along the same lines that I have seen before, either in the way it is asked or in the extra information provided - but there are clearly some who do so.
_________________________
(Editor, Humanities, Literature and Books For Children) That's all, folks!
|
|
Top
|
|
|
|
#775272 - Fri Mar 02 2012 05:17 PM
Re: Question Quest - Are Modified Qs Replayed?
[Re: looney_tunes]
|
Champion Poster
Registered: Mon Jul 09 2007
Posts: 29440
Loc: Ottawa Ontario Canada
|
Would the poor rating even count again if that player has seen your question before and rated it before?
_________________________
Editor: Television and Animals
|
|
Top
|
|
|
|
#775277 - Fri Mar 02 2012 05:42 PM
Re: Question Quest - Are Modified Qs Replayed?
[Re: guitargoddess]
|
Forum Champion
Registered: Thu Feb 08 2001
Posts: 5009
Loc: Ottawa Ontario Canada
|
I always rate something that I think I've seen before as "average" so that it doesn't skew it one way or the other.
_________________________
Chan fhiach cuirm gun a comhradh. A feast is no use without good talk.
Editor for Humanities and Movies
|
|
Top
|
|
|
|
#775310 - Fri Mar 02 2012 08:04 PM
Re: Question Quest - Are Modified Qs Replayed?
[Re: LadyCaitriona]
|
Multiloquent
Registered: Wed Feb 03 2010
Posts: 3773
Loc: Florida USA
|
Those 'done overs' shouldn't be in the New Question Game. They should be in the Revised Question Game, IMHO. Just as GG said, do you get to have one person rate twice? How do you decide a new, unexposed set of raters to take the improved version? Quizzes are only allowed to be rated once and revisions are done to them without going back to 'New Quizzes'. If the change is that sufficient to alter a lot of opinions about it, generate a whole new, re-worded version of it for the NQG which would get the ratings run a month or two down the pike. Rem there is no demerit for a bad question, your total toward the QQ badge just doesn't increase on a bad rating. (quiet aside: it is different when a good rated Q isn't counted, though)
Edited by mehaul (Fri Mar 02 2012 09:01 PM)
_________________________
"...Tomorrow's come a long way to help you." Tim Davis 'Your Saving Grace' Steve Miller Band (1969) "...Yesterday's at least a mile back." Dale Peters 'Dreaming in the Country' James Gang (1971)
|
|
Top
|
|
|
|
#775440 - Sat Mar 03 2012 10:47 AM
Re: Question Quest - Are Modified Qs Replayed?
[Re: rossian]
|
Multiloquent
Registered: Tue Jul 04 2006
Posts: 2923
Loc: Lawrenceville Georgia USA
|
I have also played questions which appear to be almost direct copies of my own questions (from quizzes) but this could just be co-incidence. I've decided it's kinder to just rate the question as it stands and give the author the benefit of the doubt. I have started doing the same, rossian, rating questions as if they were totally new on their own merits. Nevertheless, I do usually flag the similarity via a comment as a question correction note, just so the editors are aware.
Edited by shuehorn (Sat Mar 03 2012 10:48 AM)
_________________________
Sue (shuehorn)
|
|
Top
|
|
|
|
#775531 - Sat Mar 03 2012 06:42 PM
Re: Question Quest - Are Modified Qs Replayed?
[Re: WesleyCrusher]
|
Champion Poster
Registered: Mon Jul 09 2007
Posts: 29440
Loc: Ottawa Ontario Canada
|
I think too that older questions went for another round through the game just for more ratings, not necessarily that they were saved again. When the New Question game first started questions were only played about 175-200 times each but then that increased a lot. I think at one point older questions started being played again to make up some ground to be more comparable with the questions that are now getting played more like 350-400 times.
_________________________
Editor: Television and Animals
|
|
Top
|
|
|
|
#775643 - Sun Mar 04 2012 04:06 AM
Re: Question Quest - Are Modified Qs Replayed?
[Re: rossian]
|
Enthusiast
Registered: Sat Dec 15 2007
Posts: 338
Loc: Gerrard's Ghyll Cumbria UK
|
This means that those players who rate the question 'poor' or 'average' because they believe it's a copy of a previous one are being unfair. It seems the authors of these questions are being penalised over something that is totally out of their control. I'm not sure that there's anything that can be done, but maybe the players who do this could reconsider based on the information provided by these editors. My point exactly. The instructions encourage us to aim for the 55-95% correct window and to revisit questions that fall below this to make them more approachable. If this results in players giving a poor rating to what might otherwise have been a good question, then, indeed, authors are penalised unfairly for their efforts. Perhaps there should be a function for the editors to clear the modification correction once made, as indicated, or maybe the instructions for New Questions should be revisited. The few questions that I have revised have mostly been those with a good rating but low percentage correct - i.e. questions that the majority of players considered average to interesting, even though the majority of players answered incorrectly. By changing one or two words in the question, or changing one of the answer choices, one can frequently give a much better chance for players to guess the correct answer - the question is "more approachable". If these questions are going back into the New Questions game, then perhaps the rating box should be removed.
_________________________
I have a photographic memory, but keep forgetting to remove the lens cap...
|
|
Top
|
|
|
|
#775664 - Sun Mar 04 2012 08:48 AM
Re: Question Quest - Are Modified Qs Replayed?
[Re: highfells]
|
Multiloquent
Registered: Wed Feb 03 2010
Posts: 3773
Loc: Florida USA
|
Whoa. The subject slipped from fixing to get a better % correct into that means a better good/bad rating result. The two things are not connected. Getting a higher % correct may mean the Q's been dumbed-down so much that people think it not worthy of the time taken on it.
A couple of members have mentioned it only takes a split second to do ratings. Au contraire, the answer page is where we encounter the interesting information. To read and understand how the information explains or expounds upon a question and decide if it has value should take more time than less than a second. If the Q change being talked about is entirely within the Information section, it shouldn't effect the % correct number at all. It should effect the good/bad perception.
Edited by mehaul (Sun Mar 04 2012 09:06 AM)
_________________________
"...Tomorrow's come a long way to help you." Tim Davis 'Your Saving Grace' Steve Miller Band (1969) "...Yesterday's at least a mile back." Dale Peters 'Dreaming in the Country' James Gang (1971)
|
|
Top
|
|
|
|
#775757 - Sun Mar 04 2012 11:12 AM
Re: Question Quest - Are Modified Qs Replayed?
[Re: mehaul]
|
Multiloquent
Registered: Wed Feb 03 2010
Posts: 3773
Loc: Florida USA
|
I just went to play the New Questions Game and noticed this (my bolding) in the game home page title box at the top of the page::: (start copy) Welcome to FunTrivia Skunkworks : The New Questions game. This game is a little different. Questions you see in this game are appearing for their first time ever on our site, so everyone is on a completely level playing field -- no memorization is possible! (end copy)
I don't see how resubmissions can fit that description. If they are to be allowed back for further review/rating, then the game title area needs changing.
_________________________
"...Tomorrow's come a long way to help you." Tim Davis 'Your Saving Grace' Steve Miller Band (1969) "...Yesterday's at least a mile back." Dale Peters 'Dreaming in the Country' James Gang (1971)
|
|
Top
|
|
|
|
#775768 - Sun Mar 04 2012 11:46 AM
Re: Question Quest - Are Modified Qs Replayed?
[Re: mehaul]
|
Multiloquent
Registered: Tue Jan 20 2009
Posts: 2305
Loc: Briar Hill Victoria Australia
|
Whoa. The subject slipped from fixing to get a better % correct into that means a better good/bad rating result. The two things are not connected. Getting a higher % correct may mean the Q's been dumbed-down so much that people think it not worthy of the time taken on it.
A couple of members have mentioned it only takes a split second to do ratings. Au contraire, the answer page is where we encounter the interesting information. To read and understand how the information explains or expounds upon a question and decide if it has value should take more time than less than a second. If the Q change being talked about is entirely within the Information section, it shouldn't effect the % correct number at all. It should effect the good/bad perception. The question was always getting a better % correct, the worry is that it may happen at the expense of a previously-established good/bad rating. Generally, trying for a better % correct involves changing the actual question, and not the extra information. That being the case, it actually is a new question (the point raised in your next post) that is similar to a previous question. Saying that rating only takes a couple of seconds presumes that everyone reads the extra information already, and rating takes a single click longer once it had been read and considered. Players who only consider the question and answer as important will naturally take a lot longer if they actually have to add the time required to read the information onto their time.
_________________________
(Editor, Humanities, Literature and Books For Children) That's all, folks!
|
|
Top
|
|
|
|
#775772 - Sun Mar 04 2012 12:07 PM
Re: Question Quest - Are Modified Qs Replayed?
[Re: looney_tunes]
|
Multiloquent
Registered: Wed Feb 03 2010
Posts: 3773
Loc: Florida USA
|
I was referroing to the post before mine where it was said::: My point exactly. The instructions encourage us to aim for the 55-95% correct window and to revisit questions that fall below this to make them more approachable.
If this results in players giving a poor rating to what might otherwise have been a good question, then, indeed, authors are penalised unfairly for their efforts. See, it went from the subject being % to the matter of goodness. That took the reason for making corrections for % correct as being responsible for the good/bad ratings the way I read it. If you are rating, you should be reading the II. A good Q&A may have completely bogus II with it. I think my second posting above is more important to the discussion anyway. There shouldn't be any small changes showing up for members to rate a second time according to the games' mission statement. We each see a Q once and that's it. I wouldn't mind seeing a redone area to rate fixed, spayed or neutered Q&As. My stance of only once through I think is fair to the Qs that only need the once through. But I understand and agree that an author be given a chance to improve their product. It's just that the NQG shouldn't be the clearinghouse for those.
_________________________
"...Tomorrow's come a long way to help you." Tim Davis 'Your Saving Grace' Steve Miller Band (1969) "...Yesterday's at least a mile back." Dale Peters 'Dreaming in the Country' James Gang (1971)
|
|
Top
|
|
|
|
|
|