Official LiveQuiz feedback thread

mr-gentleman

Steven

Moderator
Staff member
Messages
498
Points
63
oldgreydonkey said:
Now I have observed the network traffic of a visual only bug also. On the second question the posting of the answer took 12827 ms, but differently from the "real" bug this time it returned a 200 OK as a response. All the time was waiting for the response. Because the response was not returned in time for the reveal it was displayed as unanswered, but the answer was registered.
Click to expand...

Do you happen to have any further info about such situations or about when the the answer isn't counted? The tech team is currently trying to figure it out so we could use all the help we can get. It's still kinda tricky since it seems like for some people it seems like it happens repetitively, randomly or not at all.
 
reiten

Reiten

Well-known member
Messages
148
Points
63
I've been running the logger for the last few quizzes myself. I want to see if there is a difference is any notable difference between the case of getting the bug and still being in the list and not being in the list. And to have another set of data to compare. Being a software dev myself, I'm quite curious about this, but haven't had any luck so far.

There are a few things I'm curious about. Has anyone had the bug on a question they have answered incorrectly, or after they had an incorrect answer? I haven't encountered such a situation myself, so I'm curious if they might be doing something, like keeping a list of eligible players, and that's causing some odd slowdowns.

Without at least a general idea about how the server side operates, it would be hard to give any decent advice. Any conjunctures I can draw would probably be too general and only iritate the dev team. The only somewhat useful thing I can write is, that such sporadic bugs might be a concurrency issue, but as I said this is just a guess, and your dev team has probably already considered this.
 
Last edited:
mr-gentleman

Steven

Moderator
Staff member
Messages
498
Points
63
reiten said:
I've been running the logger for the last few quizzes myself. I want to see if there is a difference is any notable difference between the case of getting the bug and still being in the list and not being in the list. And to have another set of data to compare. Being a software dev myself, I'm quite curious about this, but haven't had any luck so far.

There are a few things I'm curious about. Has anyone had the bug on a question they have answered incorrectly, or after they had an incorrect answer? I haven't encountered such a situation myself, so I'm curious if they might be doing something, like keeping a list of eligible players, and that's causing some odd slowdowns.

Without at least a general idea about how the server side operates, it would be hard to give any decent advice. Any conjunctures I can draw would probably be too general and only iritate the dev team. The only somewhat useful thing I can write is, that such sporadic bugs might be a concurrency issue, but as I said this is just a guess, and your dev team has probably already considered this.
Click to expand...
Thank you for your insight, delayed the quiz until the weekend for some extra research. So far it seems like a tricky issue, since it only happens in like maybe under 25% of the people, maybe less, and to even fewer it is something consistent. I personally only encountered it once (not even sure if that once wasn't my lack of attention) out of tens and tens of quizzes, but some seem to get it like 3-4 times in a row, which makes me think it could also be something client related, as oldgrey noticed, sometimes it times out, so probably a network fluctuation on the client connection, even if unnoticeable, might also be the culprit imo. Let's hope we'll find the annoying bug.
 
blackscrollblindfold

BlackScrollBlindfold

New member
Messages
10
Points
3
Maybe the provisional results of my analysis of the quiz-bugs could be useful for the tech team to find what causes the bugs.

My current hypothesis is that the "real"-bug (point-loss / "500 Internal Server Error") is related to the GalaSilver-balance of the account. To be more precise: whether the account is on schedule for the hourly GalaSilver-recharge or not

The reason for this assumption is the error of the Indiegala-website on 04.10.2019 .
As long as the account was not on schedule the website worked flawlessly. It was even possible to spend some GalaSilver-coins.
But immediately after the balance droped below 240iC, resulting in the account to be on schedule, it was not possible to enter the profile-page and the giveaway-section anymore. Every try to access one of these pages only showed a "500 Internal Server Error"-page. After the nesseary amount of hourly GalaSilver-recharges took place everything worked flawlessly again.

Although the "500 Internal Server Error" is an unspecific error wich could be caused by many things i used it as starting point for further tests.

Whereas the hypothesis for the quiz was the opposite of the situation described above:

account not on schedule -> bugs may occur
account on schedule -> no bugs


The results of the tests till now are:

05.09. - 03.10. (unknown status of account-balance)
4 "visual"-bugs
4 "real"-bugs
1 "marked wrong"-bug

05.10 - 26.11. (ensure that the account is on schedule)
2 "visual"-bugs
1 "real"-bug + 1 "visual"-bug (the only quiz where the account was not on schedule)


subsumption of the tests:
  1. As long as the account is on schedule while the quiz takes place the "real"-bug ("500 Internal Server Error") never occurred since 05.10. .
  2. The "visual"-bug (delayed answer) seems to be caused by something else.
  3. The "marked wrong"-bug seems to be a combination of delayed answer and "500 Internal Server Error".

I want to emphasize that this is only a hypothesis and it could be completely wrong.
 
oldgreydonkey

PurpleVanguardPlot

Active member
Messages
84
Points
33
mr-gentleman said:
Do you happen to have any further info about such situations or about when the the answer isn't counted? The tech team is currently trying to figure it out so we could use all the help we can get. It's still kinda tricky since it seems like for some people it seems like it happens repetitively, randomly or not at all.
Click to expand...
On the last quiz I got visual only bugs due to me having a real hard time with the questions and answering in the last second a couple of times. All calls returned 200 and answers was counted. Also the ones I got wrong. But it was all a bit of a mess so I couldn't really keep track.
So I don't really have any more information to give from the client side.
reiten said:
I've been running the logger for the last few quizzes myself. I want to see if there is a difference is any notable difference between the case of getting the bug and still being in the list and not being in the list. And to have another set of data to compare. Being a software dev myself, I'm quite curious about this, but haven't had any luck so far.

There are a few things I'm curious about. Has anyone had the bug on a question they have answered incorrectly, or after they had an incorrect answer? I haven't encountered such a situation myself, so I'm curious if they might be doing something, like keeping a list of eligible players, and that's causing some odd slowdowns.

Without at least a general idea about how the server side operates, it would be hard to give any decent advice. Any conjunctures I can draw would probably be too general and only iritate the dev team. The only somewhat useful thing I can write is, that such sporadic bugs might be a concurrency issue, but as I said this is just a guess, and your dev team has probably already considered this.
Click to expand...
As Reiten says it is hard to check when you only have the client side to look at and also for me a very limited number of observations of the bug. But as I'm not afraid to give advice even when I don't know what I'm talking about, here goes:
From the limited amount of information I have we can look at the case that 500 Internal server error occurs, that we know looses you points:
  • Are there any logs on the server of this?
    I guess not as then the developers could have looked at them and seen what the problem is. If you don't have logging add it. You could also think about logging all request and responses on the client side and then sending in that log at the end of the quiz and compare that with what was recoded on the server.
  • Are there any web server logs of calls to /quiz/ua?
    Do the calls come in? What status i returned? Compare the amount of calls between questions. If there is a drop in response rate on a particular question maybe calls are not reaching the server.
  • Are you using Incapsula (guessing that from the headers) and are there any logs there?
    Could it be that it is the DDOS protection or WAF functionality that is blocking the calls?
  • Are you using any load balancers, if so are there any logs there?
    Is the load balancer handling the load and can it reach the servers?
As I don't know anything about the server side I'm just throwing ideas of what to look at.
Hopefully I haven't offended someone by stating something obvious.
 
reiten

Reiten

Well-known member
Messages
148
Points
63
oldgreydonkey said:
Are there any web server logs of calls to /quiz/ua?
Do the calls come in? What status i returned? Compare the amount of calls between questions. If there is a drop in response rate on a particular question maybe calls are not reaching the server.
Click to expand...
This is a good idea. Another thing that could be done is counting of requests and responses for each question. If it matches up for questions with bugs, then the issue is external, if not internal.
 
drannyonghermano

DrAnnyongHermano

Active member
Messages
109
Points
43
lachdanan said:
First hint is wrong, the hints of the other levels say the opposite.
Click to expand...
Hmm, to me they all seem to be suggesting no quiz today. Only the position of not and take are reversed: will not take place vs will take not place, but maybe it's been updated since you posted.
 
mr-gentleman

Steven

Moderator
Staff member
Messages
498
Points
63
Oh, the quiz will take place, but I assure you that you won't like it. This week was fairly full with all of the Black Friday Promotions, Massive Gameplay Giveaway tweaking, so no new update to the quiz system yet (just some investigations), so it might still be the wild west for some.
 
mr-gentleman

Steven

Moderator
Staff member
Messages
498
Points
63
lachdanan said:
First hint is wrong, the hints of the other levels say the opposite.
Click to expand...
That is true, I have no idea why did that hint change like that, maybe I used that placeholder at another point and forgot to change it. Good job for spotting the rest as well and being vigilant.
 
taka

tAKa

Active member
Messages
130
Points
43
#2 bug and no points..
#5 hints "fifth day" answer "endup school" what?? :unsure:
 
You must log in or register to reply here.
Top