The next scheduled notification in the app

It is great that in the app a participant can see the next notification scheduled (to complete the next survey). However, when someone participates in more studies, this option might not show the first scheduled notification across all studies.
Maybe, however, this issue is a notification problem. I have tested study 913, participant 13515, survey 4716. A notification was scheduled (see activity sessions) april 1, 10:11. This scheduled notification was beforehand not visible in the app as the next notification, and indeed it did not occur.

Hi Jan,

Thanks for your feedback.

Would you please specify these?

  1. When did you expect that missing notification to be scheduled at?
  2. Since you have defined 2 notifications for your triggering logics, would you please specify which one we’re talking about? By “This scheduled notification” and “the next notification” you meant those two notification you defined and you expected both of them show up?

Best regards,
Mojtaba

Dear Moitaba,
The answer is that none of the scheduled notifications showed up at my phone. I have attached the list of expected scheduled notifications from activity sessions .

.
Some remarks that may help finding the issue:
-This is my own (samsung) phone I use for testing; we experieced this same problem for participants in another licensed study (1018) that is currently running. We have already lost valuable assessment days for at least one subject.
-see participants audit logs for 13515 (my phone). I have tried upload studies from server many times, no effects
-There is nothing wrong with the settings on the phone, scheduled notifications from a second study do work.
-It is unlikely that there is something wrong with the uploaded json; the same notifications are used in another study, and, as the attached file showed, the notifications are visible in activity sessions.
regards
Jan

Dear Jan,

Thanks for the details.
We’re extremely sorry for the problem you’ve been facing with our app.
Just wanted to let you know that we found where this issue originates from and we’re working on it as a high-priority task. I’ll update you when it’s fixed, hopefully soon.

Best regards,
Mojtaba

Hi Mojtaba,
Since your message is already 9 days ago, can you please update me on the status of this bug, We are still waiting for a solution.
regards
Jan

Hi Jan,

Sorry for the delay.
We’re going to roll out an update on our app today. Please check when it’s available and let me know if the issue still exists.

Best regards,
Mojtaba

Hi @janhoutveen

The new update is rolled out and should resolve this issue.

Thank you,
Mohammad

Hi Mohammad and Mojtaba,

I am afraid the problem still exists. I have installed version 441 of the app on my samsung phone. I am testing it as subject 13515. Two studies are active: 1630 and 913. However, when I looked in the app in settings-notifications (Instellingen-Meldingen in Dutch) at 12:40, I only saw the next scheduled notification for study 1630 (april 23, 8:00 pm), and not the next scheduled notification for study 913 (today april 21, 12:51; see the uploaded screenshot).


This notification scheduled at 12:51 today for study 913 indeed did not happen, just as all other scheduled notifications for study 913.
regards
Jan

Hi @janhoutveen

The notifications problem seems to be related to the questions used in the criteria not being persisted properly in our server. Ethica detects when a question from Survey A is used in criteria in Survey B and makes sure the responses to Survey A are available when presenting Survey B. But this requires Survey A to be published first, and then Survey B. There have been some cases when a study publishes Survey B first (that uses the criteria) and then Survey A (that defines the questions in the criteria). In these cases, the server cannot properly persist the questions.

There has been a report already on this and we’re right now working to fix this issue in the dashboard and make sure it’s not happening in the future.

There is a workaround for this issue. You can publish all activities of study 913 again (by making small changes to it, like adding something to the survey description) and after that reload your study on the mobile app.

Please let me know the result.

Best regards
Farbod

Hi Farbot,
I have changed something in survey A and published it again, and I have performed a reload studies from server afterwards. This, however, did not result in that the next scheduled notification was visible (as next notification) on the phone.
Then I have changed something in all 3 survey B’s and published them again as well, and then another reload studies from server on the phone. This, however, did not result in that the next scheduled notification was visible (as next notification) on the phone either.
Don’t you think that the problem is related to that another study that is using criteria is active on the phone as well?
regards
Jan

I logged in to the Android app using your account. As you can see in the attached image, the app showed me the next scheduled session was at 2021-04-26 20:13:19+00 (10:13 Amsterdam local time), which is related to study 913.

I also checked the reported logs, which showed the following:

Alarm set for: 
    Activity #4716 Session ID #58497abc-4dbc-4c3a-a91f-1704ab432f3a at 2021-04-26 22:13:19.000+0200
    Activity #4716 Session ID #58497abc-4dbc-4c3a-a91f-1704ab432f3a at 2021-04-26 22:28:19.000+0200
    Activity #4716 Session ID #a55cad92-9cbb-40ce-8094-851ef69f9b51 at 2021-04-27 09:50:01.000+0200
    Activity #4716 Session ID #a55cad92-9cbb-40ce-8094-851ef69f9b51 at 2021-04-27 10:05:01.000+0200
    Activity #4716 Session ID #698b61e8-fb58-4e28-ba00-e643f515e98d at 2021-04-27 13:12:47.000+0200
    Activity #4716 Session ID #698b61e8-fb58-4e28-ba00-e643f515e98d at 2021-04-27 13:27:47.000+0200
    Activity #4716 Session ID #5c90f432-8bfa-416c-ba98-20e1c7e2a556 at 2021-04-27 16:08:01.000+0200
    Activity #4716 Session ID #5c90f432-8bfa-416c-ba98-20e1c7e2a556 at 2021-04-27 16:23:01.000+0200
    Activity #4716 Session ID #c6524c13-6042-4ca4-ac16-5a730b24cd94 at 2021-04-27 18:46:14.000+0200
    Activity #4716 Session ID #c6524c13-6042-4ca4-ac16-5a730b24cd94 at 2021-04-27 19:01:14.000+0200
    Activity #4716 Session ID #80744c26-704c-42b5-9162-c87cca5fc127 at 2021-04-27 22:07:42.000+0200
    Activity #4716 Session ID #80744c26-704c-42b5-9162-c87cca5fc127 at 2021-04-27 22:22:42.000+0200
    Activity #4716 Session ID #209b120e-b448-497d-ba71-42597bc0b07a at 2021-04-28 09:48:15.000+0200
    Activity #4716 Session ID #209b120e-b448-497d-ba71-42597bc0b07a at 2021-04-28 10:03:15.000+0200
    Activity #4716 Session ID #75bdfda3-4cb5-4bad-887d-31cb684282cc at 2021-04-28 12:45:37.000+0200. Total of: 15

And this matches the top next 8 sessions:

                 uuid                 |     scheduled time     | activity id
--------------------------------------+------------------------+-------------
 58497abc-4dbc-4c3a-a91f-1704ab432f3a | 2021-04-26 22:13:19+02 |        4716
 a55cad92-9cbb-40ce-8094-851ef69f9b51 | 2021-04-27 09:50:01+02 |        4716
 698b61e8-fb58-4e28-ba00-e643f515e98d | 2021-04-27 13:12:47+02 |        4716
 5c90f432-8bfa-416c-ba98-20e1c7e2a556 | 2021-04-27 16:08:01+02 |        4716
 c6524c13-6042-4ca4-ac16-5a730b24cd94 | 2021-04-27 18:46:14+02 |        4716
 80744c26-704c-42b5-9162-c87cca5fc127 | 2021-04-27 22:07:42+02 |        4716
 209b120e-b448-497d-ba71-42597bc0b07a | 2021-04-28 09:48:15+02 |        4716
 75bdfda3-4cb5-4bad-887d-31cb684282cc | 2021-04-28 12:45:37+02 |        4716

Can you please test it one more time, maybe with a new account, and let me know if you still see any problem?

If you do, please send me the screenshot of the app, something similar to what I attached here, that shows the time of the phone and the time of the next scheduled survey, and I will certainly check further.

Best regards
Farbod

Hi Farbot,
No problem, I have made a few screenshots on my app: the two studies that are active on this phone, and the next notification that is scheduled (ie for study PROfeel QVS dieet). None of the notifications of the second study EBBB work.
I can make a new account testing EBBS, however, our problem (which we are now experiencing with an ongoing study in the field) is when two studies are active for the same participant.
regards
Jan

Hi @janhoutveen

I’ve checked your reported logs and based on that all of your activities in study 913 were disabled (their criteria was evaluated as False), and because of that, no notification was scheduled in the app. Also, participating in several studies has no effect on evaluating the criteria for each activity.

Can you please reinstall (uninstall and install again) the app and test it again, then I can check your reported logs again.

Thank you for your cooperation

Best regards
Farbod

Hi Farbot,
I have logged out, then uninstalled and re-installed Ethica, and then I logged in again.
That solved the problem! For the first time the scheduled notifications for study 913 work on this phone.
Lets hope the other study still works as well; I will know that this Friday.
Do we have to instruct our participants with this problem to uninstall and reinstall ?
Thanks
Jan

Hi @janhoutveen

As I said before in rare situations there is an issue with the persistency of activity responses and it only affects the criteria evaluation and we’re right now working to fix this issue in the dashboard and make sure it’s not happening in the future.

Already for the participants with this issue, reinstalling the app should fix the issue and the new participants will not encounter this issue (because they install the app for the first time).

Best regards
Farbod