Zeo shutting down: export your data!

Quantified Self Sleep
13

Few questions from a newbe (from Holland); is there a alternative to myzeo because it is shut down? The Eric Blue’s neurosky-brainwave-visualizer seem to me not work with existing data.
Another question I also think every wants to know, a good alternative for the headband when they do not work any more.

Oh, after searching the net I have found a link for a DIY replacement headband. I will post it here: http://www.instructables.com/id/DIY-Replacement-Zeo-Sleep-Monitor-Headband-Sensor/

14

Hi everyone I am new to this forum. Please can anyone help me. I have severe sleep problems which started a few months ago which have stopped me sleeping for several weeks.
My doctor has given me sleeping pills but I now have a fear of going to bed knowing I will be awake all night. I have managed to buy a Zeo Mobile new from Usa Ebay I paid nearly £160 for postage and import duties. I needed the zeo to give me some reassurance that I was having some sleep however little and give me something I could monitor.
But when I connected everything up synced my I phone and started the zeo program the program said my head band firmware needed updating. As Zeo no longer exists It has been impossible for me to get it going. Please could anyone help me to get the firmware in the headband. I think I need another program to get the firmware in.
Kind Regards.
Sid

15

I’ve thought alot about this today, in particular. I’ll save you the various efforts and leave you with my current best-bet. On the iPhone (I realize this may not help all smartphone users), click help->diagnostics->send diagnostic information, then delete customersupport@myzeo.com and type in your own email.

When you get your sqllite file, you can open it with (you guessed it) sql lite.

I have a variety of challenges down to how to convert the datetimes, and the data since the servers went down seems to be partly encoded in a blob.
p.s.
There’s a file above in this thread for the zeo data decoder library, and the documentation inside has a lot of good info that I’m guessing as of now is more or less directly compatible with the above mentioned fields, I’ll check tonight but my guess is that the numbers I was thinking were seconds could be counts of 30 second epochs. I’ll clarify this more if and when I can correlate the various fields to the doucmentation.

I also don’t mean to imply that these files will ever work with the sd or web api utilities. My goal is more to be able to retrieve and use the data myself.

I have yet to determine if it’s easier to guestimate the missing fields (risetime for example), or try to parse the blob.

I will continue to look to see if someone else has already done this to avoid having to do it myself, but at least this seems to answer the question how to get the data off the smartphone.

I do find it nice that it provides the 5 minute state data.

zsleepgraph, and zbasehypnogram in particular.

zbasehynogram starts off 00000000000000000022211222221111…

I am a little bothered that I can’t quite correlate that to the image I see in the app. So if anyone can volunteer what the differerent numbers mean it’ll help.

Those two fields alone are probably what most people want. Those and the summary columns that deal with time in each mode of sleep.

I dabbled with select datetime(zbedtime ,‘unixepoch’,‘utc’) from zzosleeprecord and it gives me the best date time so far, so last night it says 1982-06-04 05:14:32

I’m assuming the year is just not specified, so I will add an offset to bring that up to 2013, and the 5:14am adjusted for PST sounds about right, again close enough for me.

The only other thing I’m leaning towards right now is timeinrem/60 gives me 3.65, but in the app it says 3:39, so I guess that’s 65 100ths, thats the same way the timeclock at work does it so I guess it’s not that uncommon, so I’ll have to adjust for that too

Not sure this helps anyone, but I thought I’d throw this into the ether.

P.S.
There’s a link above to Zeo Data Decoder Library and the documentation in that file has a section 3.2 Sleep Information which I’m hopeful will help me make more sense of the data, and I will follow up to this after a day or two (I just found this thread today).
If I get sidetracked indefinitely it looks like there’s a lot of good data in there that may (or may not) be the same as what’s in the sql lite data.
I also don’t mean to imply that any of this will make your iphone bluetooth data compatible with the sd card utilities. My objective is more to get it into either excel or access where I can continue to ferret away my sleep data, and hopefully produce some kind of meaningful report of trends over time.

16

Guys, you have lost me. I just wanted to have access to my stored data/records, and make sure I have the software updated. This all exceeds my ability to keep up with you.

Thank you anyway.

17

I did not get my data downloaded. I am using Zeo per the request of my doctor, but now I can’t get to my data.

I have downloaded the library files. In the instructions, it says

2.1.2 Compiling from Source
The Java JDK must be installed in order to compile the source code.
Run Ant to compile the source.

I have installed JAVA but I don’t know what Run Ant means. (I am not a programmer):shy:

Can someone help me?

18

[quote=“wparish, post:15, topic:561”]
…zsleepgraph, and zbasehypnogram in particular.

zbasehynogram starts off 00000000000000000022211222221111…

I am a little bothered that I can’t quite correlate that to the image I see in the app. So if anyone can volunteer what the differerent numbers mean it’ll help.
…[/quote]

I think I have the zsleepgraph worked out, from last night this pretty much matches my iphone graph:
000
2 rem
3 light
1 wake
3333 light
4 deep
333333 light
22222 rem
3333 light
44 deep
3 light
44444 deep
3 light
222222222222222 rem
3333 light
444 deep
3333333 light
222222222 rem
33333 light
222222222 rem
33 light
222 rem
1 wake
0

The longer version is just more granuar. I still have to work out how I want to visualize that. But honestly I may not put a whole lot of effort into it from here as I think I have the main thing I wanted.

The other numbers in the database, contrary the the document for the sd card, don’t appear to be epochs. I can pretty much divide the number by 60, then take the remainder, and multiply that by 60, and then mash the two together (rounded off) and get the same time I see on the iphone summary.

So I have all the data I need. It looks like the easiest thing to do for me is to work out java program to convert it into something I can just import into excel. But if anyone else comes up with a utility or way to visualze the output I would like to know.

I apologize to the people who are put off by this technical babble. I realize it’d be nice to have a simple process, but the app seems to be built around their domain, and without access to that there will always be a manual process to work around that (unless someone buys the company and restores the online services).

It also appears to me that there would be two separate processes based on whether you had the sd card version or the mobile version. Which further complicates things. I suppose the charitable explanation is that Zeo never expected to fail.

19

Hi all,

We used the Zeo’s for research last year, and now wanted to use them again and thus recently realized we have a serious problem with reading the data.
Can we still use the solution to upgrade the firmware? And if so, how do we do that? (sorry if that’s a silly question) If it’s via the website then I guess we’re screwed.

Cheers

20

For all who are interested (the first step especially for @LiesN). I just bought the ZEO bedside and also facing the problem, how to export the data and read it and create usable charts of it. I am not ready but I am on the right path I assume so I will share my findings :slight_smile:

First udate firmware (ZEO-firmware-v2.6.3O.zip, read post #6 in this thread). That is easy, unzip file and place zeo.img on the SD card in the ZEO folder. Then klik Settings button, go to software, change it, et cetera.

Next, with the ZeoDataDecoder.zip (also read post #6) now you should be able to create a CSV file from the ZEOSLEEP.DAT file because with the new firmware you have an unencrypted ZEOSLEEP.DAT file. How excatly this is done I am busy to find out.

Then… with the programming language “Processing” ( http://www.processing.org/ ) and the zeo library ZeoLibrary-5.zip ( http://code.google.com/p/zeolibrary/) it should be possible to create from the CSV a nice graph. I am not sure how but I am busy trying :slight_smile:

To be continued…

21

The ZEO Data Decoder Library Documentation describes what the data for the Bedside unit records. I assume it is the same as the Mobile version.

base_hypnogram
Records the sleep stages on a 30 second time scale. The base_hypnogram tag contains a space-separated list of numbers. The first element represents the time period starting at the time specified in the hypnogram_start time tag and ending 30 seconds later. The sleep stages are encoded as integers according to the following mapping: (deep and deep_2 both represent deep sleep)
0. undefined

  1. wake
  2. REM
  3. light
  4. deep
  5. (not used)
  6. deep_2
    display_hypnogram
    Records the sleep stages on a 5 minute time scale. The display_hypnogram tag contains a space separated list of numbers. The first element represents the time period starting at the time specified in the hypnogram_start time tag and ending 5 minutes later. The sleep stages are encoded as integers according to the following mapping:
  7. undefined
  8. wake
  9. REM
  10. light
  11. deep

I hope this helps.

As to the display of data, I pulled the CSV data into excel. Put time in first column, Sleep number in Second column and then set up columns for Awake, REM, Light, and Deep.
To make the graph look like the ZEO plots I reversed the numbers (although I could reverse the Y axis scale on the excel chart to fit the numbers correctly).
To populate the cells under those columns I referenced the sleep number column and for awake put =IF(B2=1,4,"") {since I used 4 for awake not 1}, REM =IF(B2=2,3,""), Light =IF(B2=3,2,""), Deep =IF(B2=4,1,""). The result is filling each of these columns with blanks or the number I used for that state when I was in that state. Then I put together a clustered column chart for each of the four columns and matched the column colors to what ZEO had used. I also adjusted the column width to fill the full time interval. TIme was my x axis.
All of the effort was to see if I could reasonably duplicate the daily web display. I was satisfied with the results, but the process needs to be automated to make this approach practical.

Enjoy

22

I have a Zeo bed side that I just bought 3 weeks ago. I was able to down load and print out one week of data before the site went down. Is there any way to get the information out of my SD card with out the site being up any more. I thought that Dan’s firmware and data decoder might help but my computer does not know how to open either of those links. Pardon me if someone has already answered this question but not being tech savy I am having trouble understanding some of the above posts

23

@Steve222, it is not that easy, I admit. I am also busy getting data from the Zeo bedside to my pc. You can start reading my post above here (#22).
First, you need update firmware so your Zeo bedside can export data unencrypted, and then you can change the data to human readable text for the import in Excel. It is explained in post #6 and #10 from this thread.

24

Hello,
I’m new here. I went to get my data tonight and found myzeo.com was for sale at godaddy! So I didn’t get my data…

I googled and found this great community. I’ve been reading through the posts and have found the hidden directory on my android in Android/data/com.myzero.android but the only thing I found in there was a tmp folder with a jpg of the recent night’s sleep.

The app on the android has quite a bit of the history still showing, so I’m thinking the data (sqllite?) has to be in there somewhere. I would like to be able to just copy that data off of the device for now and then look at parsing it.

I would appreciate any advice on where to get the data and apologize in advance if I missed the instructions.

much thanks,
joseph

25

Unfortunately I don’t have a Zeo… Ant is a Java build automation tool. You can download it from https://ant.apache.org/. Please do share your success.

26

Have you something like this:
Sleep Date,ZQ,Total Z,Time to Z,Time in Wake,Time in REM,Time in Light,Time in Deep,Awakenings,Start of Night,End of Night,Rise Time,Alarm Reason,Snooze Time,Wake Tone,Wake Window,Alarm Type,First Alarm Ring,Last Alarm Ring,First Snooze Time,Last Snooze Time,Set Alarm Time,Morning Feel,Day Feel 1,Day Feel 2,Day Feel 3,Notes,SS Fall Asleep,SS Anticipation,SS Tension,SS Comfort,SS Noise,SS Light,SS Temperature,SS Familiar,SS Bedroom,SS Disruption,SS Hot Flashes,SS Dreams,SS Fullness,SS Hunger,SS Heartburn,SS Caffeine,SS Alcohol,SS Thirst,SS Restroom,SS Wind Down,SS Sleepiness,SS Exercise,SS Time Before Bed,SS Conversations,SS Activity Level,SS Late Work,SSCF 1,SSCF 2,SSCF 3,SSCF 4,SSCF 5,SSCF 6,SSCF 7,SSCF 8,SSCF 9,SSCF 10,SSCF 11,SSCF 12,SSCF 13,SSCF 14,SSCF 15,SSCF 16,SSCF 17,SSCF 18,SSCF 19,SSCF 20,SSCF 21,Sleep Graph,Detailed Sleep Graph,Firmware Version,MyZeo Version

I used these data when I could download this but now I can’t anymore. I don’t have, like you, “help” and in my “diagnostics” I can’t change something…For “connected” it is written “No, since 11/06/2013 à 11h:49”! If only I could change that!

27

Perfect @OP Engr! It helped me enormous. I will explain how I used your information, I hope it will be some use for other readers :wink:

With the unencrypted zeosleep.dat file from my zeo bedside I used “java -jar ZeoDataDecoder.jar zeosleep.dat zeosleep.txt” to create a readable .xml file of it.

Then I opened the xml file in Notepad++ and copied everything between <display_hypnogram> and </display_hypnogram> to a empty Notepad++ file.

Then I got a long line of numbers, like 1 1 3 3 3 3 3 3 3 3 3 etc. and I created a small macro in Notepad++ which removed the space and placed a comma.

I saved it as a csv file so I could import it in Excel (finally!)

Because of your knowledge I knew every digit is a 5 minute timespan.
I placed the info a little bit different in the excel file, on the first row I have the time of the night:
22:00 22:05 22:10 22:15 etc. till 09:00
Every 5 minutes is a column. I could paste under the time row the 1,1,3,3,3,3,3 string on the right place (with use of the hypnogram_start_time from the xml file).

Then at last, creating a graph of it.
Still not ideal but I can do something with it!

28

I’m not sure why myzeo.com shows up on Go Daddy, but if anybody would like to help organize an attempt to purchase it for the benefit of the QS community, I will help. I unfortunately don’t have time to lead on this, but if there is a person in this forum who would like to work on it, I’ll happily rally support, offer some admin/hosting infrastructure, or think about other ways to help.

29

I didn’t see this link above, is it already in the thread? Zeo firmware and backup of API data:

http://www.openyou.org/2013/06/11/zeo-firmware-and-raw-data-api-on-github/

30

Gary,
I’m willing to help with securing myzeo.com. Do we have a zeo contact to see about getting the database to put back up?
thanks,
joseph

31

I’ve reached out to Ben Rubin, one of the founders and a long time QS contributor to ask for a pointer if he has one. He’s been out of the company for a while, but may know.

32

To all, I’ve created (with a lot of help, because I am not an Excel guru) an Excel file (one workbook with a Graph and Data sheet) which you can use to import *) the unencrypted data from zeosleep.txt **) in the Data sheet under the right date and time.
Then at the Graphic sheet you can see the graphic of your sleep (drop down box to choose different day). Please look at my example data. Enjoy!

*) open zeosleep.txt with e.g. notepad++, copy only the digits between <display_hypnogram> and </display_hypnogram> to a new txt file (e.g. 120613-2340.txt) and in the Excel workbook on the Data sheet set your cursor on the right date and starttime and choose Data tab, From Text, et cetera). -> when someone knows a better solution, please tell!

**) zeosleep.dat converted to zeosleep.txt with the ZeoDataDecoder.jar (run this command: java -jar ZeoDataDecoder.jar zeosleep.dat zeosleep.txt)

Oh, I live in the Netherlands and I have a Dutch version of Excel 2010. I don’t know if that is a problem (formulas?), otherwise please report.

Zeo data graphic with dynamic list.zip (20.0 KB)