is this project still going on?
bossmanās second link archived: https://web.archive.org/web/20110928171812/http://www.sciencedirect.com/science/article/pii/S1614000106600276 it was not free but you can see what the link is about.
what tools are available to quantify cognitive performance?
I am using quantified-mind for the last month, but I recently discovered that there are quite a few bugs in the software they are using. Plus there is no development in the background, so these bugs wont be fixed anytime soon. So I dont know whether I can trust the data.
What tests/softwares do you guys use?
What bugs are you talking about wrt quantified-mind?
alternatives:
http://www.humanbenchmark.com/
http://brainworkshop.sourceforge.net/
ā may have to adjust some parameters for more comparable scores across time
Note that with all these metrics learning will occur and scores will rise regardless of anything else going on. While there are more sophisticated techniques, looking at differences from a logarithmic curve fit to the overall data should provide some insight as to what is correlated with improved scores.
3 Likes
Thanks symian.
Couple of things
-
I started doing the standard āfinger tapping testā from the āskipping breakfastā series of tests. On my side, the test results right after the finger tapping results, dont match the test results on the final screen (100 points discrepancy). secondly on days when my finger taps increased from ~70 average to 85 average, i saw a decrease in the score (higher finger taps should correspond to higher scores). Thirdly, for 3 consecutive days my finger tapping test has remained exactly the same to the 3rd decimal place at 361.865 (I dont know how many finger taps I had, it was pretty high. But this is virtually impossible).
-
I dont see any validation of these tests. Just because somebody made these tests and works at Google doesnt mean that these tests are accurate.
-
There is no documentation of what algorithm is being used in these cases.
-
Yoni mentioned that theres nobody to develop the website further and its complicated to change it.
I realized later on based on the above, that I had jumped the gun and had just assumed the website was going to give correct measurements because its name started with āquantifiedā and kindof seemed legit.
Do you know whether any of theses tests in the websites you mentioned are validated (actually corresponds to academic research)?
If not, is it any better than any of the 100s of flash game? Just because it has a ābrainā or ācognitionā in its website name doesnt mean its actually measuring attention span or memory correctly. Like most of these websites seem very sketchy, I can make a flash website and throw out random numbers, and use a name like āquantified mindā or ābrain gamesā and it will seem very legit, as long as it looks good.
If I have to make significant decision regarding any habits I want to follow, I have to make sure that the tests are actually measuring the correct thing based on my hypothesis.
1 Like
Here are 2 softwares that I found to be more legit (being developed by neuroscientists, doesnt use marketing gimmicks)
PsyToolkit | Psychology Wiki | Fandom (http://www.psytoolkit.org/)
PEBL (software) - Wikipedia (http://pebl.sourceforge.net/)
Now I have to figure out which tests are relavant.
The quantified-mind website is much simpler with readymade tests etc, but I am just not sure how much I can trust the data.
Iāve been using the QM site for the last year & found it to be very reliable. I did notice that one bug that your talking about with the finger tapping test. He said:
He talks about using the API to download the results. Theres a REST API Yoni can give you access to with keys. Iām only using the API now to analyse the results, just makes it much easier to wrap a few scripts around it all to do analysis (Iāve been running some tests on my blog - http://myquantifiedbrain.com)
Sry for necro but I do not know of better editable resource. https://www.i3mindware.com/pricing assures users it can increase IQ. Also exists MemTrax Alzheimer test https://memtrax.com/about-us/.
Lots and lots of games and puzzles on android. For them to be good candidates as cognitive self quantification tests they must have the following features.
Enough puzzles usually through automatic generation. Puzzles should not change much in difficulty or at least include an expected difficulty for that specific puzzle. Timing of each test either by limiting time on test or just measuring how much each test took. Ideally they would export results for multivariate analysis but only quantified mind does this ever. Also nice if tests starts a bit before where it expects user to end up instead of forcing user to start from the easiest levels that are completely boring and useless.
Lumosity Brainilis Elevate and āmentalā by peoresnada. All autogenerate and have good timings. Not all start from beginning.
Logic Daily is very different but still satisfies my requirements. It only has one type of test instead of 60 as the other 4. These puzzles are generated by humans, new one daily. Score is time and āexpected timeā is included with each puzzle. TBH I do not know how good that expectation is.
Also please consider daily SET puzzles. The Daily SET Puzzle
Edit: missed Brainturk Peak Brain Training? Cambridge Brain Sciences
Guys, thanks for this information. It was really useful to me. Lumosity I found to be a great option.
1 Like
The domain did expire, but it is still running at https://quantified-mind.appspot.com/ and will continue to do so.
3 Likes
I was working on a measure of long term memory based on analyzing flashcard srs systems but have kind of given up as it seems no one is using it. Anki SRS as Congitive Test