Cool initiative! I’ve just signed up.
From the site:
At the end of each day you will fill out a short survey with a few questions evaluating the effects of the pills.
Do you expect the survey questions to be sufficient, vs., say, a Quantified Mind cognitive test? The site is well-suited for this type of experimentation.
What nootropics/supplements do you want to try this with?
Modafinil, as long as you manage to guarantee users will stay legally safe.
How long of an experiment would you want to do on yourself before being satisfied with the results?
It depends on the supplement, but I think at least month, and at most six months (see the Gotu Kola supplementation, which allegedly kicks in only after 6 months).
Would you be interested in tracking other things like exercise, diet, or meditation (obviously they would not be blinded, just tracked)?
Yes. There have been a number of apps mentioned on the forum that aim to track multiple variables.
Related: a Duke University study showed that Costly Placebo Works Better Than Cheap One.