Introduction: A Statistical Analysis Of ICO Performances
In Differing Market Conditions
These past several months, an analysis of ICO performances in the midst of varying market volatility was conducted by the data science team at Lunar Digital Assets. Intuition would probably lead a typical retail investor to believe that an ICO will perform better in bull markets as opposed to bear markets (and in stable markets which are void of any particular direction).
A SURVEY OF 288 CRYPTO INVESTORS:
At the inception of the idea for this study, we were curious to see what cryptocurrency traders and ICO investors thought regarding the performances in bull and bear markets. So we asked various networks of traders and investors a fairly simple question. The results were astoundingly favored towards bull markets, as most would expect. However, it should be pretty noteworthy that 29% of those surveyed disagreed with the majority. (29% because the 12% that voted for «Anytime» would be investing in bull markets as well.) In hindsight, we probably should have had «I don't know» added to the list of choices.
SURVEY RESULTS: WHEN'S THE BEST TIME TO BE INVESTING INTO ICOs?
- Bull Markets: 171 (59%)
- Neutral Markets: 40 (14%)
- Bear Markets: 35 (12%)
- Anytime, doesn't matter: 33 (12%)
- Never: 9 (3%)
In this analysis, we aim to bring credence to or dispel this commonplace notion using statistical analysis and hypothesis testing. We strongly believe that this study is especially helpful in the relatively young market of cryptocurrencies and initial coin offerings, whereas traditional financial markets have a much longer history and established patterns and trends. We will attempt to answer the question that everyone thinks they know, but doesn't really know: Do ICOs really—statistically—perform better in bull markets?
DATA SCRAPING, CLEANING, & EDA
DATA OVERVIEW AND EXPLORATORY ANALYSIS: FINDING RELIABLE DATA IN THIS FRAGMENTED, YOUNG MARKET CAN BE CHALLENGING.
The data for this study was acquired from Coinist, which provided a sample data size of 457 initial coin offerings. Although we are aware that there were many more ICO's conducted, we believe that 457 is an ample size to draw inferences from. Coinist was also the only data source that readily had ROI information (the figures were also spot checked for accuracy), and went as far back as 2013 up until the data the captured in May 2018 when this study was being conducted.
As basis of analysis, we will be using each coin’s Return on Investment (ROI) since the ICO Ending date as a measure for investment performance. Due to the varied nature of ROI across ICOs, I will be using a common logarithmic function (Base 10) of each coin’s ROI as reasonable means of comparison. This is especially useful as we are concerned about relative performance in different market conditions and not an associated scalar value.
CAPTURED DATA:
- Name of Coin
- 1-Hour % Change
- 24-Hour % Change
- Weekly % Change
- ICO Date (last day of token sale)
- ICO Price
- Current Price
- ICO Return on Investment (ROI)
DATA CLEANING
We did not find any major issues with the data other than one mislabeled adte for the coin APX. The ICO date was set to May 21, 1970. While cross referencing with other sources, we had determined and fixed the APX ICO date to May 21, 2017. Outliers: NXT's overall ROI of ~24,000% was an obstacle to proper comparison and analysis. Despite being a significant outlier (the next best performer was Ethereum at ~1,900%), we decided to keep this data and regularize it via a common logarithmic function for analysis.
EXPLORATORY DATA ANALYSIS
The goal of EDA is to visualize the data in different perspectives to glean additional insights for further analysis, anomaly detection, and data consistency. In this section, we will visualize the data from a high level. First, we wish to explore the pace of ICOs and visualize the rise of ICO as a means of capital funding: We see a staggering yet unsurprising increase in ICOs in 2017 followed by a decline in 2018 YTD. However, we would not be surprised to see the annual 2018 value exceed 2017’s ending tally. It should be noted that since the data was taken in May, as predicted, the number of ICOs is steadily rising.
MORE EDA: VISUALIZING WINNERS AND LOSERS
In the full article published on Lunar Digital Assets, you can visually see the ROI of ICO's categorized in different segments:
- Yearly ROI —
Our dataset captures the following years and the associated numbers of ICOs held in that year. The below violin plot provides a visual summary of statistical descriptors of the ROI performance by ICO Year - Monthly ROI —
On a monthly basis, ICOs that end in April have the best median performance but also likelier to perform the worst of any month other than December. Otherwise, there does not seem to be a significant difference in ICO performance based on Ending Month. - ROI by Market Conditions:
Another important distinction to consider when analyzing ICO ROI was whether or not the ICO occurred in a bear, bull, or purgatory market environment. Date ranges were leveraged from Thomas Lee, Head of Research at Fundstrat Global Advisors. Please also note that any date ranges not included are considered “purgatory runs” or what traders like to call «sideways markets.» - ROI per Year by Market Environment:
When taking out the year dimension of the view, the plot suggests very little difference in median ROI performance. - ROI of all ICOs in Bull, Bear, and Purgatory Markets:
The plot suggests very little difference in median ROI performance, but one very odd statistic was that bull markets see more outliers of negative performance and purgatory markets see more outliers of positive performance (likely due to NXT's ROI as the coin had its massive run-up in a purgatory market in 2013).It appears that the market conditions do not have a significant impact on the median returns of ICO's. Now we can move on to see if, on average, ICOs perform better in bull markets than in bear markets.
METHODOLOGY AND STATISTICAL ANALYSIS
MEDIANS AND AVERAGES ARE NOT THE SAME!
The primary method of analysis used to assert our assumption is a hypothesis test using a Z-Test. In order to appropriately perform the test, we require that the distribution of the data be unimodal and normally distributed. In our sampling method, the sample size must be larger than 30 and our samples be independent. We find that each market environment contains 173 ICOs during a bull market, 143 during bear markets and 142 in purgatory markets. As a result, our population and ensuing sample sizes will be greater than 30. Moreover, our population samples are assumed to be independent.
To assert our data is unimodal, an Exponential Cumulative Distribution Function was constructed. The theoretical model takes the mean and standard deviation of our ROIs and plots hypothetical data points. We compare this with the actual plot of our ROI data. In the below graph, we find that our real data is closely aligned with the ideal model and thus can be assumed to be unimodal and normally distributed. The goal of our statistical analysis and hypothesis test is to determine whether ICOs, on average, perform better (has a higher average ROI) during a bull market than in a bear market. To accomplish this, we need to construct the confidence intervals and then the hypothesis test parameters.
We begin with establishing a 95% confidence interval to provide insight on the range of differences that we can observe. Taking 100 random samples from the Bull and Bear populations, the difference in the mean is -0.159. At the 95% confidence level, the difference in Logarithmic ROI can range between -0.52 and 0.21. For our hypothesis tests, our statements will be expressed as:
- H?: μ1 — μ2 = d?
- Hα μ1 — μ2 > d?
Where μ1 is the mean bull market ROI and μ2 is the mean bear market ROI. D? will be 0 (zero) to signify the difference in the means. Our null hypothesis posits that there is no difference between bull and bear market returns while our alternative hypothesis posits that there is a positive difference. Our critical rejection region will be [1.64 to infinity]. Following a stratified sampling method, we arrive at the two population means:
- Mu1 (Bull Market): -0.19
- Mu2 (Bear Market) -0.04
The Z-Test statistic formula will be the difference in means (μ1−μ2) less D0 divided by the square root of the standard error of both the bull and bear market ROIs. We arrive at a test statistic of -0.717. This value does not fall into our critical rejection region of [1.64 to infinity] and therefore fail to reject the null hypothesis. This suggests that there is no difference between the average ROI (and by extension performance) between bull and bear markets. This assertion continues to hold true at both the 99% and 99.9% confidence levels.
We additionally tested if this holds true when we change the Alternative hypothesis from Ha:μ1−μ2>D0 to Ha:μ1−μ2≠D0 (which denotes that there is a significant difference between the average ROI in bull and bear markets). We find that at the 95%, 99% and 99.9% confidence levels we still fail to reject the null hypothesis.
SUMMARY OF FINDINGS
SURPRISE! BAD PROJECTS WILL BE BAD PROJECTS, REGARDLESS OF THE MARKET'S HEALTH.
In summary, we found there to be no statistical significance in the average ICO performance in either a bull or bear market. In fact, we find that
1) there tends to be far more performance losers than winners regardless of market environment
2) ICOs, on average, tend to underperform in both bull and bear markets (where the market is driven by incumbent coins and tokens), and
3) bull markets see more outliers of negative performers!
We can safely say that there needs to be more studies done, and there are so many more variables at play here. But those looking to raise working capital through an ICO should not focus on trying to time the market but rather focus their efforts on other aspects such as the actual product, the white paper, marketing hype, building the community, and etc.
When I assigned our research team this task, I thought that I was going to prove to the world that investing in ICOs during a bear market was a bad idea. Not only was I proven wrong, but this study has given me new epiphanies on how to further capitalize the downtrends. Since then we have embraced the philosphy of truly growing organic communities and building a strong foundation for projects. While most would think that a bear market would have negative effects on all projects, the numbers were fairly clear here, and numbers don't lie. During bull markets, I suppose there's more confirmation bias as there are many more ICO's going on, which means more headline news of X, Y, and Z coins doing 500x returns.
To all the projects that are on the sidelines waiting for the bull market to come, that is a bit concerning — ultimately, it means you have no faith in your own project. True tech and true community will overcome bear markets, as projects like Chromapolis and Cloudbric has proven.
Article Produced By
Han Yoon
Lunar Marketing
David Http://markethive.com/david-ogden
