Why Excel won’t be enough?
In the previous article I explained what is quantitative trading about. In this article I will briefly describe how to start your own research. As I wrote last time, I’m writing about my path and my approach, which may not suit everyone. So take this article as an inspiration.
Quantitative trading has the great advantage that you don’t have to buy expensive software. All the necessary tools are available for free as open source software. This is offset by the fact that instead of money you have to invest considerable amount of your time. it can be an advantage for students who typically have more time and a less money.
You’ll need to learn a scripting language (Python or Bash), a compiled programming language for the calculations (C/C++) and tool for mass plotting (matplotlib or gnuplot). It will be also very advantageous to switch to Linux, which is much more suitable for calculations and work with data than Windows. If you were expecting me to reveal some marvelous shortcut, I have to disappoint you. No such thing as “quantitative trading quickly and easily” exists. That doesn’t mean you won’t see partial results sooner. Even if you don’t know how to code, after few weeks of intensive study, you can have first results of your experiments with real market data. Quantitative trading is a never ending journey. But this is what I found personally appealing. It’s not something you just learn and you’re done. You have to constantly work on developing your skills and knowledge. I’m constantly tracking scientific developments in the field of machine learning and deep learning methods, which I then take into account in development of my own algorithms.
Some people with whom I’ve talked about this argued that learning to code is useless today – calculations and data processing can be comfortably done in Excel. Excel or Openoffice is great for quick data analysis, but your options with Excel are very limited. I always give one of my own tools as an example. The tool searches for trading opportunities in futures markets, depending on seasonality and relative contango. It works in such a way that I just execute the main Bash script, which calls a subscript that connects to a remote server and automatically downloads current market data for all futures. Another script then sorts the data and corrects any errors. The main script then calls a C program that performs a simulation of outcomes of all the historic trades depending on seasonality and contango for all futures few decades back. The program also contains my own numerical method, which creates a simple probabilistic model for each future contract and verify its compliance with reality. Comparing all these models together, my program then recommends specific futures contracts, where there is a high probability of significant move up or down till the expiration. These results are used to automatically generate tens to hundreds of charts using gnuplot plotting pipeline. The main script eventually creates a source file for typesetting and typographical system LaTeX, which groups the charts by commodity and generates a few tens of PDF files that I can finally view.
Do not try to understand everything in the previous paragraph. I’ve described it so that you can have an idea how complex operations must be undertaken. At the beginning is a huge amount of confusing data and at the end is the folder with sleek pdf documents. I don’t want to speculate how long would it take you to handle something like this in Excel, but I guess that would be a couple of weeks. Do you know how much it takes my script? Few minutes! The difference is enormous. That is also the answer to the question in the title. The ability to write your own scripts and programs isn’t about time saving. It’s about being capable to do things that won’t be even possible in Excel. It opens you completely new possibilities.
The analytical tool for seasonality and contango described above is already quite advanced. I created it last year. I started with much simpler things many years ago. The same path awaits those of you who embark on a way of quantitative trading. So don’t feel discouraged, if you found some of my descriptions complicated. At the end I attached a screenshot of one of the pdfs generated by my tool as described in this article (just for illustration).