Testing real-time forecasting systems - page 36

 

Hmmm, too lazy to translate to MT for clarity, but it seems to be working, I mean, it has rallied strongly (from 12:00 MSC), it has already gone over the upper limit, but it should come back



I would have to convert this model to MT anyway (and the others wouldn't hurt :o/), it's not very convenient.


to Figar0

Рынок не может себе такую роскошь как быть всегда прогнозируемым, но для нас грустно не это, а то, что эти непрогнозируемые участки обычно наиболее волатильны...

Not really, volatile areas can be well predicted and vice versa - a lot depends on the model used. Also, the concept of volatility is very vague. I define it as aspiration to the maximum, {max(y)-min(y)}->max and in this sense the trend can only be in a volatile market

Of course the drawings are good but does anybody have any trading (auto, manual or tester) following their prognosis that they would not mind showing? How do you do it?

The idea of the theme was different - the focus is on models and forecasts, not accounts. I don't think it worked here, but I've seen it in the next thread :o). Yes, it is clear that the forecast should eventually give instructions on how to manage the order. That will be the next stage. Take your time - everything will be there, you will see :o)

 

Oh man, by the time you calculate, by the time you post it, time will have passed. 24 hour forecast refinement (15 minute countdown) from now, or rather from now minus twenty minutes.



The level of 1.5 is unlikely, but it's coming, let's see... Some strong activity ...

 
grasn писал(а) >>

not really, volatile areas can be well predicted and exactly the opposite - very much depends on the model used. Also, the concept of volatility is very vague. I define it as aspiration to the maximum, {max(y)-min(y)}->max and in this sense a trend can only be in a volatile market

You're probably right, if we call things by their proper names, I meant just sharp strong movements...

grasn wrote >>

The idea of the topic was different - the focus was on models and the forecast itself, not the accounts. It didn't come out here, but there's a lot of it in the next thread :o). Yes, it is clear that eventually the forecast should give instructions of order management. That will be the next stage. Take your time and you will see.)

I've understood the idea of the subject, it's just how else to evaluate forecasts quantitatively). I've got the Expert Advisor, ran it in the Strategy Tester and now I understand the price of forecasts. In my case it's vice versa, I don't have any pictures and just a few figures used by the Expert Advisor in trading. I wanted to transform it into images too, but I couldn't use them except for this branch; that's why I gave up. I've got a lot of nice images here, it won't work for me, the principle of forecasting is somewhat different. I do not have "dogma", the forecast will be redrawn all the time...

 
Figar0 >> :

You're probably right, if you call things by their proper names, I meant just sudden strong movements...

I have three models in operation. One of them can theoretically see big gaps.

I got the idea of the topic, just how else to quantify the forecasts?) I have made some Expert Advisor, ran it in the tester and understood the price of forecasts. I wanted to change it to images too, but cannot find any use for it other than in this branch. I've got a lot of nice images here, it won't work for me, the principle of forecasting is somewhat different. My forecast is not a "dogma", it will be redrawn all the time...

I don't think that it's a dogma, it will be constantly re-drawn. You can only check it by testing trades on history and "pilot" exploitation, which is called "classic". There is no other way, you're absolutely right. I personally have two stages:


1. testing in MathCAD (prediction and trade on every bar)

2. testing in MT (but it's still necessary to translate the system under MT, and it's not so easy)


The matter is that I am not able to create fully automatic system (roughly speaking - machine) yet, so point 1. In MathCAD I evaluate deals by their worst variant (Open/Close, but it does not matter, the number of target points is large). I'm preparing to next iteration (gathering statistics and testing). But the biggest problem is calculation time - very long. There is a lot to solve, several problems need to be solved, including increasing resolution and clarifying pivot zones (just for the order)


Besides, it is useful to keep yourself busy by publishing and testing forecasts in real time. It's also very useful to communicate during testing, gpwr for example is a very useful tool.

 
Figar0 >> :

Pictures are good of course, but does anyone do any trading (auto, manual or tester) on their forecasts that they are not "sorry" to show? How do you do it?

First of all, as you said yourself, it is impossible to predict everything 100%. Secondly, long-term forecasts are less accurate. That's why I prefer to distill my predictor on every bar to allow new information to refine the forecast. Here's what my predictor showed before the EURUSD spike, for example:


If a SELL SHORT trade had opened on the previous prediction, it would have closed with a small loss before the jump on the changed prediction.

And here is the new prediction:


I will try to code this prediction as a trading system.

 
This is a quick scribble. But I still need to work on the details. The expert is still raw.
Strategy Tester Report
Alpari-Demo (Build 225)

Symbol EURUSD (Euro vs US Dollar)
Period 1 Hour (H1) 2009.08.03 00:00 - 2009.09.07 23:00 (2009.08.01 - 2009.09.08)
Model Every tick (the most accurate method based on all available timeframes)



Bars in test 1621 Ticks modelled 1279304 Modelling quality 90.00%
Mismatched charts errors 33




Initial deposit 10000.00



Total net profit 76178.31 Gross profit 89070.23 Gross loss -12891.92
Profit factor 6.91 Expected payoff 3047.13

Absolute drawdown 6181.00 Maximal drawdown 32316.98 (39.31%) Relative drawdown 68.48% (8298.50)

Total trades 25 Short positions (won %) 15 (73.33%) Long positions (won %) 10 (80.00%)

Profit trades (% of total) 19 (76.00%) Loss trades (% of total) 6 (24.00%)
Largest profit trade 23823.86 loss trade -3998.40
Average profit trade 4687.91 loss trade -2148.65
Maximum consecutive wins (profit in money) 9 (70323.59) consecutive losses (loss in money) 1 (-3998.40)
Maximal consecutive profit (count of wins) 70323.59 (9) consecutive loss (count of losses) -3998.40 (1)
Average consecutive wins 3 consecutive losses 1

# Time Type Order Size Price S / L T / P Profit Balance
1 2009.08.03 00:00 sell 1 3.50 1.42683 0.00000 0.00000
2 2009.08.05 09:00 close 1 3.50 1.43823 0.00000 0.00000 -3998.40 6001.60
3 2009.08.05 20:00 sell 2 2.08 1.44237 0.00000 0.00000
4 2009.08.06 03:00 close 2 2.08 1.44122 0.00000 0.00000 231.71 6233.31
5 2009.08.06 13:00 buy 3 2.16 1.43816 0.00000 0.00000
6 2009.08.07 04:00 close 3 2.16 1.43514 0.00000 0.00000 -653.83 5579.48
7 2009.08.07 04:00 sell 4 1.94 1.43514 0.00000 0.00000
8 2009.08.07 20:00 close 4 1.94 1.41846 0.00000 0.00000 3235.92 8815.40
9 2009.08.07 20:00 buy 5 3.10 1.41846 0.00000 0.00000
10 2009.08.12 21:00 close 5 3.10 1.42100 0.00000 0.00000 780.89 9596.29
11 2009.08.12 21:00 sell 6 3.37 1.42100 0.00000 0.00000
12 2009.08.13 02:00 close 6 3.37 1.42171 0.00000 0.00000 -251.40 9344.89
13 2009.08.13 02:00 buy 7 3.28 1.42171 0.00000 0.00000
14 2009.08.13 15:00 close 7 3.28 1.43016 0.00000 0.00000 2771.60 12116.49
15 2009.08.13 15:00 sell 8 4.23 1.43016 0.00000 0.00000
16 2009.08.14 20:00 close 8 4.23 1.41940 0.00000 0.00000 4546.40 16662.89
17 2009.08.14 20:00 buy 9 5.86 1.41940 0.00000 0.00000
18 2009.08.18 09:00 close 9 5.86 1.41287 0.00000 0.00000 -3834.78 12828.11
19 2009.08.18 09:00 sell 10 4.53 1.41287 0.00000 0.00000
20 2009.08.18 14:00 close 10 4.53 1.41069 0.00000 0.00000 987.54 13815.65
21 2009.08.18 15:00 buy 11 4.90 1.40820 0.00000 0.00000
22 2009.08.18 18:00 close 11 4.90 1.41266 0.00000 0.00000 2185.40 16001.05
23 2009.08.18 18:00 sell 12 5.66 1.41266 0.00000 0.00000
24 2009.08.19 08:00 close 12 5.66 1.41186 0.00000 0.00000 446.01 16447.06
25 2009.08.19 09:00 buy 13 5.83 1.41042 0.00000 0.00000
26 2009.08.19 16:00 close 13 5.83 1.41484 0.00000 0.00000 2576.86 19023.92
27 2009.08.19 18:00 sell 14 6.66 1.42614 0.00000 0.00000
28 2009.08.25 23:00 close 14 6.66 1.42971 0.00000 0.00000 -2425.57 16598.34
29 2009.08.26 08:00 sell 15 5.79 1.43151 0.00000 0.00000
30 2009.08.26 13:00 close 15 5.79 1.42981 0.00000 0.00000 984.30 17582.64
31 2009.08.26 16:00 sell 16 6.18 1.42162 0.00000 0.00000
32 2009.08.27 06:00 close 16 6.18 1.42438 0.00000 0.00000 -1727.93 15854.72
33 2009.08.27 06:00 buy 17 5.56 1.42438 0.00000 0.00000
34 2009.08.28 00:00 close 17 5.56 1.43481 0.00000 0.00000 5795.19 21649.90
35 2009.08.28 02:00 sell 18 7.53 1.43692 0.00000 0.00000
36 2009.08.28 09:00 close 18 7.53 1.43304 0.00000 0.00000 2921.64 24571.54
37 2009.08.28 09:00 buy 19 8.57 1.43304 0.00000 0.00000
38 2009.08.28 12:00 close 19 8.57 1.43516 0.00000 0.00000 1816.84 26388.38
39 2009.08.28 12:00 sell 20 9.19 1.43516 0.00000 0.00000
40 2009.08.31 02:00 close 20 9.19 1.43043 0.00000 0.00000 4335.84 30724.23
41 2009.08.31 08:00 buy 21 10.75 1.42836 0.00000 0.00000
42 2009.08.31 17:00 close 21 10.75 1.43496 0.00000 0.00000 7095.00 37819.23
43 2009.08.31 17:00 sell 22 13.17 1.43496 0.00000 0.00000
44 2009.09.01 03:00 close 22 13.17 1.43223 0.00000 0.00000 3579.61 41398.83
45 2009.09.01 08:00 sell 23 14.41 1.43572 0.00000 0.00000
46 2009.09.01 18:00 close 23 14.41 1.42350 0.00000 0.00000 17609.02 59007.85
47 2009.09.01 18:00 buy 24 20.72 1.42350 0.00000 0.00000
48 2009.09.07 12:00 close 24 20.72 1.43504 0.00000 0.00000 23823.86 82831.71
49 2009.09.07 12:00 sell 25 28.85 1.43504 0.00000 0.00000
50 2009.09.07 23:59 close at stop 25 28.85 1.43388 0.00000 0.00000 3346.60 86178.31
 
Figar0 >>: the sad thing for us is not that, but that these unpredictable areas are usually the most volatile...

Sounds about right. But in my opinion, the prediction algorithm itself has to play some role here (and it's not without it anyway!).

2 grasn: mmM seems to be going the same way. The dyfurc should work roughly like this: a predicted plot (response to a jump in Greek parameters Α, Β, Γ and Ψ), then a change in Greeks again, and again a predicted instrument adaptation to the new Greeks being at a constant level.

αβγδσλ is just for fun, a game with esc-sequences...
 
 

I don't know, I've got a "hurry", the second prediction was obviously wrong from the beginning, the start was at 1.45, while this level wasn't present at the moment of prediction. (it happens sometimes, because it's considered a kind of "grid" and sometimes, when there is a significant roughening, the forecast "shifts" in some direction). But otherwise it's pretty normal, I haven't even recalculated anything since then.


to Mathemat

2 grasn: mmM, похоже, идет к тому же. Дифурка должна работать примерно так: прогнозируемый участок (отклик на скачок греческих параметров Α, Β, Γ и Ψ), затем - снова смена греков, и снова прогнозируемая адаптация инструмента к новым грекам, находящимся на постоянном уровне.

αβγδσλ is just for fun, a game with esc sequences...

Yes, yes, I know your weakness for esc - sequences. :о) Quite possibly. I'll tighten my knowledge in some areas a bit - and then Belinsky will make me jealous :o)

PS: By the way, take a closer look at the model discussed earlier, I specifically "rolled back" to history to check the detection of this spike, geez, only slightly underestimated, but the "classical model" didn't detect a damn thing. The model based on statistics (I've been showing its results here lately) - only detected it on a small period. This is the only way to detect spikes, there are no others. Or there are and I don't know anything about them. :о)


to Figar0

One of the ways of testing that I use is very simple. On the entire history, I select the most "extreme points", spikes, changes of global and significant local trends, and perform tests of the model for "lousiness". One of the models often sees such "catastrophes" but does not see any other peculiarities. But it has a serious problem - from 3-9 hours of calculation. Others do not see such "surprises" at all. Such is the case ...


to gpwr

I think I will soon be able to formulate the first questions on RBF networks. How do you prefer, ask here (if the author is against it), by e-mail or in a separate branch for general cognitive purposes.

 

4480 is a very strong target and may go lower