So there are now more than 3 months without a patch / bugfix! Do you call that good customer service?
I did pay for a product and can't use the (for me!) most important features.
When will I (and the other customers) get that patch / bugfix?
Regards
rarara
You, me and all others, have to thanks Vas because we finally have Rybka 4. Nothing more.
The next Rybka is here until late 2011 or early 2012.
Regards,
Gaмßito.
I paid for a working engine and that is what I want to have!
1) MPV leads to silent crashes,
2) Branching factor suddenly goes ballistic, e.g. you end up getting depth 19 in 12 seconds and give up on depth 20 after 8 hours, and
3) Persistent hash was removed, rather than being improved.
All of these occurred because:
1) The release of R4 UCI was allocated only a very small amount of Vas' time, and
2) Most testing was done using the engine for engine-engine testing rather than for analysis.
I'm quite sure that Vas could fix all of the serious issues in 3-4 weeks if he so desires, and I think it would be a good investment on his part.
> Most testing was done using the engine for engine-engine testing rather than for analysis.
And I:
1) Don't use MultiPV at all (relying on exclude moves.)
2) Don't leave the engine running for hours (so I never know if the branching factor is x15 or... x2400 o_O)
3) May be the cause that Persistent Hash was removed for being too aggressive in my presentation of the bugs to Vas (I was like VAS YOU MUST FIX THIS ph bug 1 BECAUSE (WALL OF TEXT WITH REASONS), AND THE RELEASE CAN'T HAVE ph bug 2 BECAUSE (WALL OF TEXT 2.0) GET RID OF OTHER FEATURES THAT HAVEN'T BEEN TESTED IF NECESSARY.)
Oh well, Vas just found the release version acceptable.
Multipv is such a basic a simple concept. Any engine unable to support it falls down one category in my opinion. A second class engine.
> That's a workaround
No, from dictionary "A workaround is a bypass of a recognized problem in a system", I didn't know about the MultiPV bug, so didn't know it had a problem. I'd rely on exclude moves with or without it (basically it doesn't affect me).
> but hard to say it's better than simply using multi-pv.
I'd turn it around and say that it's hard to say if using MultiPV is better than simply excluding moves.
> I don't know how you would use exclude moves for IA without having an IDeA tree first
Where do you store MultiPV analysis? The hash is the worst possible place as that will get deleted on next load or overwritten soon enough. So people have to learn to store their analysis later for when it's eventually needed, like, 3 months later when a different opponent reaches the same position that was already analyzed, running MultiPV again is pointless if you already did that back then, it's much more effective if you just look at what you already have stored, AND you can use exclude moves on all analyzed moves to look for new ideas. I don't use IDEA trees, but I've heard about people that store their analysis even in text files.
Bottom line, MultiPV seems like outdated technology that doesn't have any use, specially with Rybka, that is slowed down more than she should, try with Naum, tick the "Preserve analysis" box, put it to analyze the position to some depth, exclude the main move, and in transpositional positions, it'll immediately show another move with the same depth, that you can exclude to get a third move at that depth, all instantly, in MultiPV=3 it'd take about 50% more time to get the same output, so I think this R4 bug is an excellent chance for people to learn how to use superior analysis methods like exclude moves.
Multipv outdated? Doubt it. If a position has 20 reasonable candidate moves and I have a Quad, I can use many methods to explore all the possibilities. Multipv is the simplest. Speed is not an issue. Depth of analysis is where the value resides for me in correspondence chess. Using your method and running the engine a few hours per setting, it would take me a long time to feel comfortable with the results.
That's not practical for deep analysis. What I have done is build an IDeA tree as a start and then assign one core per move (3) and save the last core for all other moves including those outside the tree.
Take a different scenario, you are playing as a centaur online. Here I really like to have a second engine using multipv and rybka4 single pv. Not supporting multipv is a hassle and in rybka's case an undesirable bug.
> If a position has 20 reasonable candidate moves and I have a Quad, I can use many methods to explore all the possibilities. Multipv is the simplest.
But not the most efficient.
>Speed is not an issue. Depth of analysis is where the value resides for me in correspondence chess.
Those are correlated, with higher speed you can reach the same depth in less time, or the same depth in more positions.
> Using your method and running the engine a few hours per setting
Here's where we diverge, I'm talking about interactive analysis, if you're leaving the engine running unattended for hours, you're losing exponential time.
1) MPV leads to silent crashes,
It took me just a few hours after I got my own copy of R4 to find the problem - it is annoying, but I can play with only one variation, then check the other that I am interested in.
2) Branching factor suddenly goes ballistic, e.g. you end up getting depth 19 in 12 seconds and give up on depth 20 after 8 hours, and
This is even stranger - I had an example of a single variation that I am sure crashed, as it did not get up in depth no matter how much time I gave it. I left it 20 times more time than it needed to depth x, and still it did not reach depth x+1
3) Persistent hash was removed, rather than being improved.
I never used persistent hash, so I do not know what benefits you got using it.
I am also sorry that Vas discontinued the very good system of using his many users experience in the stage of testing as he did in version 2. A few weeks of tests of just few individuals is not enough.
Yet - all of the above does not change the fact that R4 is the best - by far....
> I had an example of a single variation that I am sure crashed, as it did not get up in depth no matter how much time I gave it.
Can you please show that position? I have not found examples like that still.
Gaмßito.
1) There are definitely workarounds to not having MPV, but it is very nice to start an analysis with some knowledge of the set of candidate moves (of course this is an imperfect list at the start of the analysis, but it's still good for scheduling purposes).
2) I don't have a workaround for this and frequently waste time waiting for a depth that will never show up. The only solution is to clear the hash and restart the analysis. This is a very heavy price to pay if you've spent hours building up the hash...
3) Persistent hash is extremely useful in backward analysis. It allows the engine to use evals from previously analyzed high depth positions in its search. Properly implemented, this is could be a huge time saver. The R3 implementation had a few severe bugs, but I still found it very useful. With R4, nothing.
That said, I agree that R4 is still of great value for analysis as an adjunct to other engines, but I don't have the patience to use it as my main analysis tool.
- multi PV isn't working properly in R4
- Monte-Carlo-Analysis is not working properly
- Positional Analysis with fixed length and more than 1 move/option is not working properly
With all the listed topics the Rybka 4 engine just stops working (hanging / stalled). That are features I am always using.
I don't talk here about a lack of strength!
And here you can read it (confirmed by Vas):
http://rybkaforum.net/cgi-bin/rybkaforum/topic_show.pl?tid=17179
R3 had a totally different aura around it- whereas R4 had a great deal of controversy surrounding it before and after its sale.
Still we*'re only part of the 1% of the customer base, so probably all that doesn't contribute much to a drop in sales.
(*) As in forum regulars.
i think this is dubious even at blitz time controls, never mind at 40/120 given today's hardware and future hardware on the horizon. the draw barrier is simply too wide. the marching forward of opening theory doesnt help, either.
who promptly apologized for the inconvenience created by the bug.
How is that for a customer service model?
1 day versus 3 months and counting
> Rybka had a great run but we have to face the truth -- it's the end of an era. Next!
Oh, that's just plain crazy talk! Why, we'll get that updated bug fix in Rybka 5 everyone knows that! Unless, Norm can solve it before hand!
Powered by mwForum 2.27.4 © 1999-2012 Markus Wichitill