Not logged inRybka Chess Community Forum
Up Topic Rybka Support & Discussion / Rybka Discussion / Since end of May ...
- - By rarara (**) Date 2010-09-05 16:14
...it is not a secret that there are severe bugs in Rybka 4!
So there are now more than 3 months without a patch / bugfix! Do you call that good customer service?
I did pay for a product and can't use the (for me!) most important features.

When will I (and the other customers) get that patch / bugfix?

Regards
rarara
Parent - - By Gaмßito (****) [cr] Date 2010-09-05 19:06
Why do you expect a patch? Don't know the very known history about Rybka 3+?

You, me and all others, have to thanks Vas because we finally have Rybka 4. Nothing more.
The next Rybka is here until late 2011 or early 2012.

Regards,
Gaмßito.
Parent - - By Uly (Gold) [mx] Date 2010-09-05 20:06
Vas said he had planned a 18 months rest between versions (because the could model will allow weekly versions, etc.)
Parent - - By Banned for Life (Gold) Date 2010-09-05 20:19
I'm not convinced there would be a lot of enthusiasm for Rybka 5 at the end of 2011. I think it's Cloud Rybka or nothing for Vas at this point...
Parent - - By Uly (Gold) [mx] Date 2010-09-05 20:31 Edited 2010-09-05 20:34
And I think Vas has some 120 elo points hidden under the bed, so that in case everything fails, he releases them and gets back in business. Perhaps he has a reality shock and starts listening to us, (like using a model similar to Rybka 2, but in where people have to pay for each new version, or something.)
Parent - - By rarara (**) Date 2010-09-05 20:43
If there will be no patch / bugfix for Rybka 4, I will never ever pay a single cent for whatever version of Rybka.
I paid for a working engine and that is what I want to have!
Parent - - By Yoav Dothan (**) [il] Date 2010-09-06 11:37
Your post is a shame - you bought the strongest chess engine in the world - as proven by all the rating lists - and yet you write as if you got a trash ... If you are somewhat chess capable, you can overide the few known bugs and in those rare positions where a bishop promotion is best, you will find it. I cannot understand you and other people writing about this wonderful program as if it nothing.
Parent - - By Banned for Life (Gold) Date 2010-09-06 20:13
R4 is very strong, but I'm surprised that you are so willing to overlook some serious deficiencies (and I'm definitely not talking about bishop under-promotion!). The worst deficiencies, in my opinion, are:

1) MPV leads to silent crashes,
2) Branching factor suddenly goes ballistic, e.g. you end up getting depth 19 in 12 seconds and give up on depth 20 after 8 hours, and
3) Persistent hash was removed, rather than being improved.

All of these occurred because:
1) The release of R4 UCI was allocated only a very small amount of Vas' time, and
2) Most testing was done using the engine for engine-engine testing rather than for analysis.

I'm quite sure that Vas could fix all of the serious issues in 3-4 weeks if he so desires, and I think it would be a good investment on his part.
Parent - By keoki010 (Bronze) [us] Date 2010-09-06 20:34
I agree except that it probably would only take 3-4 days. :smile:
Parent - - By Uly (Gold) [mx] Date 2010-09-06 20:48

> Most testing was done using the engine for engine-engine testing rather than for analysis.


And I:

1) Don't use MultiPV at all (relying on exclude moves.)
2) Don't leave the engine running for hours (so I never know if the branching factor is x15 or... x2400 o_O)
3) May be the cause that Persistent Hash was removed for being too aggressive in my presentation of the bugs to Vas (I was like VAS YOU MUST FIX THIS ph bug 1 BECAUSE (WALL OF TEXT WITH REASONS), AND THE RELEASE CAN'T HAVE ph bug 2 BECAUSE (WALL OF TEXT 2.0) GET RID OF OTHER FEATURES THAT HAVEN'T BEEN TESTED IF NECESSARY.)

Oh well, Vas just found the release version acceptable.
Parent - - By Loboestepario (****) [us] Date 2010-09-06 22:59
I assume you are using exclude moves and many instances of single-pv rybka within IA. That's a workaround but hard to say it's better than simply using multi-pv. In a complex position I don't know how you would use exclude moves for IA without having an IDeA tree first unless you have so many cores available that this is not an issue.
Multipv is such a basic a simple concept. Any engine unable to support it falls down one category in my opinion. A second class engine.
Parent - - By Uly (Gold) [mx] Date 2010-09-07 00:16

> That's a workaround


No, from dictionary "A workaround is a bypass of a recognized problem in a system", I didn't know about the MultiPV bug, so didn't know it had a problem. I'd rely on exclude moves with or without it (basically it doesn't affect me).

> but hard to say it's better than simply using multi-pv.


I'd turn it around and say that it's hard to say if using MultiPV is better than simply excluding moves.

> I don't know how you would use exclude moves for IA without having an IDeA tree first


Where do you store MultiPV analysis? The hash is the worst possible place as that will get deleted on next load or overwritten soon enough. So people have to learn to store their analysis later for when it's eventually needed, like, 3 months later when a different opponent reaches the same position that was already analyzed, running MultiPV again is pointless if you already did that back then, it's much more effective if you just look at what you already have stored, AND you can use exclude moves on all analyzed moves to look for new ideas. I don't use IDEA trees, but I've heard about people that store their analysis even in text files.

Bottom line, MultiPV seems like outdated technology that doesn't have any use, specially with Rybka, that is slowed down more than she should, try with Naum, tick the "Preserve analysis" box, put it to analyze the position to some depth, exclude the main move, and in transpositional positions, it'll immediately show another move with the same depth, that you can exclude to get a third move at that depth, all instantly, in MultiPV=3 it'd take about 50% more time to get the same output, so I think this R4 bug is an excellent chance for people to learn how to use superior analysis methods like exclude moves.
Parent - - By Loboestepario (****) [us] Date 2010-09-07 00:41
It's a workaround for people that use multipv. If you don't use it don't worry about it.
Multipv outdated? Doubt it. If a position has 20 reasonable candidate moves and I have a Quad, I can use many methods to explore all the possibilities. Multipv is the simplest. Speed is not an issue. Depth of analysis is where the value resides for me in correspondence chess. Using your method and running the engine a few hours per setting, it would take me a long time to feel comfortable with the results.
That's not practical for deep analysis. What I have done is build an IDeA tree as a start and then assign one core per move (3) and save the last core for all other moves including those outside the tree.

Take a different scenario, you are playing as a centaur online. Here I really like to have a second engine using multipv and rybka4 single pv. Not supporting multipv is a hassle and in rybka's case an undesirable bug.
Parent - - By Uly (Gold) [mx] Date 2010-09-07 01:12

> If a position has 20 reasonable candidate moves and I have a Quad, I can use many methods to explore all the possibilities. Multipv is the simplest.


But not the most efficient.

>Speed is not an issue. Depth of analysis is where the value resides for me in correspondence chess.


Those are correlated, with higher speed you can reach the same depth in less time, or the same depth in more positions.

> Using your method and running the engine a few hours per setting


Here's where we diverge, I'm talking about interactive analysis, if you're leaving the engine running unattended for hours, you're losing exponential time.
Parent - By Loboestepario (****) [us] Date 2010-09-07 01:51
It's obvious we use engines in different ways. I wish your methods will never be forbidden due to engine bugs in the future since we both paid the same fee.
Parent - - By Yoav Dothan (**) [il] Date 2010-09-07 06:13
I do not overlook the problems that you mention -

1) MPV leads to silent crashes,

It took me just a few hours after I got my own copy of R4 to find the problem - it is annoying, but I can play with only one variation, then check the other that I am interested in.

2) Branching factor suddenly goes ballistic, e.g. you end up getting depth 19 in 12 seconds and give up on depth 20 after 8 hours, and

This is even stranger - I had an example of a single variation that  I am sure crashed, as it did not get up in depth no matter how much time I gave it. I left it 20 times more time than it needed to depth x, and still it did not reach depth x+1

3) Persistent hash was removed, rather than being improved.

I never used persistent hash, so I do not know what benefits you got using it.

I am also sorry that Vas discontinued the very good system of using his many users experience in the stage of testing as he did in version 2. A few weeks of tests of just few individuals is not enough.

Yet - all of the above does not change the fact that R4 is the best - by far....
Parent - - By Gaмßito (****) [cr] Date 2010-09-07 14:04

> I had an example of a single variation that  I am sure crashed, as it did not get up in depth no matter how much time I gave it.


Can you please show that position? I have not found examples like that still.

Gaмßito.
Parent - By Banned for Life (Gold) Date 2010-09-07 15:37
This happens frequently to me when I do backwards analysis, but it can't be reproduced easily because it is dependent on what you have in the hash. Clearing the hash solves the problem at the cost of throwing out all the time you spent on putting in best known lines.
Parent - - By Banned for Life (Gold) Date 2010-09-07 15:35
I pretty much agree with your assessments:

1) There are definitely workarounds to not having MPV, but it is very nice to start an analysis with some knowledge of the set of candidate moves (of course this is an imperfect list at the start of the analysis, but it's still good for scheduling purposes).
2) I don't have a workaround for this and frequently waste time waiting for a depth that will never show up. The only solution is to clear the hash and restart the analysis. This is a very heavy price to pay if you've spent hours building up the hash...
3) Persistent hash is extremely useful in backward analysis. It allows the engine to use evals from previously analyzed high depth positions in its search. Properly implemented, this is could be a huge time saver. The R3 implementation had a few severe bugs, but I still found it very useful. With R4, nothing.

That said, I agree that R4 is still of great value for analysis as an adjunct to other engines, but I don't have the patience to use it as my main analysis tool.
Parent - By Uly (Gold) [mx] Date 2010-09-07 16:14
Yes, all Persistent Hash bugs had its workarounds, just for that Rybka 3 is still a core engine of mine. Rybka 4 is my fourth main engine, I'd be crazy if I put it as the first one. I have this feeling that some people are probably just doing weaker analysis and performing worse by relying on R4 instead of R3, but they're not aware of it and assume that just because it's 40 elo stronger on the rating lists, that it'll automatically give a better job.
Parent - By rarara (**) Date 2010-09-07 16:45
No, I am completely right. Here are the facts:
- multi PV isn't working properly in R4
- Monte-Carlo-Analysis is not working properly
- Positional Analysis with fixed length and more than 1 move/option is not working properly
With all the listed topics the Rybka 4 engine just stops working (hanging / stalled). That are features I am always using.

I don't talk here about a lack of strength!

And here you can read it (confirmed by Vas):
http://rybkaforum.net/cgi-bin/rybkaforum/topic_show.pl?tid=17179
Parent - - By keoki010 (Bronze) [us] Date 2010-09-05 20:54
I think you are not right.  He will do the same old thing he did for Rybka4.  Chop up the cloud Rybka, beta test for a week and sell, damn the bugs.
Parent - - By Uly (Gold) [mx] Date 2010-09-05 21:06
Anyway, I blame the customers that buy the engine no matter what, probably Rybka 4 is selling just as good as Rybka 3, so why release it at full strength?
Parent - - By Arrière Pensée (Gold) Date 2010-09-06 00:38
I'd like to compare sales between R3 and R4-

R3 had a totally different aura around it- whereas R4 had a great deal of controversy surrounding it before and after its sale.
Parent - By Uly (Gold) [mx] Date 2010-09-06 15:01
True, Rybka 3 was like "Oh my god, it is really 100 elo stronger than Rybka 2.3.2a?!  That's awesome!!", Rybka 4 is like "Oh god, only 40 elo stronger than R3, and with show stopping bugs, the playing style isn't as solid as what we're used to, the time control is broken, etc."

Still we*'re only part of the 1% of the customer base, so probably all that doesn't contribute much to a drop in sales.

(*) As in forum regulars.
Parent - By 8lrr8 (***) Date 2010-09-06 00:13
"...Vas has some 120 elo points hidden under the bed..."

i think this is dubious even at blitz time controls, never mind at 40/120 given today's hardware and future hardware on the horizon.  the draw barrier is simply too wide.  the marching forward of opening theory doesnt help, either.
Parent - By notyetagm (**) [us] Date 2010-09-07 01:42
Another certain magical engine that I cannot name had a bug. It was fixed the next day(!) by the programmer,
who promptly apologized for the inconvenience created by the bug.

How is that for a customer service model?

1 day versus 3 months and counting
- - By Moz (****) Date 2010-09-07 18:15
Rybka had a great run but we have to face the truth -- it's the end of an era.  Next!
Parent - By Arrière Pensée (Gold) Date 2010-09-07 21:12

> Rybka had a great run but we have to face the truth -- it's the end of an era.  Next!


Oh, that's just plain crazy talk! Why, we'll get that updated bug fix in Rybka 5 everyone knows that! Unless, Norm can solve it before hand! :yell:
Up Topic Rybka Support & Discussion / Rybka Discussion / Since end of May ...

Powered by mwForum 2.27.4 © 1999-2012 Markus Wichitill