Not logged inRybka Chess Community Forum
Up Topic Rybka Support & Discussion / Rybka Support / Large Pages in Rybka 4
1 2 3 4 5 Previous Next  
- - By Vasik Rajlich (Silver) [pl] Date 2010-05-27 02:45
Nick Carlin has put together a document about using large pages in Rybka 4. (Thanks Nick! :))

At the moment it's still a draft. I'll polish it properly this weekend. For those who want to get started now, it is attached.

Vas
Attachment: Rybkalargepages-draftFAQ.pdf (202k)
Parent - By dragon49 (****) [us] Date 2010-05-27 03:30
Thanks Vas!

I got this working, after following the steps.  It was quite a pleasure the turn off UAC altogether.  I don't need the annoyance of windows asking my permission to do something that I want it to do!

Before I read this, I had the option checked and assumed that it was working.  After reading the pdf, I turned logging on and saw that it was not.  It is working now.
Parent - - By Bobby C (****) Date 2010-05-27 03:43 Edited 2010-05-27 04:30
Can you have someone write a correct version that give instructions on how to do this in Windows 7 Starter and Home Premium editions? Those windows 7 versions do not have the Local Group Policy Editor and you need to change things manually in the registry.

Edit: Yeah this sucks, either I am a complete moron or I just wasted an hour trying to figure out how to "Lock pages in
memory" on my Windows 7 Home Premium x64. I thought maybe it was enabled by default in this OS because I have no option of running Local group policy editor but when I tried to use it with Rybka 4 the log file read this before and after rebooting....

Use Large Pages set to true
Large pages not used - CreateFileMapping () returned invalid handle.
Parent - - By Erudito (**) [ca] Date 2010-05-27 06:31
Windows 7 Home Edition DOESN'T SUPPORT Group Policy. You will need to upgrade your Windows 7 license to Professional version or above in order to have Group Policy. Hacking the registry may be an alternative, but not recommended. Too dangerous, it may make your OS unbootable or behave in odd way...
Parent - - By pokerpawn (***) [be] Date 2010-05-27 11:00
nothing wrong with editing the registry as long as you are careful and edit the right key :)
Parent - - By bfn [us] Date 2010-06-03 08:15
So what registry keys do I have to edit in Windows 7 home edition?
Parent - By pokerpawn (***) [be] Date 2010-06-03 11:27
no idea , still looking for an answer to that myself ...
Parent - - By cma6 (****) Date 2010-09-02 04:04
So I cannot run Large Pages in Windows 7 Home Premium?
  This is weird, because I was able to use Large Pages in Windows XP Pro x64.
Parent - - By Lukas Cimiotti (Bronze) [de] Date 2010-09-02 06:23
Please read this: http://rybkaforum.net/cgi-bin/rybkaforum/topic_show.pl?pid=259791#pid259791
Large pages also work with Windows 7 Home Premium - on both of my laptops this works very well.
Parent - By cma6 (****) Date 2010-09-02 13:07
Lukas, thank you for pointing out that post. It is unclear from the post if I have to do anything with UAC before using ntrights.exe or how to turn off or on UAC.
                   Thanks, CMA
Parent - By Wayne Lowrance (***) Date 2010-05-27 04:24
Vas, the description given is for Windows 7. What about Vista instructions?
Wayne
Parent - - By Sunny (***) [in] Date 2010-05-27 13:17
-->> setoption name Use Large Pages value true
                Use large pages enabled.
                  -- shared synchronization file: RybkaSync13988
                  -- shared exchange file: RybkaEx33988
           Using large pages, size = 268435456
                Using large pages, size = 268435456

what are shared synchronization and shared exchange file parameters here?
Parent - - By Vempele (Silver) [fi] Date 2010-05-27 13:18
Internal stuff that the Rybka processes use to communicate with each other.
Parent - By Master Om (Bronze) [in] Date 2010-05-27 14:22
Hi. When i set more than 256 mb hash Rybka is not using Large page files. I have 4 GB RAM. what to do ?
Parent - By Sunny (***) [in] Date 2010-05-27 16:04
Its using 26GB of larges pages :(....my systems memory
Parent - - By oudheusa (*****) [nl] Date 2010-05-27 15:46
the rebooting after reload seems very impractical when switching between engines for analysis. isn't there a simpler solution?
Parent - By Vasik Rajlich (Silver) [pl] Date 2010-06-04 13:45
There might be some memory tools for this. If somebody writes it up, I'll add it to the report.

Vas
Parent - - By Lukas Cimiotti (Bronze) [de] Date 2010-06-06 17:09
Yes - add a little bit more RAM. I tried 24 GB today on a 12 core computer. I could start Rybka using 8 GB of hash several times - large pages were always used.
Parent - By Vasik Rajlich (Silver) [pl] Date 2010-06-07 19:43
No software guy would ever brag about this solution. :)

Vas
Parent - - By Rubén Cómes (****) [ar] Date 2010-08-07 02:04
Hello Lukas

I have a problem:

I have 12 gb; Intel x980; MOBO evga X58 classified.
I load the engines and only see Max Hash Size 3039 as possible.
I think i have bad settings in GUI, but no found the solve.
Have you an idea why i have it problem/limit?
Sorry for my english.
Thank you very much!

Parent - - By AgentEE7 (**) [us] Date 2010-08-07 02:47
What OS version are you using - and is it 64-bit?
Parent - By Rubén Cómes (****) [ar] Date 2010-08-07 02:51
Windows 7 64 bit.
I have 12 gb; only with 64 bit can work 12 gb.
The problem is GUI no show me more 3039 hash size...
Parent - - By Christian Goralski (*) [de] Date 2010-05-27 19:00
Hi,

After typing "Edit group policy" into my Window 7 x64 Ultimate start button at the left of the screen no "Edit group policy" found!

What can I do?

Sincerely Christian Goralski
Parent - - By Bobby C (****) Date 2010-05-27 19:14
Try clicking "start" then typing "run". When the window opens type "gpedit.msc" and see if it finds it. If your using Windows 7 Ultimate you should have the group policy editor, I unfortunately am only using Home Premium and don't have that option. I am guessing that unless I change my OS I will never be able to use large pages(but I hope somebody will come up with something)
Parent - - By Vempele (Silver) [fi] Date 2010-05-27 19:18

> Try clicking "start" then typing "run".


Or just pressing Winkey+R.
Parent - - By Bobby C (****) Date 2010-05-27 19:34
Hi Vempele, I think of you as a pretty smart software/OS guy. Do you understand the problem I am having and do you know of a solution? Since some versions of Windows 7 x64 don't have the "Local Group Policy Editor" then I can not "Lock pages in memory" and am unable to use the "Large Pages" feature in Rybka 4.
Parent - - By Vempele (Silver) [fi] Date 2010-05-27 19:38
Administrators have that privilege by default in the higher editions, so if you turn off UAC and run as administrator and still can't use them, there probably isn't a way.
Parent - By cma6 (****) Date 2010-09-02 04:26
Vempele, I Googled UAC and found this:
Method 1: Disable and Turnoff UAC in Windows 7 from Control Panel
1. Access User Control Panel from Start Menu -> Control Panel -> User Accounts and Family Safety -> User Account
2. Click on
User Account Control settings link.
3. Move the Slider to Never Notify
4. Click OK to make the change effective
5. Reboot.

Would you recommend this procedure for Windows 7 Home Premium? I'm not sure why we have to turn off UAC to enable Large Pages, but everyone on this board assumes we do have to do it.

                                Thanks, CMA
Parent - - By keoki010 (Silver) [us] Date 2010-05-27 20:12
Bobby try going on MS and look for a group that helps you in Windows 7. I don't have the name right now but they could possibly tell you where to go in the register. Note: make sure you make a backup of the register first before editing it.
Parent - - By Bobby C (****) Date 2010-05-27 20:41
I searched around on Google last night and found a link or two that might have information on how to directly modify the registry but I never did that. I want to wait and see if a workaround come available. It's jacked up that the beta testers did not catch this, in fact in the manual that was written he clearly states that large pages will work on Windows 7 but fails to mention that not ALL versions of windows 7 can use large pages.
Parent - - By Nick (****) [gb] Date 2010-06-10 23:59
I guess I am partly responsible for these wonderful large pages :twisted:

No gpedit.msc on Windows Home? 

User rights assignments are not registry keys, but there is a utility in the Windows 2003 Resource kit that can set Windows privileges, including Lock Pages in memory, and it works on Windows 7 too.  The resource kit is a collection of tools available at:

http://www.microsoft.com/DOWNLOADS/en/confirmation.aspx?familyId=9d467a69-57ff-4ae7-96ee-b18c4790cffd&displayLang=en

You only need the program called ntrights.exe, which I'll attach to this post.

Example of turning on the privilege you need (my windows userid is "nick")

C:\Users\nick>ntrights -u nick +r SeLockMemoryPrivilege
Granting SeLockMemoryPrivilege to nick   ... successful

If you ever want to turn it off:

C:\Users\nick>ntrights -u nick -r SeLockMemoryPrivilege
Revoking SeLockMemoryPrivilege from nick   ... successful

These commands were carried out with UAC off, so you may need that or an elevated command prompt.

I've seen some posts that suggest if one is running x64 Windows 7 then you don't need this privilege, unfortunately you do need this privilege.  If you don't have it you'll see error 1350 in the Rybka log (if you do have this privilege but have fragmented memory you'll see error 1450 in the Rybka log).

Hope this helps.
Attachment: ntrights.exe (32k)
Parent - - By Bobby C (****) Date 2010-06-11 00:06
I downloaded that .exe and when I try to run it just blinks and goes away. You need to be more specific on what exactly I need to do. Thanks.....
Parent - - By Nick (****) [gb] Date 2010-06-11 00:16
When I run it, I get the output below.  Do you have UAC on?  If so you probably need to run the command prompt as administrator.

So in the start button bottom left type cmd.exe
Then when the little black dos window appears in the search list right-click on it then "run as administrator"
Then change directory to where you downloaded ntrights.exe and run the command from there

The filesize is :

18/04/2003  18:06            32,256 ntrights.exe

Make sure you got a good download.

C:\Users\nick>ntrights
NTRights.Exe - Beta Version by Georg Zanzen
Grants/Revokes NT-Rights to a user/group
usage: -u xxx  User/Group
       -m \\xxx  machine to perform the operation on (default local machine)
       -e xxxxx Add xxxxx to the event log
       -r xxx  revokes the xxx right
       +r xxx  grants the xxx right
valid NTRights are:
  SeCreateTokenPrivilege
  SeAssignPrimaryTokenPrivilege
  SeLockMemoryPrivilege
  SeIncreaseQuotaPrivilege
  SeUnsolicitedInputPrivilege
  SeMachineAccountPrivilege
  SeTcbPrivilege
  SeSecurityPrivilege
  SeTakeOwnershipPrivilege
  SeLoadDriverPrivilege
  SeSystemProfilePrivilege
  SeSystemtimePrivilege
  SeProfileSingleProcessPrivilege
  SeIncreaseBasePriorityPrivilege
  SeCreatePagefilePrivilege
  SeCreatePermanentPrivilege
  SeBackupPrivilege
  SeRestorePrivilege
  SeShutdownPrivilege
  SeAuditPrivilege
  SeSystemEnvironmentPrivilege
  SeChangeNotifyPrivilege
  SeRemoteShutdownPrivilege
Parent - - By Bobby C (****) Date 2010-06-11 00:39
I have UAC turned off. When I click on the shortcut it just blinks a black command window for a millisecond and then disappears(not running in task manager).



I know how to use command prompt but I am not figuring out what the "ntrights" file is supposed to do since it just blinks and disappears. I have Windows 7 Home Premium x64.
Parent - - By Nick (****) [gb] Date 2010-06-11 00:43

> When I click on the shortcut it just blinks a black command window for a millisecond


Don't click on the shortcut.  Instead, open up a dos window and type in the word ntrights.  It looks like the image I will attach.  Then when you've done that, put the correct parameters on the ntrights command to add the required privilege to your userid, like in the post above.
Parent - - By Bobby C (****) Date 2010-06-11 00:50 Edited 2010-06-11 00:54
How do I navigate from C:\Windows\system32> to C:\Users\Bobby\Desktop

I downloaded to program to my desktop and my user name is Bobby. I have the cmd.exe window open but it starts off at Windows\System32 and when I type in ntrights it tells me it is not recognized as an internal or external command.

Here is an image of what I am seeing.....

Parent - - By Nick (****) [gb] Date 2010-06-11 00:56

> How do I navigate from C:\Windows\system32> to C:\Users\Bobby\Desktop


In the dos window type:

cd c:\users\bobby\desktop

then type in the dos window:

ntrights -u Bobby +r SeLockMemoryPrivilege

(note there is no blank space in -u)
Parent - - By Bobby C (****) Date 2010-06-11 01:01
Perfectly done sir. Everything works now. I will test out my system with Large Pages tonight. Thanks for your hard work :)

Bobby
Parent - - By Nick (****) [gb] Date 2010-06-11 01:03
Good luck .. and goodnight! :grin:
Parent - - By Bobby C (****) Date 2010-06-11 20:41
I tested last night and Large pages is now working on my system. Thanks :)
Parent - By cma6 (****) Date 2010-09-02 04:12
Bobby, I take it you had to turn off UAC first before doing what Nick advised. How did you do that in Windows 7 Home Premium and did you turn UAC back on when you had finished enabling Large Pages?
                 Thanks, CMA
Parent - - By DazzleKnight2010 (**) Date 2011-05-13 04:41
Hi Nick, I am using Deep Rybka 4.1 and have problems with the Large pages. Can you help me to sort it out. I first received the error 1314 and then follow your draft and noe get the 1450 error. I even disabled the tablebases and reduced the cache mem to 1. Your soonest assistance will be much appreciated. Thanks DK. See attached txt file for details.
:smile:
                                                  _________________________
                                                  \                       /
                                                   \        System       / 
                                                    \___________________/  
               
                                                         Date_old : Fri May 13 04:41:02 2011
                                                   Rybka Path : "C:\Program Files (x86)\Common Files\ChessBase\Engines.uci\Rybka 4\Deep Rybka 4.1 x64.exe"
                                                   Rybka Name : Deep Rybka 4.1 x64
                                              # of Processors : 4
                                               Processor Name : Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz
                                       Processor Architecture : x64
                                        Processor Clock Speed : 2.400 GHz
                                         Processor Identifier : Intel64 Family 6 Model 15 Stepping 11
                                  Processor Vendor Identifier : GenuineIntel
                                              Processor Level : 6
                                           Processor Revision : 3851
                                                    Total RAM : 4095
                                                Available RAM : 1040
                                                RAM Page Size : 4096
                                             Operating System : Windows 7 x64
                                             Process Priority : NORMAL_PRIORITY_CLASS
               
                                                  _________________________
                                                  \                       /
                                                   \       Output        / 
                                                    \___________________/  
               
                                                  Engine Name : Deep Rybka 4.1 x64
                                            Send Text Reports : True          
               
               
                                                  _________________________
                                                  \                       /
                                                   \    Resource Use     / 
                                                    \___________________/  
               
                                               Hash Size (Mb) : -
                                                     Max CPUs : -
                                              Use Large Pages : -
               
               
                                                  _________________________
                                                  \                       /
                                                   \     Tablebases      / 
                                                    \___________________/  
               
                                                 Nalimov Path : -
                                                Nalimov Cache : -
                                      Nalimov Probe Frequency : -
               
               
                                                  _________________________
                                                  \                       /
                                                   \       Logging       / 
                                                    \___________________/  
               
                                                Log Directory : -
                                                      Log UCI : -
                                                 Log Analysis : -
                                                     Log Html : -
                                         Use Big Log Diagrams : True          
                                           Lines Per Log Page : 1             
                                   Diagram For Every Position : True          
                                           UCI Log Skip Fluff : True          
               
               
                                                  _________________________
                                                  \                       /
                                                   \    Visualization    / 
                                                    \___________________/  
               
                                             Visualizer Count : 1
                                               Visualizer Log : True          
                                            Visualizer 1 Path :
                                            Visualizer 1 Init :
                                            Visualizer 2 Path :
                                            Visualizer 2 Init :
                                            Visualizer 3 Path :
                                            Visualizer 3 Init :
                                            Visualizer 4 Path :
                                            Visualizer 4 Init :
                                            Visualizer 5 Path :
                                            Visualizer 5 Init :
                                            Visualizer 6 Path :
                                            Visualizer 6 Init :
                                            Visualizer 7 Path :
                                            Visualizer 7 Init :
                                            Visualizer 8 Path :
                                            Visualizer 8 Init :
               
               
                Uci3 has been invoked.
                Cbr3 has been invoked.
                Hash size set to 2048 Mb.
                Tablebase directory set to 'C:\autoTB\TB4;C:\autoTB\TB5;C:\autoTB\TB6'.
                Tablebase cache size set to 1 Mb.
                Tablebase probe frequency set to 36.
                No tablebases in use.
                Large pages not used - user choice.
                Position set to
rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq -
.
               
               UCI logging enabled (had been disabled), log file is at 'uci log Deep 4.1 x64 2228.txt'.
        -->> setoption name Use Large Pages value true
        <<-- ERROR: API        = CreateFileMapping
        <<--        error code = 1450
        <<--        message    = Insufficient system resources exist to complete the requested service.

                Large pages not used. This could be due to memory fragmentation or lack of Administrative privileges. Check RybkaChess.com FAQ for more info.
     2                 starting child
                       -- hash size: 2048
                       -- shared file number: 2
                       -- number of processes: 4
                       -- parent id: 2228
                       -- overridden parent id: 2228
                       -- child number: 3
                       -- full command line: "C:\Program Files (x86)\Common Files\ChessBase\Engines.uci\Rybka 4\Deep Rybka 4.1 x64.exe" 2228 4 2048 2 4 3 2228
                       starting child
                       -- hash size: 2048
                       -- shared file number: 2
                       -- number of processes: 4
                       -- parent id: 2228
                       -- overridden parent id: 2228
                       -- child number: 2
                       -- full command line: "C:\Program Files (x86)\Common Files\ChessBase\Engines.uci\Rybka 4\Deep Rybka 4.1 x64.exe" 2228 4 2048 2 4 2 2228
                       starting child
                       -- hash size: 2048
                       -- shared file number: 2
                       -- number of processes: 4
                       -- parent id: 2228
                       -- overridden parent id: 2228
                       -- child number: 1
                       -- full command line: "C:\Program Files (x86)\Common Files\ChessBase\Engines.uci\Rybka 4\Deep Rybka 4.1 x64.exe" 2228 4 2048 2 4 1 2228
                Large page usage enabled (had been disabled).
   122  -->> setoption name Clear Hash
                Hash clear invoked.
   197  -->> setoption name Clear Hash
   198          Hash clear invoked.
   230  -->> quit
                Exiting Rybka, reason : Quit command received.
Parent - - By CumnorChessClub (***) [gb] Date 2011-05-13 08:51
Have you tried restarting your computer and then right click your chess program and choose "run as administrator" then select "infinite analysis" then take a look at the txt file to see if large pages are working.

Do not start any other program before doing above. remember once you close the GUI (you are able to change engines without affecting large pages) you will have to restart your computer if you want to use large pages again.

The above is how I get large pages to work in win 7 when getting the same error. Also once in a while I have to delete the txt files too, to get it working again.
Parent - By DazzleKnight2010 (**) Date 2011-05-13 12:52
I tried that but the problem persist.
Parent - - By Vempele (Silver) [fi] Date 2011-05-13 09:07
First, try with 2MB hash. If that works, we can rule out the admin issue.
Parent - - By DazzleKnight2010 (**) Date 2011-05-13 13:01
Hi Vempele, It does not work. It seems that there is a memory fragmentation problem. Does anyone know how to sort it out. DK.
Parent - - By keoki010 (Silver) [us] Date 2011-05-13 14:41
You only have 4095 ram according to your system.  You will need to set your hash really low and go through your startup and not start some programs. Easy fix would be get more ram.
Parent - - By DazzleKnight2010 (**) Date 2011-05-14 18:53
Hi Keoki010, I got it right this time. Less memory worked. I will upgrade to maximum ram my motherboard can carry soon.Thanks a million. DK.
Parent - - By Dragon Mist (****) [hr] Date 2011-05-16 20:55
I have the same problem, loading R4.1 with 1024 hash. If I load say 256, activate large pages, and then set hash to 1024, it should work?
Parent - - By Vempele (Silver) [fi] Date 2011-05-16 21:04
No.
Up Topic Rybka Support & Discussion / Rybka Support / Large Pages in Rybka 4
1 2 3 4 5 Previous Next  

Powered by mwForum 2.27.4 © 1999-2012 Markus Wichitill