runcue.txt

CMAC神经网络机械臂控制的设计matlab源码

Compilation and Running Cues. 
The ziped archive with the source code for Mountain-Car - SARSA - CMAC package also contains two additional files: 

cmac.unx 
Contains structural parameters of the CMAC architectures used to represent action value functions. The name of this file can be passed as the command-line argument str=cmac.unx (see MainParameters for the format of the command line arguments). This architecture worked well in our experiments, but you are free to change it the way you like (preserving the format). 
teststates.unx 
Contains 50 test states, which are used as start states for the policy evaluations on test trials. The name of this file can be passed as the command-line argument tsf=teststates.unx (see MainParameters for the format of the command line arguments). The states are sampled from a uniform distribution in the state-space of the Mountain-Car task. Each state is specified on a different line with a blank space separating values of the state variables. 


To compile and create an exacutable, first unzip the archive and then use a C++ compiler. For example under unix, using g++:

        g++ -O2 *.cpp -o learn 


Then run the created exacutable with appropriate command-line arguments, e.g.:

         learn lambda=0.7 epsilon=0.01 alpha=0.00625 schedule=constant Trials=10000 Steps=1000 tf=100 tsn=50 tsf=teststates.unx ts=10 str=cmac.unx run=1 dir=. 


See documentation for the run() function for the explanation of the content of the produced files. 

--------------------------------------------------------------------------------