| In our dataset only 11% of Candidate Relations are valid. | Initialization: Model parameters 0,, = 0 and 00 = 0. |
| In our dataset only 11% of Candidate Relations are valid. | As before, 633 is the vector of model parameters , and gbx is the feature function. |
| In our dataset only 11% of Candidate Relations are valid. | Therefore, during learning, we need to find the model parameters that maximize expected future reward (Sutton and Barto, 1998). |
| Model | Update the model parameters , using the low-level planner’s success or failure as the source of supervision. |
| Model | where 6C is the vector of model parameters . |