Commit 841e116f authored by Juliette Faille's avatar Juliette Faille
Browse files

Update README.md

parent 3cb276f1
Pipeline #2 canceled with stages
......@@ -23,7 +23,7 @@ python3 -m pip install -r requirements.txt
## 2. Get the results
###2.1 Mentions Detection
### 2.1 Mentions Detection
All intermediate results are saved in the folders `WebNLG_2017`, `WebNLG_2020`, `Models_2017` and `Models_2020`.
You can use them to avoid rerunning the REL Entity Linker API.
......@@ -41,17 +41,17 @@ runEntityRecognitionMain.sh models2017
```
(with the argument `webnlg2017`, `webnlg2020`, `models2017` or `models2020`)
###2.2 Computation of Entity-based semantic adequacy
### 2.2 Computation of Entity-based semantic adequacy
To get the Entity based Semantic Adequacy score run the script:
```
runOmissionsESA.sh models2017
```
###2.3 Correlation Study
### 2.3 Correlation Study
```
runCorrelations.sh models2017 pearson 0
```
with arguments $1: models2017 or models2020, $2: pearson, spearman or kendall_tau, $3: 0, 1 or 2 (consider only texts with at least 0, 1 or 2 undetected entities for the correlation study)
###2.4 Hallucinations
### 2.4 Hallucinations
To detect hallucinations and compute Entity-based semantic adequacy for hallucinations, run:
```
runHallucinations.sh models2017
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment