Using this version I also got the exact same values as current version. I also checkout out and older version aa8b650 and compiled that version. The values are the same as the ones returned by the web service, see the original issue. The values i get are:Ġ.51207 company, sell, corporation, own, acquire, purchase, buy, business, sale, ownerĠ.75174 age, population, household, female, family, census, live, average, median, incomeĠ.73356 jewish, israel, jew, israeli, jerusalem, rabbi, hebrew, palestinian, palestine, holocaust (I get these values using the provided jar aswell) I am on a Linux system with Fedora 27. This is using the wikipedia index provided at and compiling the library locally as a jar. I get similar but not exactly the same values as the ones provided in the original issue. Using the web service I also get different scores:Īm I making a mistake somewhere? How can the scores here be different from the C_V scores displayed in the paper?Īre there any more information available on what is causing the difference between values in the paper and the ones calculated using the provided source. txt file, I get the following scores:Ġ.52072 company sell corporation own acquire purchase buy business sale ownerĠ.75174 age population household female family census live average median incomeĠ.73356 jewish israel jew israeli jerusalem rabbi hebrew palestinian palestine holocaust Running Palmetto as jar and using the wikipedia_bd downloaded from the link on Github and the above topics in a. In this table the following coherence scores, using the measure C_V, are displayed:Ġ.94 company sell corporation own acquire purchase buy business sale ownerĠ.91 age population household female family census live average median incomeĠ.86 jewish israel jew israeli jerusalem rabbi hebrew palestinian palestine holocaust Having a closer look, I found that I'm also not able to replicate the coherence scores as shown in Table 8 of the paper. However, I'm not able to replicate the same Pearson correlation scores as in Table 2. I'm trying to replicate some results described in your paper ("Exploring the Space of Topic Coherence Measures"), by using the topics and human ratings that you have published. For my research I want to evaluate a new semantic coherence measure with the ones available in Palmetto, especially C_V and C_A.
0 kommentar(er)
