Can Editorial Decisions Impair Journal Recommendations? Analysing the Impact of Journal Characteristics on Recommendation Systems

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Elias Entrup
  • Ralph Ewerth
  • Anett Hoppe

Research Organisations

External Research Organisations

  • German National Library of Science and Technology (TIB)
View graph of relations

Details

Original languageEnglish
Title of host publicationProceedings of the 18th ACM Conference on Recommender Systems
Subtitle of host publicationRecSys 2024
Pages1062-1066
Number of pages5
ISBN (electronic)9798400705052
Publication statusPublished - 8 Oct 2024
Event18th ACM Conference on Recommender Systems, RecSys 2024 - Bari, Italy
Duration: 14 Oct 202418 Oct 2024

Abstract

Recommendation services for journals help scientists choose appropriate publication venues for their research results. They often use a semantic matching process to compare e.g. an abstract against already published articles. As these services can guide a researcher’s decision, their fairness and neutrality are critical qualities. However, the impact of journal characteristics (such as the abstract length) on recommendations is understudied. In this paper, we investigate whether editorial journal characteristics can lead to biased rankings from recommendation services, i.e. if editorial choices can systematically lead to a better ranking of one’s own journal. The performed experiments show that longer abstracts or a higher number of articles per journal can boost the rank of a journal in the recommendations. We apply these insights to an active, open-source journal recommendation system. The adaptation of the algorithm leads to an increased accuracy for smaller journals.

Keywords

    Adversarial attack, Data poisoning, Journal recommendation, Scientific publishing

ASJC Scopus subject areas

Cite this

Can Editorial Decisions Impair Journal Recommendations? Analysing the Impact of Journal Characteristics on Recommendation Systems. / Entrup, Elias; Ewerth, Ralph; Hoppe, Anett.
Proceedings of the 18th ACM Conference on Recommender Systems: RecSys 2024. 2024. p. 1062-1066.

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Entrup, E, Ewerth, R & Hoppe, A 2024, Can Editorial Decisions Impair Journal Recommendations? Analysing the Impact of Journal Characteristics on Recommendation Systems. in Proceedings of the 18th ACM Conference on Recommender Systems: RecSys 2024. pp. 1062-1066, 18th ACM Conference on Recommender Systems, RecSys 2024, Bari, Italy, 14 Oct 2024. https://doi.org/10.1145/3640457.3688194
Entrup, E., Ewerth, R., & Hoppe, A. (2024). Can Editorial Decisions Impair Journal Recommendations? Analysing the Impact of Journal Characteristics on Recommendation Systems. In Proceedings of the 18th ACM Conference on Recommender Systems: RecSys 2024 (pp. 1062-1066) https://doi.org/10.1145/3640457.3688194
Entrup E, Ewerth R, Hoppe A. Can Editorial Decisions Impair Journal Recommendations? Analysing the Impact of Journal Characteristics on Recommendation Systems. In Proceedings of the 18th ACM Conference on Recommender Systems: RecSys 2024. 2024. p. 1062-1066 doi: 10.1145/3640457.3688194
Entrup, Elias ; Ewerth, Ralph ; Hoppe, Anett. / Can Editorial Decisions Impair Journal Recommendations? Analysing the Impact of Journal Characteristics on Recommendation Systems. Proceedings of the 18th ACM Conference on Recommender Systems: RecSys 2024. 2024. pp. 1062-1066
Download
@inproceedings{25e4d96b6e1e4438a4b9a47ca8ba70a5,
title = "Can Editorial Decisions Impair Journal Recommendations?: Analysing the Impact of Journal Characteristics on Recommendation Systems",
abstract = "Recommendation services for journals help scientists choose appropriate publication venues for their research results. They often use a semantic matching process to compare e.g. an abstract against already published articles. As these services can guide a researcher{\textquoteright}s decision, their fairness and neutrality are critical qualities. However, the impact of journal characteristics (such as the abstract length) on recommendations is understudied. In this paper, we investigate whether editorial journal characteristics can lead to biased rankings from recommendation services, i.e. if editorial choices can systematically lead to a better ranking of one{\textquoteright}s own journal. The performed experiments show that longer abstracts or a higher number of articles per journal can boost the rank of a journal in the recommendations. We apply these insights to an active, open-source journal recommendation system. The adaptation of the algorithm leads to an increased accuracy for smaller journals.",
keywords = "Adversarial attack, Data poisoning, Journal recommendation, Scientific publishing",
author = "Elias Entrup and Ralph Ewerth and Anett Hoppe",
note = "Publisher Copyright: {\textcopyright} 2024 Copyright held by the owner/author(s).; 18th ACM Conference on Recommender Systems, RecSys 2024 ; Conference date: 14-10-2024 Through 18-10-2024",
year = "2024",
month = oct,
day = "8",
doi = "10.1145/3640457.3688194",
language = "English",
pages = "1062--1066",
booktitle = "Proceedings of the 18th ACM Conference on Recommender Systems",

}

Download

TY - GEN

T1 - Can Editorial Decisions Impair Journal Recommendations?

T2 - 18th ACM Conference on Recommender Systems, RecSys 2024

AU - Entrup, Elias

AU - Ewerth, Ralph

AU - Hoppe, Anett

N1 - Publisher Copyright: © 2024 Copyright held by the owner/author(s).

PY - 2024/10/8

Y1 - 2024/10/8

N2 - Recommendation services for journals help scientists choose appropriate publication venues for their research results. They often use a semantic matching process to compare e.g. an abstract against already published articles. As these services can guide a researcher’s decision, their fairness and neutrality are critical qualities. However, the impact of journal characteristics (such as the abstract length) on recommendations is understudied. In this paper, we investigate whether editorial journal characteristics can lead to biased rankings from recommendation services, i.e. if editorial choices can systematically lead to a better ranking of one’s own journal. The performed experiments show that longer abstracts or a higher number of articles per journal can boost the rank of a journal in the recommendations. We apply these insights to an active, open-source journal recommendation system. The adaptation of the algorithm leads to an increased accuracy for smaller journals.

AB - Recommendation services for journals help scientists choose appropriate publication venues for their research results. They often use a semantic matching process to compare e.g. an abstract against already published articles. As these services can guide a researcher’s decision, their fairness and neutrality are critical qualities. However, the impact of journal characteristics (such as the abstract length) on recommendations is understudied. In this paper, we investigate whether editorial journal characteristics can lead to biased rankings from recommendation services, i.e. if editorial choices can systematically lead to a better ranking of one’s own journal. The performed experiments show that longer abstracts or a higher number of articles per journal can boost the rank of a journal in the recommendations. We apply these insights to an active, open-source journal recommendation system. The adaptation of the algorithm leads to an increased accuracy for smaller journals.

KW - Adversarial attack

KW - Data poisoning

KW - Journal recommendation

KW - Scientific publishing

UR - http://www.scopus.com/inward/record.url?scp=85210476990&partnerID=8YFLogxK

U2 - 10.1145/3640457.3688194

DO - 10.1145/3640457.3688194

M3 - Conference contribution

AN - SCOPUS:85210476990

SP - 1062

EP - 1066

BT - Proceedings of the 18th ACM Conference on Recommender Systems

Y2 - 14 October 2024 through 18 October 2024

ER -