Follow
Ivan Stelmakh
Ivan Stelmakh
Verified email at cs.cmu.edu - Homepage
Title
Cited by
Cited by
Year
PeerReview4All: Fair and accurate reviewer assignment in peer review
I Stelmakh, NB Shah, A Singh
Algorithmic Learning Theory, 828-856, 2019
642019
On testing for biases in peer review
I Stelmakh, N Shah, A Singh
Advances in Neural Information Processing Systems 32, 2019
442019
Catch me if i can: Detecting strategic behaviour in peer assessment
I Stelmakh, NB Shah, A Singh
Proceedings of the AAAI Conference on Artificial Intelligence 35 (6), 4794-4802, 2021
192021
Prior and prejudice: The novice reviewers' bias against resubmissions in conference peer review
I Stelmakh, NB Shah, A Singh, H Daumé III
Proceedings of the ACM on Human-Computer Interaction 5 (CSCW1), 1-17, 2021
182021
A novice-reviewer experiment to address scarcity of qualified reviewers in large conferences
I Stelmakh, NB Shah, A Singh, H Daumé III
Proceedings of the AAAI Conference on Artificial Intelligence 35 (6), 4785-4793, 2021
162021
Debiasing evaluations that are biased by evaluations
J Wang, I Stelmakh, Y Wei, NB Shah
Proceedings of the AAAI Conference on Artificial Intelligence 35 (11), 10120 …, 2021
122021
A large scale randomized controlled trial on herding in peer-review discussions
I Stelmakh, C Rastogi, NB Shah, A Singh, H Daumé III
arXiv preprint arXiv:2011.15083, 2020
92020
CrowdSpeech and VoxDIY: Benchmark Datasets for Crowdsourced Audio Transcription
N Pavlichenko, I Stelmakh, D Ustalov
arXiv preprint arXiv:2107.01091, 2021
42021
VLDB 2021 Crowd Science Challenge on Aggregating Crowdsourced Audio Transcriptions
D Ustalov, N Pavlichenko, I Stelmakh, D Kuznetsov
Proceedings of the 2nd Crowd Science Workshop: Trust, Ethics, and Excellence …, 2021
22021
Cite-seeing and reviewing: A study on citation bias in peer review
I Stelmakh, C Rastogi, R Liu, S Chawla, F Echenique, NB Shah
arXiv preprint arXiv:2203.17239, 2022
12022
To ArXiv or not to ArXiv: A Study Quantifying Pros and Cons of Posting Preprints Online
C Rastogi, I Stelmakh, X Shen, M Meila, F Echenique, S Chawla, ...
arXiv preprint arXiv:2203.17259, 2022
12022
Towards Fair, Equitable, and Efficient Peer Review
I Stelmakh
Proceedings of the AAAI Conference on Artificial Intelligence 35 (18), 15736 …, 2021
12021
No Rose for MLE: Inadmissibility of MLE for Evaluation Aggregation Under Levels of Expertise
C Rastogi, I Stelmakh, N Shah, S Balakrishnan
2022 IEEE International Symposium on Information Theory (ISIT), 3168-3173, 2022
2022
ASQA: Factoid Questions Meet Long-Form Answers
I Stelmakh, Y Luan, B Dhingra, MW Chang
arXiv preprint arXiv:2204.06092, 2022
2022
Exploiting Ontological Knowledge in Crowdsourcing
G Strimel, I Stelmakh
The system can't perform the operation now. Try again later.
Articles 1–15