And so that does raise the question, both in the old system and the new system, what is the incentive for a referee to write a good report?Okay, Jules, you're right.
But, some researchers looked at the rise of lawyers to the position of judge in South Carolina. Referees see people clad in red as more dominant.
In some journals it is, but in many journals it's not, and you definitely won't hear back about what the score for your referee report was, and therefore, there's also no formal expectation that you can have that you will be treated differently if you wrote a good report. But a lot of people do think implicitly that they will get rewarded for it.
You send the paper in, it goes for referee . The referee has a bunch of comments, and the good news is the editor says, "Please revise this paper along the referee 's comments and resubmit it," and then sends it back to the referee .
of the game whether the Blue Jays won or not somebody can say I learned about that player I didn't realize that he was a referee in high school when he played baseball something along those lines that make it something you retain after the game Eric Jerry Jerry what are the uh what are how you sounding like me up
Now, if in the course of trying to get it, you observe someone is guilty of a little bit too extra enthusiasm, like a knee in somebody's Just referee better. I don't think it's that hard.
And for some reason out of my mouth came I am a Jewish man. the referees , the downmarker guys, everybody would run off the field.
But that depends on asking regular academics like Jules and I to evaluate the paper and write what is called a referee 's report. There's essentially no compensation for writing those referees ' reports.
So it's enormously costly. To do a referee 's report with very little compensation. And so the question now is why do people do it?
This is all implicit. And so as a referee , you hope that if you write good reports, that the reputation that being a good referee gives you will give you some benefits.
Well, Jules, I think the following is almost certainly true, which is if you're a junior faculty member and you're not very well known, and you write a referee report that is deep and insightful, the editor is likely to remember that you're not a fool And if you're not a fool and you submit a paper, and he's thinking about which referee resources to use, he's gonna realize, "Well, look, there's some chance that this
I think most people wouldn't disagree with me on that. And so what a referee does is find ways to impress the editor without putting in as much effort as he would otherwise have to do.
And that has happened in referee reports. So what referee reports have become today are these lists of things that authors are expected to do and As I said, the acceptance rate of the Journal of Finance is 8%. The way it works is you don't send a paper in and it gets accepted.
comments and resubmit it," and then sends it back to the referee . If the referee doesn't say, "Okay, yes, he's addressed my concerns." You get a rejection. And we just said how important an acceptance is.
And that's an amazing segue into actually talking about the Global Goals World Cup. You're the referee tomorrow. What is it, and how does it help raise awareness to the Sustainable Development Goals specifically?
So I have a dream. will be as a referee , correcting in real time all the excess
You serve the team, and you're responsible for the team, and speaking with the team's voice, and representing the team, whether it's conversations with the referee , or the press, and even inside a team dynamic, between the coaches and the playing group, and between the playing group and the coaches. So very much serve all the different entities, and then my mindset's always been you're very much a first among equals.
And they want to make rules to make the game more interesting So, since there are changes in the rules every year Even the referee cannot keep up Everyone is having trouble with this The audience aren't sure what happens in games But it is something we cannot fix As mentioned by Mr. Sorimatsu earlier This goes with soccer too But there is a play that the player can control
And it was a matter of punching the telephone numbers to reply to the questions. worth to the referee .
Another explored a Latin American dictatorship through the eyes of student revolutionaries. These innovations-- using a referee , assigning players, individual characters, each who has their own unique objective, giving each person the freedom to do what they want-- these lit a fire in the Twin Cities gaming community.
And it gets down to the question of incentives. How incentivized are referees to do a good job? So their incentive is not to do a good job, but to impress the editor.
Yes. And why is that? It's because referees demand more and more and more and more irrelevant stuff to be put in the paper. So I have an interest in evolutionary psychology.
Cosmos but um so this is this is another map uh you know prior to peer review and um uh papers being um refereed you know con uh contrasting ideas and opposing ideas were often depicted uh in these maps and what you
And it was a matter of punching the telephone numbers to reply to the questions. There were no referees .
And it was a matter of punching the telephone numbers to reply to the questions. They're there as referees .
And so, for me also-- I mean, I've been married for a certain number of years, going up on 20 years now. The person who is refereeing the conversation-- who would be me-- makes sure the ground rules are set, that people understand the rules of the road in terms
And then of course, there's the very big piece which is, what's the incentive for the referee ? You're being asked to referee a paper. We can all agree that the compensation, the financial compensation that any person gets for refereeing a paper is nowhere near what the hourly rate would be if somebody
Most importantly, it's anonymous. The author never finds out who the referee is. So given that anonymity, you'd think there'd be even less incentives for anybody to either do a report or do a good job on the report.
will give you some benefits. But it is in no way - your referee report is never scored. In some journals it is, but in many journals it's not, and you definitely won't hear back about what the score for
otherwise have to do. What that invariably means is the referee finds low-hanging fruit in the paper, right? Small little things that are easy to find that he can ask the authors to do and that somehow convince the editor
But the really deep stuff he doesn't have to spend. And that has happened in referee reports. So what referee reports have become today are these lists of things that authors are expected to do and As I said, the acceptance rate of the Journal of Finance is 8%.
However, yeah, so I just have a degree that's an engineering degree. So you are now an ICC match referee . What else are you doing?
It means something to be biracial in the world. Because you become this kind of racial referee , and you're looking at the world sometimes very subjectively, but sometimes very objectively. And that is what fed the partnership, is having the same nomenclature about how we do process, or how we do comedy, the process of how we do comedy,
Dave Wesely, an undergraduate physics student at Saint Paul's Hamline University, unearthed the book in the University of Minnesota library and rediscovered the centuries-old idea of an all-powerful referee -- someone to sort of watch over the game and look at it and say, you know what? You've got it wrong.
And then if your friend or another referee says you didn't follow directions, guess what?
one snotty hotshot whined to our referee . 'These guys don't belong out here.' His team had just scored three goals in 15 minutes while dodging homicidal slide tackles, so
all of a sudden the referee calls a penalty and screams out intentional grounding friedman looks at the referee he says
issues and they have -- the -- the government referee -- the government is -- is not a player in the game, but a referee and they have to
sense, how many authors would admit that due to the refereeing process their paper got better, and how many of them would convincingly argue that due to the refereeing process their paper got strictly worse? And obviously, given the fact that so many resources go into the process itself, you would hope that there is some visible sign of the
they were given more penalties by the referees .
And this is true for both white referees and for African American referees .
Well, I don't know when they put it in, but that's the rule. It takes weight off the referees , of course, makes it easy. Now with replay they can get it right every single time, because they can-- but a fumble's a fumble.
anecdote about coaching girls' soccer or refereeing soccer.
You don't even know what the referees are going to be like.
articles on texts that our referees have read as our authors have read we get an article our referees read the article
The referee has a bunch of comments, and the good news is the editor says, "Please revise this paper along the referee 's comments and resubmit it," and then sends it back to the referee . If the referee doesn't say, "Okay, yes, he's addressed my concerns." You get a rejection.
And we just said how important an acceptance is. So you're forced to do whatever the referee wants, regardless of whether it makes any sense at all, regardless if there's a trade-off. Oftentimes it may make a little bit of sense, but it takes an enormous amount of effort, and nobody would ever make that trade-off, but you're forced to.
Oftentimes it may make a little bit of sense, but it takes an enormous amount of effort, and nobody would ever make that trade-off, but you're forced to. And then what happens is it goes back and the referee wants to impress the editor again, so they find a new problem. So often you can go two or three rounds with the referee , each time involving more work, which essentially means that there's a huge amount of wasted effort.
And then what happens is it goes back and the referee wants to impress the editor again, so they find a new problem. So often you can go two or three rounds with the referee , each time involving more work, which essentially means that there's a huge amount of wasted effort. So junior faculty especially spend an enormous amount of time, instead of doing new research, revising papers in ways that don't really improve the paper.
And we have a story on the first woman referee .