A good judge will have tasted at least one or two of the “commercial examples” listed in the guidelines for every style available in their country, to give them some idea of what “good” really is. Good judges should not expect exact clones, but with experience it should become more and more apparent to the good judge which characteristics are crucial, which are optional, and which are uncharacteristic and thus not really desirable within a particular style.
Obviously, if I’ve never been to Czech Republic (for example, or wherever), I’m not going to be able to use the listed examples to bolster my qualifications, which admittedly puts me at a significant disadvantage compared with some other judges who HAVE been able to taste some of those. But where possible, good judges should strive to be tasting enough good examples, preferably those listed in the guidelines, to ensure they’re not missing something intangible that you just can’t pick out from reading the black & white guideline descriptions.
All that being said… there are good judges with less experience, and there are bad judges with a lot of experience, and good judges can have bad days, and everything else in between. Thus, every judging session & competition is always a crapshoot. Judging remains largely subjective, and prone to a thousand variables that will never be perfect. And I don’t know about you, but if I enter competitions, I don’t want AI judging beers for me either. The human touch is still superior, despite our “flaws”.
Regarding the OP’s second question about an intangible quality of having been “made in a factory”, I would argue that there might in fact be such a thing as the opposite, “homebrewed beer” flavors, kind of sort of. Not that commercial brewers never have off-flavors because of course they do! But there are common off-flavors that just seem to be much more common with homebrewers of any experience level (but mostly amateurs), versus commercial brewers who have been brewing a batch or two every single day for the past 10 years or whatever. And this fact, IF it is a fact, is OK. Homebrewers are definitely capable of brewing flawless beers, it’s something I’m sure we all strive for and it’s totally achievable, and not even super difficult (though a little bit of luck also can help). But by & large I do think commercial examples are relatively better on average than homebrews from an average brewer on an average day. People can hate me for this opinion, but it is MY opinion. And in truth I am likely wrong. And I’m OK with that.
As a judge, what do I expect from a 45- or 50-point example, if that’s what “made in a factory” is meant to imply? Well, it needs to be flawless. Does this mean it needs to taste like it was made in a commercial brewery? Well… maybe, kind of? But what it really means is that I can detect zero off-flavors, and it meets the style guidelines, and that I would want to buy a pint of this and would enjoy the whole pint and not just the first or second sip but then be done with it. I would love if all commercial beers were like this, but of course they are not all like this! There are plenty of commercial beers out there that I would NOT want to drink a whole pint of, sad but true. And there are certainly MILLIONS of commercial beers out there that if I judged in competition, I would probably only score them 25-30 points, sometimes less, sometimes much less.
So then, is “made in a factory” such a good thing?! Meh… the idea might be closer to meaningless. I dunno.
Great questions, fun to think about some more later if/when I have more time.
Cheers!