@alxd This is a GREAT idea.
I co-ran a music festival that had an open call. We used google forms (yies, i know, I'd use Easy Chair now) and recruited a bunch of people to do peer review. Every submission got scored by 3 people on a few factors.
We also found systemic gender bias even when the identity of the submitter was hidden. It was a tech-focussed festival, but we needed to add a specific question to the reviewers about aesthetics, which was extremely helpful in addressing the bias.
Having only women judges would also have fixed the gender bias.
I think this is a great idea. I'd like to encourage you to avoid entrance fees.
Also, it is probably possible to find a gallery or arts org to partner with. This is a bit outside of my area, but maybe try Piksel?
@celesteh Thank you!
How did the systemic gender bias work with the author's gender hidden? Were the judges against "girlish" art?
@alxd in general, the submissions by men tended to talk more about technical aspects and ones by women tended to talk more about aesthetic approaches. Women reviewers tended to treat these approaches as equal where men tended to give too much weight to technical descriptions.
@alxd Finally, because concerts need to be "curated", we eliminated anyone below a certain score and then passed everyone to the concert programmers, who came up with themes and picked acts that fit them.
@alxd hi! My nonprofit, the Dream Foundry, ran an art contest last year and will be doing so again this year. I'd be happy to talk to you about it and answer specific questions - best way is definitely by email for me. Cislyn at gmail.
@cislyn can you link to your last contest? I'd love to see it!
The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!