<html><head><meta http-equiv="Content-Type" content="text/html charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Hi Adam<div><br><div><div>On Oct 31, 2013, at 10:02 AM, Adam Peake <<a href="mailto:ajp@glocom.ac.jp">ajp@glocom.ac.jp</a>> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite">Did the MAG discuss the evaluation process and how to score? I know there were general baskets (diversity, relevance etc) but need consistency in responses. Example: how do you decide relevance, was there an agreed standard, was it discussed?<br></blockquote><div><br></div>As I recall there were several stages. First, after the Feb. consultation, a group of us got together under the baton of Mervi Kultamaa (govt. of Finland) and developed a couple page proposal with detailed criteria for evaluation. This included such innovations as saying the workshops had to actually be about Internet governance, have multiple perspectives, demographic diversity, etc. I think there was brief discussion on the MAG list with expressions of support but nothing too probing or sustained. Second, the secretariat later put up a form for workshop submissions that listed some of what we'd suggested, but not everything (unclear why). Members then ranked proposals and it turned out (in the view of many) that we were interpreting, applying, and balancing between the listed criteria differently. So there was a lot of discussion on how to recalibrate, treat different categories, handle the resulting numerical rankings, deal with organizers who submitted 10-18 separate proposals, etc. Third, we had a May meeting where the MAG went off into thematic break out groups to review workshops divided up by the main categories, and several of these groups came back to plenary and reported that they had added back in workshops that had fallen below the agreed numerical threshold (i.e. were rejected by the full MAG), for various reasons. There were multiple expressions of disquiet about this and other aspects of the process, as is reflected in the public transcript. There were also instances of lobbying for proposals, unfortunate. Under the difficult circumstances of a very compressed schedule, everyone was doing their best to get this right, but we didn't all view what was right in the same way. The eventual outcome was generally not bad and eventually most people I spoke with in Bali were largely happy with the quality of workshops selected, but of course the process was not pretty and there were some contestable rejections.</div><div><br></div><div>Subsequent to the May meeting, Fiona Alexander (govt. of US) offered to spearhead a new effort to sort out clear evaluation criteria, but this was launched pre-Bali when people were preoccupied so it seemed to engender some expressions of support but no broad group discussion. Hopefully we will return to the matter in January-February when people have more bandwidth and before the next F2F MAG meeting to probe deeper and get a stronger shared understanding of just how we're doing this next time, resulting in clearer than ever guidelines to organizers and evaluators alike. Hopefully too the "preliminary proposals" experiment will not be repeated.</div><div><br></div><div><blockquote type="cite"><br>BTW, a colleague at his first IGF found the number of tracks perfectly manageable.<br><br>I sat in on most of the main sessions, they were poorly attended. The surveillance session the last day was OK, even that fewer than you'd expect given the importance of the topic, and civil society participation was surprisingly weak, just a few questions/comments. <br></blockquote><div><br></div>I think there is a real question about what to do with the 'focus' sessions. Either we find new and enticing formats like debates, or we should consider dumping them. To the extent they're run like workshops, but peopled by the MAG rather than bottom up workshop organizers, it's not obvious what their distinctive added value is anymore.<br><blockquote type="cite"><br>Most of the transcripts are now online <<a href="http://www.intgovforum.org/cms/igf-2013-transcripts">http://www.intgovforum.org/cms/igf-2013-transcripts</a>> and video on YouTube, see IGF channel <<a href="http://www.youtube.com/user/igf/videos?shelf_index=0&view=0&sort=dd">http://www.youtube.com/user/igf/videos?shelf_index=0&view=0&sort=dd</a>> These were uploaded just about immediately after the session had ended, not sure that was well known.<br></blockquote><div><br></div>Define most. I was involved in 7 workshops, 1 of which is online. Video quality seems a bit variable. Things to work on. I assume the secretariat folks are all exhausted so maybe a little patience is merited.</div><div><br></div><div>Bill<br><blockquote type="cite"><br>Adam <br><br><br>On Oct 31, 2013, at 5:10 PM, William Drake wrote:<br><br><blockquote type="cite"><br>On Oct 30, 2013, at 5:19 PM, Jeanette Hofmann <<a href="mailto:jeanette@wzb.eu">jeanette@wzb.eu</a>> wrote:<br><br><blockquote type="cite">The MAG in its wisdom rejected at least two IPR related workshops. My workshop proposal addressed IPR enforcement and internet governance.<br></blockquote><br>I was puzzled by this but unable to get real clarity on the rankings done. It may be that there remains an aversion in some circles to discussing intellectual property issues in the IGF, which would be a pity.<br><br>Bill<br>____________________________________________________________<br>You received this message as a subscriber on the list:<br> <a href="mailto:governance@lists.igcaucus.org">governance@lists.igcaucus.org</a><br>To be removed from the list, visit:<br> <a href="http://www.igcaucus.org/unsubscribing">http://www.igcaucus.org/unsubscribing</a><br><br>For all other list information and functions, see:<br> <a href="http://lists.igcaucus.org/info/governance">http://lists.igcaucus.org/info/governance</a><br>To edit your profile and to find the IGC's charter, see:<br> <a href="http://www.igcaucus.org/">http://www.igcaucus.org/</a><br><br>Translate this email: <a href="http://translate.google.com/translate_t">http://translate.google.com/translate_t</a><br></blockquote><br><br>____________________________________________________________<br>You received this message as a subscriber on the list:<br> <a href="mailto:governance@lists.igcaucus.org">governance@lists.igcaucus.org</a><br>To be removed from the list, visit:<br> <a href="http://www.igcaucus.org/unsubscribing">http://www.igcaucus.org/unsubscribing</a><br><br>For all other list information and functions, see:<br> <a href="http://lists.igcaucus.org/info/governance">http://lists.igcaucus.org/info/governance</a><br>To edit your profile and to find the IGC's charter, see:<br> <a href="http://www.igcaucus.org/">http://www.igcaucus.org/</a><br><br>Translate this email: <a href="http://translate.google.com/translate_t">http://translate.google.com/translate_t</a><br></blockquote></div><br><div apple-content-edited="true">
<div style="color: rgb(0, 0, 0); font-family: Palatino; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div style="color: rgb(0, 0, 0); font-family: Palatino; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div style="color: rgb(0, 0, 0); font-family: Palatino; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">**********************************************************<br>William J. Drake<br>International Fellow & Lecturer<br> Media Change & Innovation Division, IPMZ<br> University of Zurich, Switzerland<br>Chair, Noncommercial Users Constituency, <br> ICANN, <a href="http://www.ncuc.org">www.ncuc.org</a><br><a href="mailto:william.drake@uzh.ch">william.drake@uzh.ch</a> (w), <a href="mailto:wjdrake@gmail.com">wjdrake@gmail.com</a> (h),<br> <a href="http://www.williamdrake.org">www.williamdrake.org</a><br>***********************************************************</div></div></div>
</div>
<br></div></body></html>