Universal Code of Conduct/2021 consultations/Enforcement/Wikidata community/it

From Meta, a Wikimedia project coordination wiki
This is an archived version of this page, as edited by Sannita (WMF) (talk | contribs) at 16:31, 13 April 2021. It may differ significantly from the current version.

Questo è un riassunto generale della consultazione per la Fase 2 che è stata condotta su Wikidata nel primo trimestre 2021.

Introduzione a Wikidata

Wikidata started on October 29, 2012, and is the youngest Wikimedia project so far. It rapidly became one of the most edited Wikimedia projects, along with English Wikipedia and Wikimedia Commons. As of April 2, 2021, Wikidata has more than 93.2 million items and around 26.4k active users.[1]

As it is a multilingual project, editors come from many different backgrounds and geographical areas. English is the default language for basic communications among members, although all languages are theoretically eligible for communications: all of the important policies and guidelines and several of the community hubs are available in many languages. There are currently 62 administrators, 3 bureaucrats, 5 checkusers, plus several other classes of users with defined rights.

Sunto delle linee guida sul comportamento di Wikidata

During the years, Wikidata has established a code of very basic guidelines for behaviour on the project, mainly based on Wikipedia’s Five Pillars. The most important issues covered are deletions, blocks, personal attacks, assuming good faith, use of alternate accounts, and biographies of living people.

Given the particular nature of Wikidata, which is even more content-driven than other communities, this basic code proved more than sufficient to deal with virtually all problematic behaviours up until now.

All violations are dealt with on the Administrators’ noticeboard (for all «matters requiring administrator attention») or on the Requests for checkuser page (in case of abuse of multiple/alternate accounts). More broad issues are to be discussed through a request for comment.

In addition to the existing guidelines, Wikidata community produced two more pages: “Speaking rightly, acting rightly,” a general essay about how to behave politely (and how difficult sometimes this can be); and “Wikidata:Behavior norms,” an abandoned draft about which behaviours the community wants to see and which are to be shunned/banned from it.

La consultazione su Wikidata

The main hub for discussion on Wikidata was structured as a set of dedicated pages, with a general landing page that summarised the scope and the duration of the consultation, as well as the actions that every user could take during the period; a general discussion page, that worked as «the general space for discussion about the consultation»; and a FAQ page, that was adapted from Meta’s FAQ page to cover the needs of the Wikidata consultation in particular.

Most of the communications and solicitation of answers were conducted on wiki, through Wikidata’s Project Chat or user talks, and through the Wikidata mailing list. Only sporadically, communications also happened in the Wikidata unofficial Telegram channel and the Wikidata-related Facebook groups.

Throughout February, three different rounds of questions were held, each with a particular focus. From February 10 to February 28, a sitenotice was set up to advertise both the consultation and an online survey. A “gamified” version of the consultation, similar to the Italian initiative that was also launched in the same period.

The local consultation on Wikidata was officially closed on March 5, 2021. In total, 21 users participated in on-wiki discussions, while 5 others interacted off-wiki (e-mail, Telegram/Skype chats, Facebook comments). The online survey proved, by far, to be the most successful way of collecting feedback, with 337 individual responses (92.8% of the total feedback received).

Feedback della comunità

In breve

  • There was no clear consensus on preferring a “local” solution instead of a global solution. Generally speaking, it can be inferred that Wikidatans might prefer a solution that involves directly and transparently the community, but with a “fail-safe option” of recurring to an external “solution”, in case admins are involved.
  • It was more easy to observe consensual suggestions about the enforcement process, than about who should be in charge of it – the latter was a more polarising argument, considering also the considerations above.
  • The current reporting system on Wikidata is fairly working, but can be improved – especially in terms of visibility for users who are not expert in using Wikidata. There is reasonable consensus about establishing a private channel for reporting harassment and unwanted behaviour, but there is no clear consensus about who should be in charge of it.
  • Harassment that happens outside of the projects should be reported to the community or to the Foundation, but its eventual punishment might still depend on its severity and its potential link to on-wiki issues.

Feedback sulle modalità di applicazione

Riguardo l'attuale sistema di segnalazione

Wikidata is perceived as a welcoming community by those who provided feedback: of the 337 respondents to the survey, 196 (58.2%) stated they «suffered or witnessed any of the unacceptable behaviours listed in the Code of Conduct», but this number drops to 95 (28.2%) when interviewees answered about their experience on Wikidata.

Domanda No Totale
Have you ever suffered or witnessed any of the unacceptable behaviors listed in the Code of Conduct within the Wikimedia community? 196 (58.2%) 141 (41.8%) 337 (100%)
Have you ever suffered or witnessed any of the unacceptable behaviors listed in the Code of Conduct on Wikidata? 95 (28.2%) 242 (71.8%) 337 (100%)

However, the answers also clearly indicate that the current system for reporting harassment is simply unknown to many people: 51.6% of the people interviewed (189 out of 337) said they would not know «how to report such case(s) on Wikidata».

Domanda No Totale
If necessary, would you know how to report such case(s) on Wikidata? 148 (43.9%) 189 (56.1%) 337 (100%)

This was also echoed by a user during the on-wiki consultation:

Error: No text given for quotation (or equals sign used in the actual argument to an unnamed parameter)

— User:Mr_impossible

Moreover, of the 95 people who said they suffered or witnessed harassment on Wikidata, only 51 (53.7%) decided to go on and report it, either publicly or privately.

“If so, did you report such behavior in a project page, to an admin or to another user?”[2]
“Yes, publicly on a project page” 28 (35.4%)
“Yes, publicly or privately to an admin/user” 23 (29.1%)
“No, I decided not to report it” 28 (35.4%)
Total respondents 79 (100%)

Even though it is not possible to determine exactly why those reports did not follow through, some of the follow-up answers provide some interesting points to discuss (all quotes are from anonymous user answering the survey):

Error: No text given for quotation (or equals sign used in the actual argument to an unnamed parameter)

— Utente anonimo

Error: No text given for quotation (or equals sign used in the actual argument to an unnamed parameter)

— Utente anonimo

Error: No text given for quotation (or equals sign used in the actual argument to an unnamed parameter)

— Utente anonimo

Riguardo la possibilità di aggiungere una modalità riservata per migliorare l'attuale sistema di segnalazione

A private reporting tool was explicitly referred to as a possibility of enhancing the current reporting system on Wikidata. Most of the users who intervened, both on-wiki and off-wiki, seem to be in favour of the general idea, but differ – sometimes substantially – in its implementation.

More specifically, three of the four users who intervened on-wiki on the topic are open to set up «a complementary procedure» to report harassment privately. In the survey, of the 337 respondents, 195 (57.9%) agreed that «a private reporting method [would] be useful in addition to the existing (public) ones». It is worth noting, though, that 60 responders (17.8%) did not agree with the idea.

Domanda No Non so Totale
In your opinion, could a private reporting method be useful in addition to the existing (public) ones? 195 (57.9%) 60 (17.8%) 82 (24.3%) 337 (100%)

Using e-mails to report harassment was the main suggestion of the respondents. At least two of the users who interacted on-wiki referred to an e-mail address as a potential means for private communication, as well as 287 (85.2%) of the 337 respondents to the survey. The main suggestions coming from the survey ranged from using the native Special:EmailUser function, to establishing a separate e-mail account, to set up an OTRS-like system. Again, it is worth noting that a handful of survey participants (5, 1.5%) expressed their opposition to a private reporting system in itself.[3]

If there was consensus for a private reporting tool, it should be easy to use. Which tool do you think could be more apt?[4]
Special:EmailUser – Wikimedia’s function for sending emails 75 (22.3%)
A dedicated e-mail address to send reports to 113 (33.5%)
An OTRS-like service 99 (29.4%)
Other answers[5] 40 (11.9%)
“Non so” 10 (3.0%)
Total respondents 337 (100%)

About the functioning of the system, respondents’ answers were too much different among themselves to provide clear preferences. There is consensus, though, about a number of general principles, such as:

  • fairness in the investigation process;
  • clear definition of who is in charge of it;
  • transparency in the publication of the results;
  • possibility for the accused user to express and defend themselves.

These principles are echoed by interactions in the on-wiki consultation by two users

(1, 2):

Error: No text given for quotation (or equals sign used in the actual argument to an unnamed parameter)

— User:Donald Trung

Error: No text given for quotation (or equals sign used in the actual argument to an unnamed parameter)

— User:ChristianKl

On the contrary, one of the anonymous respondents to the survey was sufficiently clear about their opposition to set up a private reporting system:

Error: No text given for quotation (or equals sign used in the actual argument to an unnamed parameter)

— Utente anonimo

About cases of harassment that go beyond Wikimedia projects

If a Wikimedia user suffers harassment outside of the Wikimedia projects in relation to their Wikimedia work and/or affiliation, there is general consensus coming from the consultation that either the community and/or Trust & Safety should be notified of the fact. Of the 337 survey’s respondents, 162 people (48.1%) said the community should be notified, and 167 (49.6%) that T&S should be made aware of such unwanted behaviour.

“In your opinion, how can we intervene against or manage harassing behaviors that involve wikimedians, but happen outside of the Wikimedia community?”[4]
“The Wikimedia community should be notified about them” 162 (48.1%)
“The Trust & Safety Office should be notified about them” 167 (49.6%)
“They should be reported to the social network/platform administrators” 166 (49.3%)
Other answers[5] 74 (11.9%)
Total respondents 337 (100%)

However, no conclusive answer could be drawn about the effects of such reporting. This depends from a series of possible reasons, such as the severity of the offence and the lack of precise on-wiki rules about such cases. It should be also noted that there is a general unspoken view among Wikimedia users, that is well-summarised by this anonymous comment posted in the survey:

Error: No text given for quotation (or equals sign used in the actual argument to an unnamed parameter)

— Utente anonimo

Feedback sui responsabili dell'applicazione

Riguardo un organo locale di applicazione

The discussion about how to enforce the UCoC on Wikidata strangely did not see a lot of participation on-wiki, therefore large parts of the data in this section come from off-wiki discussions. In general, there is no clear-cut consensus about who should be dealing with UCoC violations. A general majority of survey respondents indicated a preference for a “local” solution, i.e. either by establishing a locally-elected enforcement body or by trusting Wikidata administrators of dealing with the violations. There was though a substantial minority of respondents that would prefer stewards or a global body to deal with them.

In your opinion, who should be in charge of handling reports and dealing with violations of the Code of Conduct on Wikidata?[4]
“gli amministratori di Wikidata ” 126 (37.4%)
“un gruppo locale di utenti, eletti dalla comunità di Wikidata ” 160 (47.5%)
“gli steward ” 72 (22.0%)
“un nuovo organo globale, che dovrà essere creato in seno alla comunità wikimediana ” 140 (41.5%)
altre risposte [5] 44 (13.0%)
totale risposte 337 (100%)

In the case «the violator is an admin on Wikidata», though, this ratio is slightly inverted: in this case, respondents made clear their preference for somebody else from outside the project to take care of the violation, in order to ensure neutrality in the decision.

In your opinion, who should be in charge of handling reports and dealing with violations of the Code of Conduct, if the violator is an admin on Wikidata?[4]
“gli altri amministratori di Wikidata ” 116 (34.4%)
“un gruppo locale di utenti, eletti dalla comunità di Wikidata ” 136 (40.4%)
“gli steward ” 100 (29.7%)
“un nuovo organo globale, che dovrà essere creato in seno alla comunità wikimediana ” 165 (49.0%)
totale risposte 337 (100%)

About the functioning of the enforcement body, conclusions are similar to those for the private reporting tool. In addition to those considerations, though, there was one more recurrent request among respondents: the body should be composed by people who are somewhat “professional”, or at least explicitly trained, in dealing with harassment. Some respondents were also worried about the potential inclusion of volunteers, due to the possibility of them shying away from the task.

A user, who asked to remain anonymous, outlined a couple more principles about such enforcement body, in a 1-on-1 private discussion:

Error: No text given for quotation (or equals sign used in the actual argument to an unnamed parameter)

— Utente anonimo

Probably the comment that sums up best all of the considerations above is the following:

Error: No text given for quotation (or equals sign used in the actual argument to an unnamed parameter)

— User:Romaine

Riguardo un potenziale organo globale di applicazione

The potential establishment of a global enforcement body to deal with violations of UCoC on Wikidata was thoroughly discussed in the survey and in some off-wiki private discussions. The results of the latter are generally coherent with the survey’s results, and relevant feedback on the matter is reported in the “Interesting ideas” section.

The questions about the global enforcement body can be divided into two groups. The first one is about some of the more general aspects, such as community decision on its establishment, definition of the body’s scope of action, and the possibility for all users to address the body regardless of language-based barriers. In two cases, users overwhelmingly stated their agreement with the statement they were presented: 286 users (89.9%) supported a very clear definition of the body’s scope of action; and 264 users (78.3%) concurred with the idea that it should be possible for all users to address such global body.

Also the idea that the global community should have the last word about the creation of the global enforcement body was fundamentally agreed upon, but it is noteworthy that its support was somewhat lower than the other two statements (209 users, 64.9%), while the minority expressing its disagreement was more marked than the other two cases (61 users, 18.1%).

Affermazione Non concordo Neutrale Concordo Totale
1 2 3 4 5
The decision to create this “enforcement body” must be approved by the global Wikimedia community 40 (11.9%) 21 (6.2%) 57 (16.9%) 80 (23.7%) 129 (41.2%) 337 (100%)
The scope of action of this “enforcement body” must be defined very clearly 17 (5.0%) 3 (0.9%) 31 (9.2%) 63 (23.7%) 223 (66.2%) 337 (100%)
It must be possible for every user to address such “enforcement body”, regardless of any language barrier 25 (7.4%) 11 (3.3%) 37 (11.0%) 52 (15.4%) 212 (62.9%) 337 (100%)

The second group of statements was composed by four different and competing affirmations, that were drafted to explore the various possibilities of the scope of action of such body, from including all of the Wikimedia projects, to including only those who do not have sufficient procedures, to other middle-ground possibilities. In all cases, opinions were far more polarised, and a substantial quantity of users chose to position themselves on a “neutral” stance.

The hypothesis relatively preferred by interviewees was to include all Wikimedia projects and communities within the scope of action of the (potential, yet-to-be-established) global enforcement body: 202 users (59.9%) expressed their agreement, while 85 (25.2%) disagreed with the idea. This seems to be coherent with the results scored by the second hypothesis presented, i.e. limiting the global body’s capabilities to «Wikimedia communities who do not have sufficient/proper established procedures»: in this case, opposing users are the majority (145 people, 43%), with a noteworthy minority of 108 users (32.1%) agreeing with the idea.

The last two statements, that basically deal with the idea of leaving the decision to the single communities about the adoption of the body, show even more polarisation: the idea of leaving out those community who do not wish such a body to be established was basically welcomed with a substantial tie between those in favour and those against (both groups account 133 users, 39.4%), with slightly more than a fifth of the interviewees choosing a neutral stance. The idea for larger communities to opt-in, on the other hand, receives a bit more of support (152 users, 45.1%), with still a substantial minority opposing the idea (96, 28.5%).

Domanda Non concordo Neutrale Concordo Totale
1 2 3 4 5
The scope of action of this “enforcement body” must include ALL of Wikimedia projects and communities 60 (17.8%) 25 (7.4%) 50 (14.8%) 52 (15.4%) 150 (44.5%) 337 (100%)
The scope of action of this “enforcement body” must include only Wikimedia communities who do not have sufficient/proper established procedures 88 (26.1%) 57 (16.9%) 84 (24.9%) 40 (11.9%) 68 (20.2%) 337 (100%)
The scope of action of this “enforcement body” must be limited only to the Wikimedia project or community who choose to establish it 84 (24.9%) 49 (14.5%) 71 (21.1%) 40 (11.9%) 93 (27.6%) 337 (100%)
Larger communities should have the possibility to opt-in the scope of action of such “enforcement body”, should there be consensus about it 64 (19.0%) 32 (9.5%) 89 (26.4%) 58 (17.2%) 94 (27.9%) 337 (100%)

Feedback sul supporto alle vittime di minacce o molestie

More concrete indications were given for the expected timings for dealing with harassment and other violations’ reports. Generally speaking, 72.7% of respondents to the survey clearly indicated their preference for a quick “initial response”: 110 people (out of 337, 32.6%) expressed a preference for being contacted within the first 24 hours, with an additional 135 (40.1%) who said that could “wait” up to three days from their initial report.

In your opinion, how long should it take to get you an initial message that your case has been taken into consideration?
“24 ore al massimo” 110 (32.6%)
“entro 1-3 giorni” 135 (40.1%)
“entro 3-5 giorni” 43 (12.8%)
“entro una settimana” 49 (14.5%)
totale risposte 337 (100%)

The trend is somewhat confirmed with the follow-up question about the timings to receive an update on reports: the majority of respondents (120, 35.6%) would wait up to a week, but there is an almost-equivalent number of person (123, 36.5%) who would like to receive an answer in a relatively shorter time.

In your opinion, how long should it take to receive an update on your report?
“entro 1-3 giorni” 62 (18.4%)
“entro 3-5 giorni” 61 (18.1%)
“entro una settimana” 120 (35.6%)
“entro due settimane” 94 (27.9%)
totale risposte 337 (100%)

Altri feedback interessanti

Among the very first comments about the UCoC text, there was an issue raised by a user about the fact that UCoC would forbid to raise the fact that a user might be in “conflict of interest” because of their ethnicity, if the user engages «in non-neutral editing of pages» that might be of importance for the ethnicity in case. The whole discussion was held on-wiki in January.

Error: No text given for quotation (or equals sign used in the actual argument to an unnamed parameter)

— User:ChristianKl

Despite the whole issue stemming from a personal interpretation of a portion of the UCoC, the point raised is definitely a tough one to be addressed, also because it might reverberate on content. While reflecting accurately the facts of the dispute is the most rational, most pillars-aligned, and most common answer, we might need to take into consideration that sometimes identification and/or belonging to a group does play a role in such discussions, and that stifling discussions on this point might be a mistake.

Statistiche sui partecipanti

The first main take from the consultation is, of course, the demographics breakdown. Of the 363 people who took part to the consultation, 239 of them (65.8%) self-identify as male, 41 (11.3%) as female, and 14 (3.9%) as “non-binary or other gender identities.” 69 more (19%) users declined to self-identify.

This breakdown, however, changes dramatically if we consider separately the survey and the other channels: the survey itself accounts for 337 of the 363 overall users reached – a staggering 92.8% of the overall feedback received. Even more interesting is the fact that, of the 26 users reached through the on-wiki pages and other channels (private mail, Telegram, Skype, or Facebook), only 3 of them self-identify as female, while the remaining 23 are all males.

Totale Uomini Donne Altro N/A
Consultazione su Wikidata 21 19 2
Altri mezzi di comunicazione 5 4 1
Sondaggio 337 216 38 14 69
Risposte complessive 363 239 41 14 69

The consultation saw a large participation of established users, especially on-wiki: almost all of the people who took part to the on-wiki consultation have contributed substantially to Wikidata; in addition, seven people who expressed their opinions (on-wiki or through private means) are administrators and one was also a bureaucrat; only two users were active since less than one year or had less than 500 edits. This was substantially confirmed in the survey: around half of the people who took it (164, 49.8%) revealed they have been active on Wikimedia projects for more than 10 years, while only 44 (13.4%) were active since less than a year.

Wikidata is also not necessarily the primary project of many of the people who intervened in the project – which is not surprising, given the peculiarity of the project. Of course, the project on which participants are more active is Wikipedia, followed by Wikidata and Wikimedia Commons. It is curious to note that the three projects are also the ones more edited in the community and arguably those more strictly connected to each other.

“Da quanti anni prendi parte ai progetti Wikimedia?”
più di 10 anni 164 (49.8%)
fra 5 e 10 anni 43 (13.1%)
fra 3 e 5 anni 36 (10.9%)
Between 1 and 3 years 42 (12.8%)
Less than 1 year 44 (13.4%)
Didn’t answer 8 (2.4%)
Total feedback from survey 337
How do you participate in Wikimedia projects?
As a registered user 221 (67.4%)
As an administrator 46 (14.0%)
As a member of other user groups 30 (9.1%)
As an unregistered user 31 (9.5%)
Didn’t answer 9 (2.7%)
Total feedback from survey 337
How many projects are you active on?[4]
Wikidata 259 (79.4%)
Wikipedia 295 (90.5%)
Wikimedia Commons 227 (69.6%)
Meta-Wiki 104 (31.9%)
Wiktionary 76 (23.3%)
Wikisource 66 (20.2%)
Wikiquote 39 (12.0%)
Wikibooks 37 (11.3%)
Wikivoyage 32 (9.8%)
Wikiversity 25 (7.7%)
Wikinews 24 (7.4%)
Wikispecies 24 (7.4%)
Didn’t answer 11 (3.6%)
Total feedback from survey 337

== Conclusions == The main data that stands out is the marked difference, both quantitatively and qualitatively, in turnout between the “public” on-wiki consultation, and the “private” off-wiki consultation. There is no conclusive evidence about the reasons of such difference – even if it might be safely assumed that the delicacy of the theme would require a more private, therefore “safe,” environment for the users to freely share their opinions. Apart from this, the Wikidata consultation was conducted in relative tranquility, and no major incidents were registered.

About the results of this consultation, it was more easy to observe consensual suggestions about the enforcement process, than about who should be in charge of it. The latter, as it would have been easy to guess, was a more polarising argument, mostly due to its potential effects on the internal equilibrium of the community. This is even more important in a multilingual community such as Wikidata, that also has to deal with the difficulty of describing the basic data about reality and its many manifestations.

There was no clear consensus on preferring a “local” solution instead of a global solution. Generally speaking, it can be inferred that Wikidatans might prefer a solution that involves directly and transparently the community, but with a “fail-safe option” of recurring to an external “solution”, in case admins are involved. It was even more complicated to outline any kind of consensus about a potential global enforcement body within the Wikimedia community: there is a slight preference for it to encompass all of the Wikimedia projects, but there is a consistent part of people who intervened who argue otherwise.

A more clear consensus was, instead, easy to find on the principles of such process, in particular fairness in investigation (providing also the possibility to the accused to share their point of view) and transparency to the community, which are clearly core principles of the larger Wikimedia community.

== References ==

  1. Statistics from Special:Statistics, last consulted on April 2, 2021. “Active users” are those users who have performed at least one action in the 30 days prior to April 2, 2021.
  2. This answer was optional and conditional to another question.
  3. These five users are grouped in the “Other answers” row in the table below.
  4. a b c d e Respondents could check more than one answer.
  5. a b c Respondents could provide personalised feedback. All answers that do not fit in the other fixed answers are collected here. Qualitative evaluation of such answers will be demanded to the Phase 2 drafting committee.