View source for Grants:IdeaLab/Automatic article topic detection

{{Probox
<!-- briefly summarize your idea in a sentence below -->
|summary= Build a classifier that associates articles with WikiProjects.  This could be used to route new article drafts to people with the right subject matter expertise for review.  For example, English Wikipedia has different guidelines depending on topic.  See [[:en:Wikipedia:Notability (academics)]] for example.  
<!--(optional) add a username or email address that we can use to contact you below. For an email address, use {{@}} in place of "@", for example, yourname{{@}}yourdomain.com.-->
|contact= [[User:EpochFail]]
<!-- (optional) add a custom image to represent your idea below. Example: "File:MechaDuck.png" -->
|image=File:Revision Scoring as a Service logo.svg

<!-- ADDING ROLES
You can choose to add any of the following roles to your idea, if you know what kind of skills this idea will need! (Learn more at Grants:IdeaLab/Roles)
Add roles below using the following format: -->
|project_manager1=
|developer1=
|community_organizer1=
|researcher1=EpochFail
|designer1=
|advisor1=EpochFail
|volunteer1=

<!-- YOU DON'T NEED TO EDIT BETWEEN THESE LINES -->
|project=Automatic article topic detection
|creator=EpochFail
|timestamp=18:35, Monday, March 7, 2016 ([[UTC]])
|translations=Probox/Idealab/Content
|portal=Inspire Campaign
}}
<!-- YOU DON'T NEED TO EDIT BETWEEN THESE LINES -->

==Project idea==

===About the idea creator===
I'm a Senior Research Scientist at the Wikimedia Foundation. I've personally performed research studies around the retention of newcomers, the quality of new article creations, and the design of machine learning tools for supporting curation practices.

===What is the problem you're trying to solve?===
Right now, patrollers all read from the same new article queue when reviewing.  This requires patrollers to maintain a broad expertise in subject matter details and subject specific notability guidelines.  Further, many articles are not claimed by WikiProjects or the full set of WikiProjects that might claim them. 

===What is your solution?===
Develop an automated, machine learned classifier for general topic spaces (which roughly correspond to WikiProjects).  We can train the model on articles that have already been claimed or not by WikiProjects.  We can deploy the model using [[ORES]] to make it available to patrollers and other tool developers.  This would allow us to (1) route new article creations towards those with relevant expertise, (2) auto-tag new article creations for relevance to a particular WikiProject and (3) help WikiProjects discover old articles that have yet to be associated to their WikiProject. 

Such a model would have potentially broad ranging applications beyond the target of this idea proposal.  E.g. routing good-faith newcomers who tend to work in a certain topic area to WikiProjects and helping new WikiProjects bootstrap -- by allowing them to quickly identify the articles most closely related to their topic of interest.  If this model is highly accurate, it could also be used to identify new statements for Wikidata.

==Project goals==
# Build a high fitness article topic classification model
# Deploy model via ORES
# Re-engineer new article review to let patrollers filter by "predicted topic area"

__TOC__<!--please leave this here-->
==Get involved==
<!--In this section: other volunteers are welcome to join or endorse below - using the buttons in the infobox is the easiest way to add yourself to this section!.-->

===Participants===
<!-- Want to join this idea? Add your name by clicking the button in the infobox, or edit this section directly. -->
* The trick to getting this working in practice is to find a route which can obtain a consensus of editors. I suggest that one such route would be a tool to suggest a set of wikiprojects (and perhaps other tags such as <nowiki>{{Disambiguation}}</nowiki>) for a new article and allow new page patroller to add them with a single click.  [[User:Stuartyeates|Stuartyeates]] ([[User talk:Stuartyeates|talk]]) 02:11, 18 March 2016 (UTC)
**[[:en:User:AlexNewArtBot]]? [[User:Antigng|Antigng]] ([[User talk:Antigng|talk]]) 08:40, 18 March 2016 (UTC)

===Endorsements===
<!-- Want to endorse this as a good idea? Add your name by clicking the button in the infobox, or edit this section directly. -->
[[User:Smallbones|Smallbones]] ([[User talk:Smallbones|talk]]) 20:20, 22 March 2016 (UTC)
*I'm against general topic spaces next to WikiProjects - imo all sufficiently notable/large/general/... topic spaces should become WikiProjects. This automated topic detector could be used as a suggestor for a) article categories and b) WikiProjects. Instead of adding either straight away it adds these suggestions so that human editors can check them and add the categories & WikiProjects if appropriate. I think this is a great idea and one of many to implement if one would like to utilize the tremendous potential the WikiProjects (aka general topic spaces) have in fostering more and better edits (saying more [active] newcomers & experts; better choice of articles to edit by all editors). [[en:WP:Wikipedia:WikiProject X|WikiProject X]] might also be interested in this. [[User:Fixuture|Fixuture]] ([[User talk:Fixuture|talk]]) 22:54, 29 March 2016 (UTC)

==Expand your idea==
<!-- We suggest you delete this button after you expand your idea. But you can delete it, and the whole section, at any time you like. -->
Do you want to submit your idea for funding from the Wikimedia Foundation? <div style="" class="wp-formsGadget mw-ui-button" data-mode="expand" data-type="IdeaLab">Expand your idea into a grant proposal</div>

[[Category:IdeaLab/Ideas/Tools and technology]]