Syndication feeds: Difference between revisions

From Meta, a Wikimedia project coordination wiki
Content deleted Content added
→‎Visualization: Wikipedia visual aggregator experiment
No edit summary
 
(44 intermediate revisions by 32 users not shown)
Line 1: Line 1:
{{Soft redirect|[[w:Wikipedia:Syndication]]}}
<!-- align table of contents right -->
<table align="right" border="0" cellpadding="0"><tr><td>
__TOC__
</td></tr></table>

==Why==

In purging old comments, I found this one of the more compelling...
:As a casual browser to the site, I tend to visit here and get lost for hours clicking through the site; yet, I need "reminding" to come check what's new everyday -- and while I've cut-down on my "news" mailing lists become of spam-byproduct, now my rss feed reading is the bulk of where I check for online news; I beleieve both wikpedia and its audience would benefit from a "what's new on wikipedia today" feed. [[user:corqspy|corqspy]]

==Feeds Available from MediaWiki==

Formats: [[en:RSS (protocol)|RSS]], [[en:Atom (standard)|Atom (0.3)]]

===Recent changes===

*[http://meta.wikimedia.org/w/index.php?title=Special:Recentchanges&feed=rss rss]:
<nowiki>{{SERVER}}{{localurl:Special:Recentchanges|feed=rss}}</nowiki>
*[http://meta.wikimedia.org/w/index.php?title=Special:Recentchanges&feed=atom atom]:
<nowiki>{{SERVER}}{{localurl:Special:Recentchanges|feed=atom}}</nowiki>

===New Pages===

*[http://meta.wikimedia.org/w/index.php?title=Special:Newpages&feed=rss rss]:
<nowiki>{{SERVER}}{{localurl:Special:Newpages|feed=rss}}</nowiki>

*[http://meta.wikimedia.org/w/index.php?title=Special:Newpages&feed=atom atom]:
<nowiki>{{SERVER}}{{localurl:Special:Newpages|feed=atom}}</nowiki>


===Scraped feeds===

*English - see [[en:wikipedia:syndication]] (many, including announcements, current events, photo of the day, etc)
*Other Languages?

==Watchlist feeds==

Please, add any ideas or information which might help toward implementation! More discussion on the [[talk:syndication_feeds|talk page]].

===Existing Conversation===
*Bugzilla: [http://bugzilla.wikimedia.org/show_bug.cgi?id=208 Extension 208:] API for external access ( SOAP, XML-RPC, REST... )
*Bugzilla: [http://bugzilla.wikimedia.org/show_bug.cgi?id=471 Bug 471:] Basic XML Feed support for watchlist (implementation idea: token)
*Bugzilla: [http://bugzilla.wikimedia.org/show_bug.cgi?id=3646 Bug 3646:] Make MediaWiki more RSS friendly
*Old wikitech threads: [http://mail.wikipedia.org/pipermail/wikitech-l/2004-December/thread.html#26558 04dec], [http://mail.wikimedia.org/pipermail/wikitech-l/2005-September/thread.html#31577 05sep]

===Ideas and hacks===

#Shinobu claims to have hacked a VB app together accomplishing a similar task at [[en:User:Gerbrant/WikiCheck]] (untested).
#Any RSS reader with the ability to filter or sort incoming stories with rules would work to cut the global [http://en.wikipedia.org/w/wiki.phtml?title=Special:Recentchanges&feed=rss Recent changes feed] down to ones you are interested in.
##[http://www.cs.utexas.edu/~karu/gmailrss/ gmailrss] combined with gmails filters looks like it will do the trick. Once they are sorted, I can use gmail's RSS feed to monitor stories in my main RSS reader or forward relevant stories wherever. Any other rss readers with persistent filters/rules?
#Scrape recentchanges from irc.wikimedia.org and parse for topics ( [irc://irc.wikimedia.org/en.wikipedia #en.wikipedia], [[IRC_channels]] )
#<s>Scrape recentchanges from [[Realtime_recent_changes]] ...</s> (tool down)
#a [[User:Sylvain_Schmitz/Watchlist_RSS_feed_in_PHP|watchlist RSS feed in PHP]].
#IndyGreg's [[User:IndyGreg/WikiFeeds|WikiFeeds]] mediawiki extension (generates: Recent page changes; Newest pages; Recent changes by user; Newest pages by user; Recent changes for articles in a category; per user watchlst)
#[http://www.deheus.net/petrik/blog/post/68/| Another watchlist RSS feed, in Python]

== Article Feeds ==

Its surprising to me that there isn't an option to add rss output for any page in wikipedia or am I missing something.

:[[Special:Export]] already dumps the latest change to XML, but it isn't in an appropriate format for syndication. It's theoretically possible to massage the XML into the RSS or Atom format, though I have not yet seen a working implementation. - [[User:Jredmond|jredmond]] 15:37, 20 January 2006 (UTC)

==Wishlist==
Wishlist:

*<nowiki>''minor=show|hide|only''</nowiki> - attribute to hide minor changes
*<nowiki>''lines=X''</nowiki> Add the first X lines of new articles / diffs for changed articles
*RSS Feed of my watchlists (This should solve the problem of multiple watchlists in different languages)
**( [[Syndication_feeds#Watchlist_feeds]] )
*Topic-based-watchlists. They will be created by feeds based on the links on single pages: <tt>FeedRDF.php?pages-that-are-linked-from=List_of_Foos</tt>. The merging of different topics can be done outside of the wikipedia-server with blog-techniques.
*feed of edits by certain users. in order to watch interesting users

(contribs by [[User:Nichtich|Nichtich]], [[user:MyRedDice]], [[user:here|Here]])

* it would be nice to make an RSS of "wanted pages" to stimulate getting those pages written.

== Considerations ==
===Privacy===
*A public watchlist toggle should be available regardless, (and export OPML, when available)
**More complexity is possible here
*Authentication required if watchlists toggled private.
**With user authentication, or are watchlists to be considered public, so you could show anyone your watchlist?
**Well... both! I prefer my private watchlist to be hidden so this requires a concept of user authentification. <tt>https://user:pw@en.wikipedia.org/w/FeedRDF.php?watchlist=user</tt> should work. If there is a make-my-watchtlist-public-flag you will be able to create topic-based watchlists with user-accounts especially created for this purpose... but Wait! I better like:
***For what it's worth, this user:pw@host scheme is not standard HTTP, and is not supported by Internet Explorer anymore for security reasons. --[[User:IlyaHaykinson|Ilya]] 20:42, 3 Aug 2004 (UTC)
***So: <tt>https://en.wikipedia.org/w/FeedRDF.php?watchlist=user&pw=password</tt>

===Performance===
Creating RSS (or other) feeds for the site would mean that thousands of requests would happen on the hour, every hour, driving the site performance further down. --[[User:IlyaHaykinson|Ilya]] 20:42, 3 Aug 2004 (UTC)
:Creating the feeds from a mirror only should help solving the problem -- [[User:Nichtich|Nichtich]]
:Or refresh RSS-feeds at specific intervals for caching(e.g. hourly), and block IP's that request a feed every minute (because it's not nessecary due to the refresh rate).

==Applications==

===Visualization===

Visualization of feeds should be interesting in order to let anyone see what he wants. Look at the following example: One square per item of feed. On color per keyword. Feeds are organized in matrix. The newest is in the upper left corner of each matrix. The oldest is down on the right.

* All Yahoo higtech news in a matrix : http://yann.x-arn.org/rssgp/Yahoo
* A group working on many wikis : http://yann.x-arn.org/rssgp/Auteurs
* Matrix in a home page of a single wiki : http://notreconstitution.net
* Wikipedia visual aggregator experiment (French):http://wiki.km2.net/wakka.php?wiki=VeilleWikiPedia
.
If you need some help or want to participate to the development, please visit http://wiki.km2.net/wakka.php?wiki=AgregateurPoietique.

Tis project is also presented in [[Collaborative images]]

==See Also==

Meta
*[[:Category:MediaWiki tools]]
*[[:Category:Feature requests]]
*[[Help:Watching pages]]
*[[Wikipedians who blog]] has many community member feeds available.
*[[Worldwide Lexicon]] - syndication format (from old comment, is this relevant?)
*[[WikiFeeds]] - an alternative syndicated feed generator for MediaWiki. It supports ATOM 1.0 and watchlist feeds

En
*[[en:wikipedia_talk:syndication]]
*[[en:talk:RSS_(file_format)]]

De
*[[de:Diskussion:RSS]]

[[Category:MediaWiki_tools]]
[[Category:Feature requests|Syndication Feeds]]

Latest revision as of 03:07, 22 March 2023

This page has been moved.
The text of this page has been moved to: w:Wikipedia:Syndication.
If you found this page by following a link, please go back and update it, or notify an admin.