Syndication feeds

From Meta, a Wikimedia project coordination wiki
This is an archived version of this page, as edited by OlivierAuber~metawiki (talk | contribs) at 21:49, 25 January 2006 (→‎Visualization: Wikipedia visual aggregator experiment). It may differ significantly from the current version.

Why

In purging old comments, I found this one of the more compelling...

As a casual browser to the site, I tend to visit here and get lost for hours clicking through the site; yet, I need "reminding" to come check what's new everyday -- and while I've cut-down on my "news" mailing lists become of spam-byproduct, now my rss feed reading is the bulk of where I check for online news; I beleieve both wikpedia and its audience would benefit from a "what's new on wikipedia today" feed. corqspy

Feeds Available from MediaWiki

Formats: RSS, Atom (0.3)

Recent changes

{{SERVER}}{{localurl:Special:Recentchanges|feed=rss}}

{{SERVER}}{{localurl:Special:Recentchanges|feed=atom}}

New Pages

{{SERVER}}{{localurl:Special:Newpages|feed=rss}}

{{SERVER}}{{localurl:Special:Newpages|feed=atom}}


Scraped feeds

  • English - see en:wikipedia:syndication (many, including announcements, current events, photo of the day, etc)
  • Other Languages?

Watchlist feeds

Please, add any ideas or information which might help toward implementation! More discussion on the talk page.

Existing Conversation

  • Bugzilla: Extension 208: API for external access ( SOAP, XML-RPC, REST... )
  • Bugzilla: Bug 471: Basic XML Feed support for watchlist (implementation idea: token)
  • Bugzilla: Bug 3646: Make MediaWiki more RSS friendly
  • Old wikitech threads: 04dec, 05sep

Ideas and hacks

  1. Shinobu claims to have hacked a VB app together accomplishing a similar task at en:User:Gerbrant/WikiCheck (untested).
  2. Any RSS reader with the ability to filter or sort incoming stories with rules would work to cut the global Recent changes feed down to ones you are interested in.
    1. gmailrss combined with gmails filters looks like it will do the trick. Once they are sorted, I can use gmail's RSS feed to monitor stories in my main RSS reader or forward relevant stories wherever. Any other rss readers with persistent filters/rules?
  3. Scrape recentchanges from irc.wikimedia.org and parse for topics ( #en.wikipedia, IRC_channels )
  4. Scrape recentchanges from Realtime_recent_changes ... (tool down)
  5. a watchlist RSS feed in PHP.
  6. IndyGreg's WikiFeeds mediawiki extension (generates: Recent page changes; Newest pages; Recent changes by user; Newest pages by user; Recent changes for articles in a category; per user watchlst)
  7. Another watchlist RSS feed, in Python

Article Feeds

Its surprising to me that there isn't an option to add rss output for any page in wikipedia or am I missing something.

Special:Export already dumps the latest change to XML, but it isn't in an appropriate format for syndication. It's theoretically possible to massage the XML into the RSS or Atom format, though I have not yet seen a working implementation. - jredmond 15:37, 20 January 2006 (UTC)[reply]

Wishlist

Wishlist:

  • ''minor=show|hide|only'' - attribute to hide minor changes
  • ''lines=X'' Add the first X lines of new articles / diffs for changed articles
  • RSS Feed of my watchlists (This should solve the problem of multiple watchlists in different languages)
  • Topic-based-watchlists. They will be created by feeds based on the links on single pages: FeedRDF.php?pages-that-are-linked-from=List_of_Foos. The merging of different topics can be done outside of the wikipedia-server with blog-techniques.
  • feed of edits by certain users. in order to watch interesting users

(contribs by Nichtich, user:MyRedDice, Here)

  • it would be nice to make an RSS of "wanted pages" to stimulate getting those pages written.

Considerations

Privacy

  • A public watchlist toggle should be available regardless, (and export OPML, when available)
    • More complexity is possible here
  • Authentication required if watchlists toggled private.
    • With user authentication, or are watchlists to be considered public, so you could show anyone your watchlist?
    • Well... both! I prefer my private watchlist to be hidden so this requires a concept of user authentification. https://user:pw@en.wikipedia.org/w/FeedRDF.php?watchlist=user should work. If there is a make-my-watchtlist-public-flag you will be able to create topic-based watchlists with user-accounts especially created for this purpose... but Wait! I better like:

Performance

Creating RSS (or other) feeds for the site would mean that thousands of requests would happen on the hour, every hour, driving the site performance further down. --Ilya 20:42, 3 Aug 2004 (UTC)

Creating the feeds from a mirror only should help solving the problem -- Nichtich
Or refresh RSS-feeds at specific intervals for caching(e.g. hourly), and block IP's that request a feed every minute (because it's not nessecary due to the refresh rate).

Applications

Visualization

Visualization of feeds should be interesting in order to let anyone see what he wants. Look at the following example: One square per item of feed. On color per keyword. Feeds are organized in matrix. The newest is in the upper left corner of each matrix. The oldest is down on the right.

. If you need some help or want to participate to the development, please visit http://wiki.km2.net/wakka.php?wiki=AgregateurPoietique.

Tis project is also presented in Collaborative images

See Also

Meta

En

De