Syndication feeds: Difference between revisions

From Meta, a Wikimedia project coordination wiki
Content deleted Content added
No edit summary
Line 105: Line 105:
Examples:
Examples:


* All Yahoo higtech news in a matrix : http://yann.x-arn.org/rssgp/Yahoo
* Matrix in a home page of a single wiki : http://overcrowded.anoptique.org
* A group working on many wikis : http://yann.x-arn.org/rssgp/Auteurs
* Matrix in a home page of a single wiki : http://notreconstitution.net


* Wikipedia visual aggregator(Test 1) (French): http://anoptique.org/WikiPedia
* Wikipedia visual aggregator(Test 1) (French): http://anoptique.org/WikiPedia

Revision as of 15:47, 9 November 2006

Why

In purging old comments, I found this one of the more compelling...

As a casual browser to the site, I tend to visit here and get lost for hours clicking through the site; yet, I need "reminding" to come check what's new everyday -- and while I've cut-down on my "news" mailing lists because of spam-byproduct, now my rss feed reading is the bulk of where I check for online news; I believe both wikpedia and its audience would benefit from a "what's new on wikipedia today" feed. corqspy

Feeds Available from MediaWiki

Formats: RSS, Atom (0.3)

Recent changes

{{SERVER}}{{localurl:Special:Recentchanges|feed=rss}}

{{SERVER}}{{localurl:Special:Recentchanges|feed=atom}}

New Pages

{{SERVER}}{{localurl:Special:Newpages|feed=rss}}

{{SERVER}}{{localurl:Special:Newpages|feed=atom}}

History of a page

This is possible for every page. [MW1.7+]

{{SERVER}}{{localurl:{{FULLPAGENAME}}|action=history&feed=atom}}

Scraped feeds

  • English - see en:wikipedia:syndication (many, including announcements, current events, photo of the day, etc)
  • Other Languages?

Watchlist feeds

Please, add any ideas or information which might help toward implementation! More discussion on the talk page.

Existing Conversation

  • Bugzilla: Extension 208: API for external access ( SOAP, XML-RPC, REST... )
  • Bugzilla: Bug 471: Basic XML Feed support for watchlist (implementation idea: token)
  • Bugzilla: Bug 3646: Make MediaWiki more RSS friendly
  • Old wikitech threads: 04dec, 05sep

Ideas and hacks

  1. Shinobu claims to have hacked a VB app together accomplishing a similar task at en:User:Gerbrant/WikiCheck (untested).
  2. Any RSS reader with the ability to filter or sort incoming stories with rules would work to cut the global Recent changes feed down to ones you are interested in.
    1. gmailrss combined with gmails filters looks like it will do the trick. Once they are sorted, I can use gmail's RSS feed to monitor stories in my main RSS reader or forward relevant stories wherever. Any other rss readers with persistent filters/rules?
  3. Scrape recentchanges from irc.wikimedia.org and parse for topics ( #en.wikipedia, IRC_channels )
  4. Scrape recentchanges from Realtime_recent_changes ... (tool down)
  5. a watchlist RSS feed in PHP.
    1. A variant of the above that runs as a command-line script on the local machine. Requires a reader that can subscribe to local scripts (such as NetNewsWire).
  6. IndyGreg's WikiFeeds mediawiki extension (generates: Recent page changes; Newest pages; Recent changes by user; Newest pages by user; Recent changes for articles in a category; per user watchlst)
  7. Another watchlist RSS feed, in Python
  8. Journowiki has a special page Special:Syndicationfeed which allows category sorting of articles using AND, OR, and NOT to create custom feeds. Provides RSS/Atom.
  9. Watchlist RSS feed could contain HTML button for easy, one-click reverts from within your RSS reader.

Article Feeds

Its surprising to me that there isn't an option to add rss output for any page in wikipedia or am I missing something.

Special:Export already dumps the latest change to XML, but it isn't in an appropriate format for syndication. It's theoretically possible to massage the XML into the RSS or Atom format, though I have not yet seen a working implementation. - jredmond 15:37, 20 January 2006 (UTC)[reply]

Wishlist

Wishlist:

  • ''minor=show|hide|only'' - attribute to hide minor changes
  • ''lines=X'' Add the first X lines of new articles / diffs for changed articles
  • RSS Feed of my watchlists (This should solve the problem of multiple watchlists in different languages)
  • Topic-based-watchlists. They will be created by feeds based on the links on single pages: FeedRDF.php?pages-that-are-linked-from=List_of_Foos. The merging of different topics can be done outside of the wikipedia-server with blog-techniques.
  • feed of edits by certain users. in order to watch interesting users

(contribs by Nichtich, user:MyRedDice, Here)

  • it would be nice to make an RSS of "wanted pages" to stimulate getting those pages written.

Considerations

Privacy

  • A public watchlist toggle should be available regardless, (and export OPML, when available)
    • More complexity is possible here
  • Authentication required if watchlists toggled private.
    • With user authentication, or are watchlists to be considered public, so you could show anyone your watchlist?
    • Well... both! I prefer my private watchlist to be hidden so this requires a concept of user authentification. https://user:pw@en.wikipedia.org/w/FeedRDF.php?watchlist=user should work. If there is a make-my-watchtlist-public-flag you will be able to create topic-based watchlists with user-accounts especially created for this purpose... but Wait! I better like:

Performance

Creating RSS (or other) feeds for the site would mean that thousands of requests would happen on the hour, every hour, driving the site performance further down. --Ilya 20:42, 3 Aug 2004 (UTC)

Creating the feeds from a mirror only should help solving the problem -- Nichtich
Or refresh RSS-feeds at specific intervals for caching(e.g. hourly), and block IP's that request a feed every minute (because it's not nessecary due to the refresh rate).

Applications

Visualization

Visualization of feeds should be interesting in order to let anyone see what he wants. Look at the following example: One square per item of feed. On color per keyword. Feeds are organized in matrix. The newest is in the upper left corner of each matrix. The oldest is down on the right.

Examples:

Unfortunately there is to many items in the global wikipedia rss feed. This visual aggregator would be only usefull if Wikimedia decides to deliver Category Rss feed or Watchlist rss feed...

If you need some help or want to participate to the development (FreeArt Licence), please visit: http://anoptique.com.

This project is also presented in Collaborative images--OlivierAuber 22:31, 25 January 2006 (UTC)[reply]

See Also

Meta

En

De