Yahoo Pipes for China and Chinese
First, I just want to say that Yahoo Pipes is going to be the internet technology of 2007. This way I’ll have bragging rights on New Year’s Day 2008 when I’m right and can link back to this post.
What is Yahoo Pipes? If you have used Unix, Linux or the terminal in Mac OS X, then you’ll probably be familiar with the idea of pipes, ie., “|” on the command line. Well, it’s basically the same idea, but for the internet. If you’re going “Huh?” then I suggest you just go to the website and look at the examples of all the different and wicked cool ways in which this brand spanking new technology is already being used.
For China-based users, Yahoo Pipes provides yet another way to get around the GFW. For example, you can use Yahoo Pipes to create RSS feeds that aren’t subject to the GFW. For example, all blogs hosted on WordPress.com, as well as their feeds, are blocked in China, which of course includes this blog you are reading right now.
Yahoo Pipes, however, is not blocked in China, and probably never will be since it is primarily a technical service, not a content providing service. Thus, by piping a feed through Yahoo Pipes one can get around the GFW. As an example, have a look at The Weifang Radish Piped Feed on Yahoo Pipes. You can even subscribe to this feed. One downside to this though is that the feed only contains about the first 300 characters, or approximately 50 words, of a post. There might be a way to change this, but I haven’t found it yet, or maybe this functionality will be added in the future.
Note: The Feedburner feed to this blog is not blocked in China and contains the entirety of each post. If you live in China and enjoy this blog it would make more sense to subscribe to the Feedburner feed instead.
But here’s an even better use for Yahoo Pipes. Two Fish is a WordPress.com hosted blog kept by an Asian-American academic who writes interesting posts on China, among other things. Unfortunately, the author of Two Fish has not created a Feedburner feed. Actually, in theory anyone could create their own Feedburner feed for Two Fish for their own use if they wanted to read it in China, but I have tried this in the past and found that, for whatever reason, when burning a feed for a blog over which I do not have administrative control, I can not get the feed to work. This is probably just my own imbecility. Anyway, I did get it to work in Yahoo Pipes: view the Two Fish Piped Feed on Yahoo or subscribe to it via RSS.
Better still, but more complex, would be to use Pipes to create an on-the-fly glossary of new vocabulary for Chinese language articles. I don’t even know if this use of Yahoo Pipes is feasible yet, but it would be damned cool. Here’s an outline of my idea:
Input = Chinese language article.
Step 1: Query database of characters one definitely knows.
Step 2: Find all characters in article not already in database.
Step 3: Use online Chinese-English dictionary to make a glossary of characters not in database.
Output = article glossary containing: character - pinyin - English definition.
Pipes is what would link the steps together. You’d need different tools for each of the steps, like an online text file that you have (probably painstakingly) created for step 1, some sort of online file comparison tool for step 2, and of course an online Chinese-English dictionary for Step 3. Of course, this same thing could have been done before with a script and a similar set of tools, but Yahoo Pipes makes it easier for non-programmers like myself to create such a tool. Also, since all elements of this tool would be online you could use this tool from any internet connected computer. And most importantly, Yahoo Pipes makes it easy to share such a tool with people all over the world.
If you read this post and are inspired to flesh this idea out and get it working you can have the credit for being the über geek who got the coolest thing in CSL since pinyin working, but I want the credit for the idea. Seriously, this blog is protected under a Creative Commons license.
Tags Yahoo Pipes, China, Internet, Cool Idea, CSL
February 14, 2007 at 6:07 pm
Heh, amazing. I was just over at the Taiwanese http://blog.schee.info/ reading about the Pipes and playing with them, when I noticed your post about it.
It is something quite overwhelming. and the opportunities are endless. I like your idea (and previous method mentioned of learning Chinese). So, I agree, if people go beyond the scary technological interface, they will be able to find really neat things to do with this tool.
I just wonder what Yahoo gets from all this…
February 14, 2007 at 8:40 pm
I agree, it’s not readily apparent what Yahoo! gets from this at the moment, but I think this is going to turn out to be a huge deal and Yahoo! is going to find a way to monetize this and come out very well. So, here’s The Weifang Radish’s first stock recommendation: YHOO - Buy.
February 14, 2007 at 8:48 pm
Chinalyst users could make use of Yahoo Pipes too. One use would be to filter out blogs on the list they don’t like. Like this one. Heheheh. Just kidding.
February 16, 2007 at 12:59 am
Great post!
Thanks for the lead on this and Two Fish….
Lon
February 19, 2007 at 8:53 am
I have been trying to implement this, but so far can not figure out a way to “get into” the content of a feed item. Feeds can be analyzed and manipulated based on their content, but it seems that the content itself can not be manipulated, which I suppose makes sense, though it certainly limits the usefulness of Pipes.
May 8, 2007 at 11:07 pm
Kevin,
I also saw you wrote about it in Lorelle’s. Could you maybe explain to folks how to do what you’ve suggested with Chinalyst, and I’ll post it there. It’s another great implementation for this tool.
(BTW - Chinalyst’s recently popular is becoming very pop-oriented lately, eh?
I wonder what I can do to improve that… maybe add channels? )
May 9, 2007 at 7:41 am
This is now a tip on Chinalyst.
fiLi,
I have created a filter for Chinalyst’s Recently Popular content using Yahoo! Pipes. The filter removes any content from the Recently Popular feed that I already subscribe to individually, letting me focus on popular content that I don’t subscribe to and would therefore likely otherwise miss.
For example, I already subscribe to the China Law Blog feed, so I’ve filtered feed items from China Law Blog out of my Chinalyst Recently Popular Piped feed. I don’t, however, subscribe to Chinese in Vancouver, so items from this blog appear in my Chinalyst Piped feed.
Here is the permalink for my Piped feed:
http://pipes.yahoo.com/pipes/pipe.info?_id=RBUBVIbA2xGhShoqfOgC8A
People can view exactly how I created this filter from the above link, and can even clone the Pipe and edit it to be useful for themselves, as everyone’s list will be different.