×

Welcome to the Slashdot Beta site -- learn more here. Use the link in the footer or click here to return to the Classic version of Slashdot.

Thank you!

Before you choose to head back to the Classic look of the site, we'd appreciate it if you share your thoughts on the Beta; your feedback is what drives our ongoing development.

Beta is different and we value you taking the time to try it out. Please take a look at the changes we've made in Beta and  learn more about it. Thanks for reading, and for making the site better!

Firefox Plugin Annodex For Searching Audio, Video

timothy posted more than 9 years ago | from the well-lookie-and-hearie-here dept.

Media 129

loser in front of a computer writes "ZDNet Australia reports that 'Australia's CSIRO research organisation has developed a Firefox plugin named Annodex that allows browsing through time-continuous media such as audio and video in the same way that HTML allows browsing through text.' I've just checked Annodex out and it's very cool. The sample video from the Perl conference is way funny too." The catch is, the media to be searched has to be prepped first.

cancel ×
This is a preview of your comment

No Comment Title Entered

Anonymous Coward 1 minute ago

No Comment Entered

129 comments

astonishing (5, Funny)

rich42 (633659) | more than 9 years ago | (#11675971)

the implications for porn surfing are mind numbing.

Re:astonishing (0)

Anonymous Coward | more than 9 years ago | (#11675987)

I take it all the blood to your brain has gone elsewhere.

Re:astonishing (0, Redundant)

midianus (727997) | more than 9 years ago | (#11676020)

indeed, this is really cool though, I can now search for mp3's in html format! I wonder when the porn implemation for this kind of stuff will be made.

Re:astonishing (0)

Anonymous Coward | more than 9 years ago | (#11676178)

Or wrist numbing!! I see a generation of RSI related issues ahead.

Re:astonishing (0)

Anonymous Coward | more than 9 years ago | (#11676196)

the implications for porn surfing are mind numbing.

surely you mean arm numbing?

Of course (4, Insightful)

shreevatsa (845645) | more than 9 years ago | (#11675976)

The catch is, the media to be searched has to be prepped first.
Isn't that obvious? It's too much to expect it to be able to search video without knowing what it is.

Re:Of course (2, Insightful)

jokumuu (831894) | more than 9 years ago | (#11676022)

well, to be revolutionary it would require that capability. As it is now, it is simply a toy to play around with and then forget about.

Re:Of course (5, Insightful)

bogado (25959) | more than 9 years ago | (#11676050)

You understand that to be able to search you must read the content before, right? Google does read all the pages to index them, this is a preprocessing stage. I don't see why this requirement is a impediment. Sure video processing is time consuming, but downloading videos are also time and bandwidth consuming, so in general searching videos is harder, much harder then text.

Re:Of course (1)

wdd1040 (640641) | more than 9 years ago | (#11676260)

But, when the time comes that bandwidth overshadows any realtime video bandwidth, video searching and viewing will become as ubiquitous as email and google now.

Re:Of course (2, Interesting)

bogado (25959) | more than 9 years ago | (#11677985)

Even if you have the largest bandwidth you can imagine, still local indexes are the way to go. I can't imagine any movie search engine that will not pre-process the movie info, to fit the data into an index first. This pre-processing could be made externally to aid the search engine, and keeped in a separate file with the metadata for the movie. (I din't read the article due to the slashdot effect, but I imagine this is something like that).

Re:Of course (1)

Koiu Lpoi (632570) | more than 9 years ago | (#11676085)

Exactly. However, this means a huge load of work for SOMEBODY or the entire community to watch every video and categorise it. Also, you'll need to make sure people read over submissions - it would be very easy (in a wikipedia sense) to simply put bogus information in.

I'll do this, who will take drama? (1)

RenHoek (101570) | more than 9 years ago | (#11676255)

Ok, I shall take Prometheun task on me to review all pron. So please snail mail all DVD's and other recordable media to me that contains it. I will send it back after I'm done with it..

/.ed?? (0, Troll)

xtracto (837672) | more than 9 years ago | (#11675978)

Already slashdotted? anyone got a mirror of annodex.net??

Not likely at currently then (5, Insightful)

jokumuu (831894) | more than 9 years ago | (#11675981)

If the media has to be specially prepared for this to work, I do not see this taking off currently until the search engine can do the prepping fast and simple from the orginal unprepped media.

Re:Not likely at currently then (2, Insightful)

Agret (752467) | more than 9 years ago | (#11676004)

How could a computer possibly work out what media is sports or music videos or anime or tv shows or whatever. We need a new format like WMV (It contains XML type things in it) with XML wrapped inside that can be extracted and read that contains proper Genre and Category and such. I think WMV has this but it's not compulsury and doesn't get used often. If these formats were to take off then I could see this happening.

Re:Not likely at currently then (5, Insightful)

luvirini (753157) | more than 9 years ago | (#11676018)

Yes indeed that is the core of the problem, in order to search something, the search algoritm has to understand the content to be searched.

Currently trying to get a computer to understand something in pictures, even less in motion pictures is very inaccurate and extremly prosessor intensive, unless one uses a really small subset(like fingerprint recognition)

Re:Not likely at currently then (0, Redundant)

Agret (752467) | more than 9 years ago | (#11676025)

I expect once we get quantum computing in 20 or so years this will solve the video problem ;)

Re:Not likely at currently then (1)

Koiu Lpoi (632570) | more than 9 years ago | (#11676101)

Precisely. However, I do remember computer face recognition software taking off not that long ago. It's entirely in the realm of possibility for a computer algorithm to understand things like movies, it's just going to be perpetually 15 years down the road, if you catch my meaning.

Re:Not likely at currently then (4, Interesting)

Anonymous Coward | more than 9 years ago | (#11676026)

How could a computer possibly work out what media is sports or music videos or anime or tv shows or whatever.
That sounds like a doctorate in the making... I'd anticipate an 80% hit rate in genre classification (at least) within 6 months of research, just given those sorts of categories. It's just image recogition and classification, really, but with a fscking huge dataset (which is a good thing).

Re:Not likely at currently then (1)

jokumuu (831894) | more than 9 years ago | (#11676156)

oh, I am sure google would hire anyone who got this recognition working with low enough prosessor requirement.

Re:Not likely at currently then (1)

Jagasian (129329) | more than 9 years ago | (#11677834)

You have got to be kidding me. Do you know anything about he current state of vision recognition? A picture containing a large red car and a large woman in a red dress are nearly identical to a computer. Facial recognition is easily defeated if the target people just slightly turn their face to the side or down or up.

Even voice recognition is still pretty bad. Say something with an accent, and you can forget about proper recognition, unless you spend huge effort tweaking the recognizer for each different accent and then tell it the accent you are using before hand.

Re:Not likely at currently then (1)

TheTimoo (658067) | more than 9 years ago | (#11676556)

From the Vorbis website:
Can I bundle Vorbis and another media type (like text lyrics or pictures) in the same file?

Yes. The Ogg container format was designed to allow different media types to be multiplexed together; Theora will be mixed with Vorbis audio in an Ogg container to encode movies.

--http://vorbis.com/faq.psp#container/ [vorbis.com]

Does that mean Ogg too can do what you're suggesting? Probably needs some work still, though.

MirrorDot (3, Insightful)

Agret (752467) | more than 9 years ago | (#11675993)

loser in front of a computer writes "ZDNet Australia reports that 'Australia's CSIRO research organisation has developed a Firefox plugin named Annodex [mirrordot.org] ? [google.com] that allows browsing through time-continuous media [mirrordot.org] ? [google.com] such as audio and video in the same way that HTML allows browsing through text.' I've just checked Annodex out and it's very cool. The sample video from the Perl conference is way funny too." The catch is, the media to be searched has to be prepped first [mirrordot.org] ? [google.com] ... Full Slashdot Story [mirrordot.org]

Read more... (4, Insightful)

MicroBerto (91055) | more than 9 years ago | (#11675999)

Unfortunately, in order to remain loyalty-free, it only supports Ogg Theora. How many of those videos do you see out there? I see none.

A cool application, nonetheless.

Re:Read more... (4, Interesting)

Agret (752467) | more than 9 years ago | (#11676010)

I got some Anime in ogg once. It was the Rurouni Kenshin OVA. It was such a wonderful format and I could switch between english/jap audio and subs just by right clicking a system tray icon.

I really wish the Anime community saw it as a viable format rather than using XVid and DivX for everything. OGG is beautiful.

Re:Read more... (4, Insightful)

phaxkolumbo (572192) | more than 9 years ago | (#11676084)

Now, I might be wrong, but chances are that what you got instead of Ogg Theora compressed files were Ogg Media Files [faireal.net] (.ogm).

OGM is a container format for audio/video that supports multiple subtitles (just like you mentioned) and multiple audio tracks. From what I personally know, the video is usually compressed with XviD and the audio with Ogg Vorbis.

(see also Matroska [matroska.org] which does the above, and more)

Re:Read more... (2, Insightful)

Buzzard2501 (834714) | more than 9 years ago | (#11676096)

That would be OGM + Ogg Vobis, not Ogg Theora. OGM is a video and audio container like AVI, while Ogg Theora is a video codec (based on VP3 IIRC)

Re:Read more... (2, Informative)

Agret (752467) | more than 9 years ago | (#11676204)

Ah yes my mistake. They are 250mb OGM files. Oh well it's still beautiful and should be employed as the Anime standard.

Re:Read more... (1)

iwan-nl (832236) | more than 9 years ago | (#11676104)

I really wish the Anime community saw it as a viable format rather than using XVid and DivX for everything. OGG is beautiful.

Sure, I too would love to see an open format like ogg hit the mainstream, but since CDRs can only hold 700 MB of data, I also want to use that space as efficient as possible. That means using the codec with the highest compression/quality ratio, which unfortunately is not free (as in speech).

as per your sig (0)

Anonymous Coward | more than 9 years ago | (#11677986)

...I also want to use that space as efficient as possible

Correction:
...I also want to use that space as efficiently as possible.

Don't fret though, most Americans (assuming you are a non-American trying to learn English, though I could be wrong) can't use adverbs either.

Re:Read more... (1)

Rendus (2430) | more than 9 years ago | (#11677174)

There are many containers (which is what your .ogm was, just a container) capable of holding multiple audio streams and soft subtitles.

Re:Read more... (3, Interesting)

Anonymous Coward | more than 9 years ago | (#11676017)

Well now this is just the thing to get more Ogg Theora videos out there. Annodex provides a reason that one would want to use Ogg.

Although I guess that might present a chicken/egg situation.

Re:Read more... (1)

sploo22 (748838) | more than 9 years ago | (#11676157)

Well, in my experience Theora's real strength is low-bitrate encoding. At rates where MPEG would just give up and encode big ugly 8x8 blocks, Theora gives you a very reasonable picture. I once tested and found I could get reasonble quality PDA-sized video at about 160k. Unfortunately, at higher bitrates it seems to really lag behing XviD in quality.

Re:Read more... (1)

FruitCak (56337) | more than 9 years ago | (#11676335)

Actually being one of the folks who have seen this and the production tools demoed and played with them (in the meeting room at work no less). I have to say its pretty cool.

And that is supports only ogg theora is a misnamona. The output video is an ogg container with xml packets and theora video interleaved in a format suitable for streaming. The source input video can be anything your system can play back and feed into the encoding/interleaving tools

Re:Read more... (1)

nessy (859582) | more than 9 years ago | (#11676824)

Annodex is a generic encapsulation format and allows for other codecs to be annotated and indexed, too. Also, with the support of media frameworks, authoring tools can transcode from any format to Ogg Theora and Ogg Vorbis.

I dunno (3, Insightful)

earthbound kid (859282) | more than 9 years ago | (#11676016)

Isn't the whole point of time-continuous media to watch it through a continued period of time? Putting hyperlinks into a video just turns your web browser into an improved version of the Sega CD or 3DO. I'll admit this technology has its place, but I wonder how big that place is...

Re:I dunno (0)

Anonymous Coward | more than 9 years ago | (#11676040)

I can easily forsee the EA grind-mart pushing out a remake of "Night Trap". God save us all.

Re:I dunno (1)

secretsquirel (805445) | more than 9 years ago | (#11676168)

I'm thinking hook it up to some digital turntables somehow and get a tight DJ that can use it to mix some crazy beats that might not have previously even been possible to do on-the-fly. In most other sound/video editing situations these would seem to be incredibly convenient and time saving. And thats without even taking into account the revolutionary impact this will have on pr0n watching!

Re:I dunno (1)

earthbound kid (859282) | more than 9 years ago | (#11677308)

People have been talking about making video turntables for years. If it was going to happen, we would have seen a successful example of it by now.

I think one problem is that with audio, it's easy to just fade one song into another, but with video, there's not as clear an equivalent.

What we need is a machine that automatically adds "star wipe" to every conceivable frame of video. Now that would be sweet.

interactive film (2, Interesting)

iddi (188484) | more than 9 years ago | (#11676036)

We're in Russia doing this for video and audio for years. Will not link to sample, as this is bandwidth consuming.

moreover (2, Interesting)

iddi (188484) | more than 9 years ago | (#11676070)

it can be prepped in realtime and published online along with the event and uses anything as output video format.

composition tools are not yet available for the general public.

Re:interactive film (0, Offtopic)

Koiu Lpoi (632570) | more than 9 years ago | (#11676091)

I bet back when you were Soviet Russia, the bandwidth consumed YOU.

there was no bandwidth a that time ;) (2, Funny)

iddi (188484) | more than 9 years ago | (#11676097)

there was no bandwidth a that time ;)

Re:there was no bandwidth a that time ;) (1)

Koiu Lpoi (632570) | more than 9 years ago | (#11676123)

And judging by your first post, there's no bandwidth now either. ;)

it is US that charges all inbound traffic (1)

iddi (188484) | more than 9 years ago | (#11676171)

it is US companies that charge other countries for all inbound traffic...

Re:interactive film (0)

Anonymous Coward | more than 9 years ago | (#11676823)

In Russia the videos search you.

Surely... (4, Informative)

FirienFirien (857374) | more than 9 years ago | (#11676047)

'Rewind' and 'fast-forward' already do this? "Time-continuous media" is odd in that it implies something like a stream, yet if the media has to be prepared first, it has to be a complete file. If I could reach the article (seems /. hosed their bandwidth?) I'd check up on this, but:

The only implication here is that you could skip past part of a stream that exists as a preprepared complete file at the other end (as opposed to radio, which is incomplete and not browsable); but I bet the prepped file is significantly bigger, and the time saved skipping over a boring section would be replaced by the time required to download the extra data.

Quicktime .mov files also play while still downloading, and work in more browsers than just Firefox; .mov has been around for a while, is already prepped, is easy to convert to with existing programs (free to download) and has various things like crossplatform compatibility.

Re:Surely... (1, Informative)

Anonymous Coward | more than 9 years ago | (#11676354)

Hi, the "preprepared complete file" is not significantly bigger at all. We store things in standard Ogg bitstream file, with an additional track (logical bitstream, in Ogg speak) to store the extra metadata (CMML) that we use to store the information about each clip. The CMML is absolutely tiny in comparison to the raw audio and video; for the videos we've got there as samples, the CMML consumes perhaps only a few kilobytes (out of maybe a dozen megabytes.)

We've designed Annodex and CMML with the Internet in mind, and have some mechanisms to keep it bandwidth-friendly. For example:

1. If you start playback at 5 minutes into the file, you don't play the first 5 minutes: the client sends the server timed URI [annodex.net] , and the server will start serving out the media from 5 minutes only.

2. You can retrieve only the CMML from the media by setting a HTTP header of "Accept: text/x-cmml" in the HTTP request. We already have a proof of concept [csiro.au] for search engines to use this, so they can search on the entire video (and create hyperlinks to the exact time points concerned -- no more scrubbing through an hour of video to get to the bits of information you were after!). The Firefox extension does this to grab the "table of contents" display from the server.

3. We've designed Annodex to be proxy-friendly, so that they can cache the audio and video, even for media that's served out at different times.

- Andre (one of the annodex.net developers)

Too bad that this idea is kinda already done (1)

Bob64 (844867) | more than 9 years ago | (#11676052)

What this plugin seems to do is already found in a DVD, except this adds search capabilites.

The search feature is kinda the only thing that is making this stand out, but since it only supports one format, and that the media seems to need to "manually" prepped is a huge drawback.

To sum it up, this plugin is basically: a table of contents, a closed caption text search, and the "scene select" menu in a DVD.

YAML (Yet Another Markup Language) (3, Insightful)

atomic noodle (814905) | more than 9 years ago | (#11676074)

Good to see this is open source and works with FireFox, but it's a shame they have to resort to marketing babble and buzzword bingo (see below) to get any media attention for their work. Basically this is YAML (Yet Another Markup Language). They're definitely not the first to do video indexing... search 'VAML', for example.

Project leader Dr Silvia Pfeiffer, says that the applications of Annodex(TM) are many and varied.

"Users are discouraged by the complexity of search for clips within vast online multimedia collections. They are demanding a technology that lets them actively search for content," says Dr Pfeiffer.

"Annodex(TM) and the standards behind it allow them to do just that - it will revolutionise the way we search for time-continuous data. Annodex(TM) also allows video content to be explored using any digitally networked device - including mobile phones, handheld PDAs and digital TV."

Besides entertainment, Annodex(TM) has many other practical applications such as searching medical information, environmental measurements and network load statistics - on demand."

The groundbreaking technology behind Annodex(TM) is known as Continuous Media Markup Language (CMML). CMML does for time-continuous media what HTML does for text. It allows the user to search, access, navigate and query.

Re:YAML (Yet Another Markup Language) (1)

nessy (859582) | more than 9 years ago | (#11677096)

Hmm, and the Web was Yet Another Hypertext System at the time. All technology has to prove its value.

Slashdotted...damn! (1, Interesting)

EzInKy (115248) | more than 9 years ago | (#11676078)

So can anybody tell me is this extension for the integrated Mozilla suite or is it only for the standalone browser Firefox?

Re:Slashdotted...damn! (1, Informative)

Anonymous Coward | more than 9 years ago | (#11676261)

The extension is currently only for Firefox. There's no technical reason stopping it from being used Mozilla though (we use Mozilla internally to do a lot of testing); it's only that Mozilla and Firefox extensions must be packaged slightly differently, and we haven't put the time into writing the required install.js script for Mozilla yet. (It's open-source remember, so feel free to contribute and send us patches!)

- Andre (one of the developers)

What is the innovation here? (3, Interesting)

sonamchauhan (587356) | more than 9 years ago | (#11676087)

How is this innovative above a DVD "jump to a scene" menu? (honest question)

I watched the video, but all it seems to be is a system of sectioning audio-visual files into smaller chunks, and a browser that gives access to a "table of contents" that lets the user jump directly to a section.

Is the sectioning/table-of-content-generation process automated? It seems to be manual.

I think software is already available that can partially automate the sectioning of a video. It does this by detecting scene-transitions, and then offering up the "chunks" to the user for approval and labelling. I think such software is used in DVD authoring for generating the "Jump to a Scene" DVD menu.

Re:What is the innovation here? (1, Interesting)

Anonymous Coward | more than 9 years ago | (#11676145)

One difference is, you can jump into a different video, on the same or a different server, not just other places in the same one.

Or you can search and get links directly into a specific position in a video. eg. With this search engine
http://labs.panopticsearch.com/search/sear ch.cgi?c ollection=labs.cmweb

The section/TOC generation is manual. However in theory it could be automated using scene-detection and speech to text. But you can consider that as part of the original authoring process.

Re:What is the innovation here? (1)

sonamchauhan (587356) | more than 9 years ago | (#11676486)

Thanks for the reply. Jumping between different streams on different servers is not very different from jumping between different streams on one disk (as in DVDs). Also, I recall Microsoft introducting a standard called web-DVD some years ago to increase the interactivity of DVDs and link them to online content.

Today, I can listen to streaming audio from an online radio station with Windows media player.
These stations already section their streams into songs. Media player lets me add individual songs from online stations to the "media library". In one playlist, I can have songs from multiple stations in any order. When I play the playlist, Media player fetches remote songs as appropriate. In other words, I can already seek between different online audio streams with Media player. I think Winamp may support similar functionality for video (it playlists support both audio and online TV stations)

Instead of having to prep and modify the media file (which may not be always possible) the table-of-contents/sectioning process can generate a seperate file containing _pointers_ to time offset positions within the media file. This would let a player seek to individual sections within a media file or stream without modifying the file or stream itself.

Re:What is the innovation here? (1)

sonamchauhan (587356) | more than 9 years ago | (#11676728)

I got this link [blinkx.tv] from the blinkx.tv site the responder above linked to:

On page 7:
Indexing

blinkx TV uses advanced indexing technology to watch, listen to, and read a video
or audio signal in real time to build a rich index that you can use to quickly locate
specific segments within the video content or audio clip. In turn blinkx TV stores
the information it extracts in metadata tracks in a video index. blinkx TV
automatically generates metadata tracks to save information generated by the
media analysis process. The information in all metadata tracks are time stamped
and synchronized with the associated digital video file.
i.e. Similar, but automated authoring of metadata stored seperate from the media clips.
(Makes sense - allows easy playback by users; also allows them to refine metadata while the media clips themself do not genreally change)

Best wishes.

Real innovation (2, Interesting)

montmorency77 (685021) | more than 9 years ago | (#11676166)

For proper search in rich media, check out a service like www.blinkx.tv, where the audio is transcibed. No reliance on meta-data, and the sectioning is also automated.

Re:Real innovation (1)

sonamchauhan (587356) | more than 9 years ago | (#11676386)

Wow - thanks for that ... it's a good link. They must have a *lot* of CPU horsepower dedicated to voice recognition to do straight audio transcription for so many channels.

I wonder what sort of arrangement Blinkx have with content providers in order for users to view content. I wonder if they also search the closed-captions/teletext as Google Video does. (About a year ago, I also intended doing [slashdot.org] something similar as a hobby project.)

Re:Real innovation (1)

Junta (36770) | more than 9 years ago | (#11677264)

That was hilarious, looking through some of their 'transcipts':
Weather report excertp:
I know this is the way this OS Linux agency lot of clout through northern parts and through eastern parts and you can see how this is this just pushing its weight and keeping eastern parts of Britain but there's no such plan through central and eastern parts he is going to be bringing a lot of snow
Anether except:
the coming into force this week in August tested in the courts they sit unworkable and unenforceable and that is Senator the papers in the Linux Hymon and Atticus of enemy is not found anywhere at eight fifteen what's coming up later this month it he finally asked if more than willing we're looking

I'm glad speech recognition has come so far...

Re:What is the innovation here? (1, Interesting)

Anonymous Coward | more than 9 years ago | (#11676400)

The innovation is more that we're going with the Web's model of finding information: i.e., hyperlinks. The capability for hyperlinking is sort-of present in lots of media formats, but we're really the first to advocate it as the future way of putting videos on the Web.

Additionally, the "freeform" annotation of the video serves very well for searching: it enables marking up a video in a way that's very meaningful for people. Try out the YAPC video on the example web there to see what I mean. The annotations are quite different from subtitles or closed captioning texts, and the hyperlinks allow you to dig deeper for information if you're interested in what the video is talking about. We're trying to make video a "first-class citizen" on the Web: when you can hyperlinking to specific time points inside video and out of the video to other Web content, video becomes part of the whole Web experience, rather than just a cool thing that you need to download some plugins to view.

This post [csiro.au] hits the nail on the head.

- Andre (one of the Annodex developers)

thats great! (1)

iddi (188484) | more than 9 years ago | (#11677451)

thats great,
we do similar things, but with proprietary technology...

actually our implementation of interactive films (or structured video) goes beyond that and allows to link video with any additional information type.

also we've explored back in 2001-2002 almost all the applications of this technology and made a bunch of samples of various kinds.

Re:What is the innovation here? (1)

nessy (859582) | more than 9 years ago | (#11676981)

Ever tried making your own DVD and publish it on a Web server with links to other Web content? This technology allows that sort of thing to happen, but with an open technology, not a proprietary solution.

Also, it is not actually creating smaller chunks from audio-visual files - the files stay intact! There is a separate language to create the markup (just like HTML for text pages) and once that is created, everything else is automated - also the table-of-content-generation process.

time-continuous media (1)

smallguy78 (775828) | more than 9 years ago | (#11676139)

A quick epistomological sidenote: what's the opposite of time-continuous media?! All media records an instance of time, whether it's 1 ms or 10 seconds.

Ok I'm being a pedantic asshole I admit it

Re:time-continuous media (1)

I(rispee_I(reme (310391) | more than 9 years ago | (#11676183)

I am not certain, but my best guess is that it's a buzzword. If I had to impose meaning on it, I'd do so like this:

Time-continuous media: television shows, movies, radio shows.

Non-time-continuous media: Paintings, photographs, books(?)

Re:time-continuous media (1)

fieldcomm (685891) | more than 9 years ago | (#11676229)

You haven't taken the time to look at Kant's Critique of Pure Reason have you?

Time is a function of our inner experience. To illustrate time in Space, the function of our outer experience, it must be represented on a line. I assume that this would change the direction of the line.

Imagine watching the a video normally is live following a vertical line, but you can only turn your head horizontally. You can't see where you've been or where you are going.

Turn the line on its side, so you can see all the scenes simultaneously, horizontally. Each scence cannot be in motion (because that is a function of a vertical movement) but you can see all scenes, for selection, at the same time.

It is basically like scene selection on your DVD.

Re:time-continuous media (1)

SkunkPussy (85271) | more than 9 years ago | (#11676441)

"A quick epistomological sidenote: what's the opposite of time-continuous media?! All media records an instance of time, whether it's 1 ms or 10 seconds."

An openoffice document does not record an instance of time, yet it is media. There is no specificity in time of an OO document and neither does it change over time.

Yes there is the instant the document was saved/created but this applies to all media, even video clips but has nothing to do with the media itself ("How longs the DVD? 24th April 2004 10:56:13" makes no sense).

And yes you are a pedant!

Firefox Plugins Links Thread (1, Informative)

Douglas Simmons (628988) | more than 9 years ago | (#11676162)

My favorite thing about stories like this is that creates fertile ground on which to find links for warez to enhance whatever the given program of discussion is. That is the purpose of this thread. Its secondary purpose is to give me some karma, as I am in a whorish mood.

Allow me to kick it off. The following are links for Firefox browsers only as they will install themselves automagically upon click. You've been warned. A couple of these, I forgot which, install links are for the MS Windows platforms since most of you suckers use Windows even though this site is about Linux leetness.

Autocopy [mozilla.org] saves you from having to hit ctrl+c to copy highlighted text, sort of like most remote terminal programs and irc clients
DictionarySearch [mozilla.org] will allow you get dictionary.com definitions in a new background tab by highlighting a word, right clicking it, and in the menu you can hit Dictionary Search for "triskaidekaphobia"
Adblock [mozilla.org]
should be self-explanatory.
This one [mozilla.org] will identify the current US Homeland Security terrorism threat level with a small colored box in the status bar (fun for showing off to get IE users to make the switch)
Stock ticker [mozilla.org] . When putting in your symbols, here are a few symbols for some indices: ^NDX (nasdaq), ^DJI (dow jones industrial average), ^GSPC for the S&P 500
LinkPreview [mozilla.org] will pop up thumbnail preview images [most of the time] when you mouseover a link. Frickin awesome. Requires restart.

Time to stop and hit submit before this article gets too many posts so that I may maximize karma intake :). Please reply with links to your own favorite plugins/extensions.

Yours, Douglas Simmons

Re:Firefox Plugins Links Thread (1)

spacefight (577141) | more than 9 years ago | (#11676227)

LinkPreview sounds interesting, but there is no documentation available over it on mozdev.org. Where did you get more information and that xpi link from? not much here... [mozdev.org]

Re:Firefox Plugins Links Thread (1)

Douglas Simmons (628988) | more than 9 years ago | (#11676332)

I had to google cache the thing and I eventually got it. Basically, when you load up a page, it checks in with alexa.com and collects any thumbnails the site may have of either the specific page you want to go to or at least the front index of the domain. I think it does this with links as soon as the page is loaded, but it might only do one at a time on the mouseover. To tweak its settings, like the thumbnail server and the thumbnail size, you go to Tools > Extensions > [select it and hit options].

While I'm in A HREF mode, bookmark this. [google.com] It brings you to google's image server (great for porn). Remember to go to advanced settings to turn off the safesearch filter and when searching for chicks click Large on the image size option first, if you're in a high-res mode that is.

Re:Firefox Plugins Links Thread (1, Informative)

Anonymous Coward | more than 9 years ago | (#11676228)

  • LinkPreview will pop up thumbnail preview images [most of the time] when you mouseover a link. Frickin awesome. Requires restart.

Your link is to an older version (1.2)

From the changelog:
  • 1.3 - Major bug fix (random Firefox crashes), many thanks to Mark.

So if you want to try it, better get 1.3: http://patsis.brownhost.com/hpxpi/linkpreview13.xp i [brownhost.com]

Re:Firefox Plugins Links Thread (1)

TheoGB (786170) | more than 9 years ago | (#11676345)

"most of you suckers use Windows even though this site is about Linux leetness"

Arse. Does that mean I have to leave now because Windows works on my PC?

Re:Firefox Plugins Links Thread (1)

dawnread (851254) | more than 9 years ago | (#11676446)

Thank-you, kind sir - a most excellent post, and bad karma to those who down-modded it!

Find every single Firefox extension in the world here [mozilla.org]

Re:Firefox Plugins Links Thread (1)

Douglas Simmons (628988) | more than 9 years ago | (#11676459)

Thanks. Actually, I was doing a little reverse psychology to get a helpful and not flagrantly trollish post in there that would ignite a relatively long thread yet get stapled with a -1 moderation.

You know, for the irony.

Legal implications? (2, Interesting)

Anonymous Cumshot (859434) | more than 9 years ago | (#11676211)

Are there any legal restrictions on the indexing of files? I can see a lot of companies becoming upset at having their media prepared in such a way..

Re:Legal implications? (1)

kegon (766647) | more than 9 years ago | (#11676737)

Are you suggesting there might be a law against you starting your CD from any position other than track 1, at the start ?! Or watching a DVD having skipped past the credits ?

Very unlikely IMHO

How it really works (5, Informative)

EEproms_Galore (755247) | more than 9 years ago | (#11676241)

Ive actually seen this in action and most of you are right off track. This isnt a streaming only format nore is it a DVD media replacement. It s a interactive web based media format. Imagine your watching a lecture and during the lecture lest say "Open Source" is mentioned. The author can put a pop up link in the video stream with "Learn more about Open Source" click on the link and you get a short video about open source then it goes back to the main lecture. No getting stuck having to pause the video stream while you look up a term.

it is already possible with quicktime... (1)

iddi (188484) | more than 9 years ago | (#11677369)

it is already possible with quicktime for many years... but there is no free wysiwyg tool to do that, however = you can do that with QuickTime API and then play movie with QuickTime Player...

Could be great for TV news (free and otherwise) (3, Interesting)

frostman (302143) | more than 9 years ago | (#11676391)

This could be really useful for TV broadcasts, particularly news.

I think anybody doing closed captioning [robson.org] already has the descriptive content they need. (Others could use a similar process to create it.)

That info, combined with relatively easily-detectable scene transitions, would make it possible to automate the searchable video file creation to a large extent.

So the CC or equivalent would still have to be done manually but you'd have this extremely useful, huge searchable archive of video.

Not so easy for things that depend on the visual content as opposed to the spoken content, but for news it could be amazing.

Then watch as politicians and captains of industry squirm [ntk.net] at the thought that their every word and twitch is available for searching...

Re:Could be great for TV news (free and otherwise) (0)

Anonymous Coward | more than 9 years ago | (#11676432)

You're right -- and the interesting thing is, most of the media production companies we've been talking to already have this sort of information (closed captioning, subtitles, general scene descriptions), etc. Most of that information simply gets lost when the video gets put online, but all the metadata is frequently stored in a big database. One great thing about Annodex is that the metadata language, CMML, is just XML, so it's very easy to pick up these big databases of information and make them useful for searching and video segmentation.

Where it starts becoming cool is when you have Web servers which can talk to the databases that generate the CMML on-the-fly, and from the CMML, dynamically compose the media on the fly! We have an Apache modules name mod_annodex that is already capable of dynamically composing the media (large parts of media.annodex.net are using that feature right now); it wouldn't be very hard to modify it so the CMML is pulled from a database of some sort, to make the entire process dynamic. It's the equivalent of PHP/Perl CGI, but for Theora+Vorbis rather than HTML.

- Andre (one of the Annodex developer)

All Hail the Abe Vigoda Status Plugin (1)

gelfling (6534) | more than 9 years ago | (#11676814)

https://addons.update.mozilla.org/extensions/morei nfo.php?application=firefox&version=1.0&os=Windows &id=451

SMIL already does this, and is widespread (2, Interesting)

maggard (5579) | more than 9 years ago | (#11677547)

Everything promised is already possible using the Synchronized Multimedia Integration Language (SMIL [w3.org] ) standard from W3C.

What's more SMIL is already [w3.org] supported by Quicktime, Real, MS Media Player, & MS Internet Explorer (& Firefox with some effort).

For platforms SMIL is available on Linux, Linux/PDA, Windows, Windows CE, MacOS, & MacOS X.

For content creation numerous SMIL tools are out there, inlcuding most industry standard ones.

For those curious here's a SMIL tutorial [empirenet.com] , in SMIL.

I must be missing something here... (1)

Jason Smith (3310) | more than 9 years ago | (#11678701)

I could swear I gave a talk on something very similar back in 2000 at ACM Hypertext. The OvalTine project at UNC (no, don't ask, it was a silly name) allowed a user to markup video by tracking faces/heads automatically from frame to frame, and attaching a URL to them once. (You could also attach URLs to any other object in the video stream, but the object tracker we had running best at that time was for heads.) Clicking on any object that was so tagged would pop up a browser window (or the appropriate application if it was a 'file:' URL opening a local document).

Since we did this in QuickTime, it also supported jumping within the video stream, or to other video streams via timecodes. The same file format is now MPEG-4... so why on earth didn't these folks just use that? That way, the link information is embedded directly in the movie file, no external files are necessary. They tend to get lost, after all. Any reasonable MPEG-4 player would then be able to be used, it would be using an open standard file format, and they would be showered with admiration for making the process much easier.

Or am I missing something critical?
Load More Comments
Slashdot Account

Need an Account?

Forgot your password?

Don't worry, we never post anything without your permission.

Submission Text Formatting Tips

We support a small subset of HTML, namely these tags:

  • b
  • i
  • p
  • br
  • a
  • ol
  • ul
  • li
  • dl
  • dt
  • dd
  • em
  • strong
  • tt
  • blockquote
  • div
  • quote
  • ecode

"ecode" can be used for code snippets, for example:

<ecode>    while(1) { do_something(); } </ecode>
Sign up for Slashdot Newsletters
Create a Slashdot Account

Loading...