×

Welcome to the Slashdot Beta site -- learn more here. Use the link in the footer or click here to return to the Classic version of Slashdot.

Thank you!

Before you choose to head back to the Classic look of the site, we'd appreciate it if you share your thoughts on the Beta; your feedback is what drives our ongoing development.

Beta is different and we value you taking the time to try it out. Please take a look at the changes we've made in Beta and  learn more about it. Thanks for reading, and for making the site better!

Phoronix Releases Linux Benchmarking Distribution

timothy posted more than 4 years ago | from the medium-infrastructure dept.

Operating Systems 31

Bitnit writes "Phoronix has released a major update to their automated Linux benchmarking software, the Phoronix Test Suite, and more interestingly they have released their own distribution that's designed for hardware testing and benchmarking on Linux. With PTS Desktop Live they provide this Linux distribution that's to run only from a live environment off a DVD / USB key and then allows their benchmarking software to run — and only that — on this standardized software stack, which makes hardware comparisons a lot easier."

cancel ×
This is a preview of your comment

No Comment Title Entered

Anonymous Coward 1 minute ago

No Comment Entered

31 comments

Problems... (2, Insightful)

Darkness404 (1287218) | more than 4 years ago | (#28940033)

A lot of speed issues have to do with drivers and not the actual hardware itself. I wonder if this takes that into the equation.

Re:Problems... (1)

TheRaven64 (641858) | more than 4 years ago | (#28955167)

Does it matter? As a user, I don't care if poor performance is caused by bad drivers or by bad hardware.

Re:Problems... (3, Insightful)

jd (1658) | more than 4 years ago | (#28964573)

Well, to an extent you do. A bad driver is much easier to upgrade/replace than bad hardware, especially if the hardware is built into the motherboard. In the case of audio (a classic Linux problem), if ALSA has a bad/missing driver you are still free to use OSS, and vice versa. If X has a bad video driver, there may be one in GGI or in the Linux framebuffer that you can use. On the other hand, if the chipset is crud, all the software options in the world won't help you.

I'm afraid! (5, Funny)

Parker Lewis (999165) | more than 4 years ago | (#28940081)

"The only required dependencies for the Phoronix Test Suite on Linux systems is PHP 5.x CLI"

Re:I'm afraid! (0)

Anonymous Coward | more than 4 years ago | (#28943325)

Did anyone see this [trollaxor.com]? What the fuck?

Errors on me when I run the gui (1)

ta bu shi da yu (687699) | more than 4 years ago | (#28940085)

chris@ubuntu:~$ phoronix-test-suite gui

Fatal error: Class 'GtkWindow' not found in /usr/share/phoronix-test-suite/pts-core/objects/gtk/pts_gtk_window.php on line 23

Not working too well... :(

Re:Errors on me when I run the gui (1, Funny)

Anonymous Coward | more than 4 years ago | (#28941447)

perhaps they could port to QT . . .

Re:Errors on me when I run the gui (1)

RalphSleigh (899929) | more than 4 years ago | (#28941509)

I think the PHP Gtk binding are still a compile from source mission on ubuntu, there was not a package available when I needed it a few weeks ago. Plus if you leave the module in your default php config, it breaks php (as in won't run even non Gtk scripts) whenever it it run from somewhere without a window manager available (ssh, cron, etc).

All in all a pain in the ass.

Re:Errors on me when I run the gui (1)

Kryai (976997) | more than 4 years ago | (#28963203)

I think the PHP Gtk binding are still a compile from source mission on ubuntu, there was not a package available when I needed it a few weeks ago. Plus if you leave the module in your default php config, it breaks php (as in won't run even non Gtk scripts) whenever it it run from somewhere without a window manager available (ssh, cron, etc).

All in all a pain in the ass.

I'm about to give up installing the requirements for a GUI on CentOS 5.3 trying to get php-gtk installed is quite the venture.

Wrong benchmarks (2, Interesting)

Anonymous Coward | more than 4 years ago | (#28940183)

While the suite is good for benchmarking regressions between kernel versions (across distros for example), it's not a very good distribution comparing tool in my opinion.

I'd like to see benchmarks such as:

* Time from bootloader to login window/desktop
* Time from desktop to webbrowser fully loaded Google or something
* Time it takes to open an Excel sheet with OpenOffice
* Amount of swap space used under normal desktop cirmumstances (some ~15 FF tabs, few sheets, docs, mail reader, etc)

It doesn't matter if it differs +-2 fps in some game, or a MB/s on storage throughput. It's the whole integration and system together that determines what the distribution is etc.

Re:Wrong benchmarks (3, Informative)

ta bu shi da yu (687699) | more than 4 years ago | (#28940319)

So what's stopping you? :-) They give instructions on how to do this here [phoronix-test-suite.com]. The only thing it probably won't do well is bootup testing, but then you probably want something like Bootchart for that.

Speed - running off the CD (1)

yossarianuk (1402187) | more than 4 years ago | (#28940199)

LiveCD/DVD's are always slower then a proper HD install.

Will this not make peoples bechmark results slower ? This would invalidate the benchmark results.

Re:Speed - running off the CD (5, Informative)

roger_that (24034) | more than 4 years ago | (#28940305)

Once the test is loaded, it runs from memory, and CD speed will not (should not) affect the test results.

Re:Speed - running off the CD (2, Insightful)

Aim Here (765712) | more than 4 years ago | (#28940419)

Why would it invalidate them? The results will be slower for everyone, since the LiveCD would standardise the software environment.

Anyways, it only matters if the suite reads from the disk during a test for some boneheaded reason.

VirtualBox (4, Funny)

owlman17 (871857) | more than 4 years ago | (#28940343)

Sounds great! I'll download it and try to run it in a VM.

Re:VirtualBox (0)

Anonymous Coward | more than 4 years ago | (#28940595)

Now there's a good idea. I mean, running in a VM wouldn't skew the results at all.

Re:VirtualBox (4, Insightful)

Cormacus (976625) | more than 4 years ago | (#28941287)

nooo . . . but it would give you an idea of how much of a performance hit you take when running in a VM. Which could be interesting in and of itself.

Re:VirtualBox (1)

geekboybt (866398) | more than 4 years ago | (#28943423)

That's the point, at least in my case. My Master's thesis/project involves benchmarking multiple VM systems - Xen, OpenVZ, and KVM. Unfortunately, VMware's out at this point due to licensing issues, though I'm probably going to run them anyway for my own personal use.

Re:VirtualBox (1)

atomic-penguin (100835) | more than 4 years ago | (#28945955)

Um, is there anything that explicitly prohibits you from benchmarking and publishing the results of performance on VMWare ESXi or GSX? Both of them are free downloads from vmware.com with a valid e-mail address.

Re:VirtualBox (1)

Bert64 (520050) | more than 4 years ago | (#28946321)

Yes, the license terms which you must agree to before you can go on with the download...

Re:VirtualBox (1)

atomic-penguin (100835) | more than 4 years ago | (#28947153)

Actual license terms verbiage:

You may use the Software to conduct internal performance testing and benchmarking studies, the results of which you (and not unauthorized third parties) may publish or publicly disseminate; provided that VMware has reviewed and approved of the methodology, assumptions and other parameters of the study. Please contact VMware at benchmark@vmware.com [mailto] to request such review.

To the parent poster, IANAL however, if nobody outside your University or dissertation committee ever even reviews your paper, that would certainly be acceptable use under these terms. Otherwise you can shoot them an e-mail, explain your situation and ask permission, you might even be surprised by the response.

Re:VirtualBox (2, Informative)

geekboybt (866398) | more than 4 years ago | (#28946941)

"You may use the Software to conduct internal performance testing and benchmarking studies, the results of which you (and not unauthorized third parties) may publish or publicly disseminate; provided that VMware has reviewed and approved of the methodology, assumptions and other parameters of the study. Please contact VMware at benchmark@vmware.com to request such review." From http://www.vmware.com/download/eula/server.html [vmware.com]

Re:VirtualBox (1)

atomic-penguin (100835) | more than 4 years ago | (#28949303)

So you e-mailed them at the given address, and they told you that you could not use VMWare benchmark results in your graduate dissertation?

Re:VirtualBox (0)

Anonymous Coward | more than 4 years ago | (#28946615)

ESXi is free, as well as Microsoft Hyper-V Server.

Both VMWare and Microsoft have free VMs.

Great! (4, Funny)

Simian Man (1472911) | more than 4 years ago | (#28940445)

Now anyone can conduct highly inaccurate bench-marking tests and publish the results every few months!

Phoronix == phoenix + moron (0)

Anonymous Coward | more than 4 years ago | (#28955409)

A moron that rises from the ashes every few months with a fucked up benchmark.

Re:Great! (0)

Anonymous Coward | more than 4 years ago | (#28984877)

True. Now we can see, how much the choice of file system effects on the mp3 encoding speed.

randallslagle (0, Troll)

pres211982 (1576391) | more than 4 years ago | (#28945593)

Its very interesting, coz the scores are totally different than operating system X in GUI mode or some thing. I have Imbenched operating system X before, in Graphic User Interface mode, and only the thing is how poor results are comparable to Linux on the same Hardware. http://www.randallslagle.com/ [randallslagle.com]
Check for New Comments
Slashdot Account

Need an Account?

Forgot your password?

Don't worry, we never post anything without your permission.

Submission Text Formatting Tips

We support a small subset of HTML, namely these tags:

  • b
  • i
  • p
  • br
  • a
  • ol
  • ul
  • li
  • dl
  • dt
  • dd
  • em
  • strong
  • tt
  • blockquote
  • div
  • quote
  • ecode

"ecode" can be used for code snippets, for example:

<ecode>    while(1) { do_something(); } </ecode>
Sign up for Slashdot Newsletters
Create a Slashdot Account

Loading...