Copyright 2004 by M. Uli Kusterer Fri, 29 Nov -1901 11:00:00 GMT Comments on article blog-how-not-to-run-tests at Zathras.de http://www.zathras.de/angelweb/blog-how-not-to-run-tests.htm blog-how-not-to-run-tests Comments witness_dot_of_dot_teachtext_at_gmx_dot_net (M. Uli Kusterer) witness_dot_of_dot_teachtext_at_gmx_dot_net (M. Uli Kusterer) en-us Comment 7 by MidnightToker http://zathras.de/angelweb/blog-how-not-to-run-tests.htm#comment7 http://zathras.de/angelweb/blog-how-not-to-run-tests.htm#comment7 MidnightToker writes:
you might want to have a look at the following link for a nice comparisson.
http://www.anandtech.com/mac/showdoc.aspx?i=2685

They've also done a funky cool comparisson between apache/sql running on a range of linux boxes and then OSX -it shows some VERY interesting issues RE the Darwin kernel.
http://www.anandtech.com/mac/showdoc.aspx?i=2436 (and then part2:)
http://www.anandtech.com/mac/showdoc.aspx?i=2520
Comment 6 by Roland Fines http://zathras.de/angelweb/blog-how-not-to-run-tests.htm#comment6 http://zathras.de/angelweb/blog-how-not-to-run-tests.htm#comment6 Roland Fines writes:
I agree with Jon H.

The guy did a bunch of test with the computers he have, the tests are very interesting, and I'd rather have that than nothing. His conclusion is also perfectly correct, this machine could replace his G5 for development.

Although 512Mg would not support development very well. As a Java dev, only Netbeans runs on the Intel iMac (through Rosetta, Eclipse doesn't launch), and as soon as you start opening many java files, switching from an app to another is Pain. I just upgraded it to 1Gig, and it performs muuuch better now.
Comment 5 by Jon H http://zathras.de/angelweb/blog-how-not-to-run-tests.htm#comment5 http://zathras.de/angelweb/blog-how-not-to-run-tests.htm#comment5 You seem to be leaping to something's defense when no offense was offered. You're writing as if the comparison were done to "debunk" Apple's claims about the Intel Macs' performance.

What I see is someone doing an informal benchmark of their machines, out of personal curiosity, to get a general idea of how the two machines compare for the tasks he does. That's pretty natural for a geek to do. No points being scored, no aspersions being cast. No grand, sweeping conclusions being offered.
Comment 4 by Sam Pullara http://zathras.de/angelweb/blog-how-not-to-run-tests.htm#comment4 http://zathras.de/angelweb/blog-how-not-to-run-tests.htm#comment4 Sam Pullara writes:
... As I stated in the comment to your comment the iMac was not swapping during the tests. If it were you would get extremely poor performance and would definitely not beat a dual 2.5 ghz G5.

... It is straight forward comparison between two systems. If you don't care about performing these tasks on these 2 systems its not interesting to you.

... The comparison is between tasks being done on the two machines. A user doesn't care if a task takes longer on one because of RISC vs. CISC or whatever. Just that one does the equivalent task faster.

I still get the feeling that you don't understand the results at all and don't see that the "low-end iMac" trounces the "high-end PowerMac" in almost every test. There are only a few PowerMacs that are faster than this one. 1) the new dual core 2.5 ghz G5 (only slightly), 2) the old dual proc 2.7 ghz G5, and 3) the 2.5 ghz Quad G5.

So in summary, I am not doing a detailed comparison of the hardware. I'm testing two development systems and comparing how well they perform some fairly typical developer tasks. If this isn't the kind of thing you would have me test, what would be?
Comment 3 by Mike Zornek http://zathras.de/angelweb/blog-how-not-to-run-tests.htm#comment3 http://zathras.de/angelweb/blog-how-not-to-run-tests.htm#comment3 Mike Zornek writes:
Yeah, I didn't take it very seriously.
Comment 2 by Aaron Ballman http://zathras.de/angelweb/blog-how-not-to-run-tests.htm#comment2 http://zathras.de/angelweb/blog-how-not-to-run-tests.htm#comment2 Aaron Ballman writes:
Yeah, it's apples and oranges (pun only slightly intended).

I've always been led to believe that SSE3 was on-par with AltiVec and that it was SSE2 that was lightyears behind the times. Have I been hearing wrong?
Comment 1 by weblog1@chucker.rasdi.net http://zathras.de/angelweb/blog-how-not-to-run-tests.htm#comment1 http://zathras.de/angelweb/blog-how-not-to-run-tests.htm#comment1
There is some merit to this, actually. Transcoding is one of the areas where AltiVec really helped out greatly and made a huge difference, and Intel's SSE3 simply can't compete. So, take the "yet" away from the sentence, and you vaguely have some truth in there.

Other than that, you are of course perfectly right. The two systems can't be reasonably compared at all.