From xemacs-m  Mon Dec  9 14:38:00 1996
Received: from altair.xemacs.org (steve@xemacs.miranova.com [206.190.83.19]) by xemacs.cs.uiuc.edu (8.8.3/8.8.3) with ESMTP id OAA20654 for <xemacs-beta@xemacs.org>; Mon, 9 Dec 1996 14:37:58 -0600 (CST)
Received: (from steve@localhost)
          by altair.xemacs.org (8.8.4/8.8.4)
	  id MAA07077; Mon, 9 Dec 1996 12:47:47 -0800
To: xemacs-beta@xemacs.org
Subject: Re: Benchmarking XEmacs versions (was Re: Additions to Shane Holder's bench.el)
References: <199612090006.SAA17017@xemacs.cs.uiuc.edu> <m2d8wkl6mt.fsf@altair.xemacs.org> <fawengzk0d7.fsf@mordor.rsn.hp.com>
X-Url: http://www.miranova.com/%7Esteve/
Mail-Copies-To: never
X-Face: #!T9!#9s-3o8)*uHlX{Ug[xW7E7Wr!*L46-OxqMu\xz23v|R9q}lH?cRS{rCNe^'[`^sr5"
 f8*@r4ipO6Jl!:Ccq<xoV[Qz2u8<8-+Vwf2gzJ44lf_/y9OaQ`@#Q65{U4/TC)i2`~/M&QI$X>p:9I
 OSS'2{-)-4wBnVeg0S\O4Al@)uC[pD|+
X-Attribution: sb
From: Steven L Baur <steve@miranova.com>
In-Reply-To: Shane Holder's message of 09 Dec 1996 13:01:56 -0600
Mime-Version: 1.0 (generated by tm-edit 7.95)
Content-Type: text/plain; charset=US-ASCII
Date: 09 Dec 1996 12:47:47 -0800
Message-ID: <m2iv6bcumk.fsf@altair.xemacs.org>
Lines: 111
X-Mailer: Red Gnus v0.72/XEmacs 20.0

Thanks for the update Shane.  Here are my results running the modified
benchmark.

Shane, it does not look like you disabled all the error checking that
is normally disabled in delivered XEmacsen.  Chuck and Martin could
you please comment on the Large File scrolling benchmark versus the
Tower of Hanoi?

System Info:
Linux 2.0.27/libc-5.4.16
i586 Pentium 200 (underclocked) 64MB RAM/#9 Motion 771 running in 24 bit
XFree86/3.2 (X11R6.1), S3 accelerated server.

Raw data first, normalized against Emacs 19.34 follows.

Emacs 19.34, Compiled -O4
Function Name  Call Count  Elapsed Time  Average Time
=============  ==========  ============  ============
bench-mark-1   3           3.5750560000  1.1916853333   <= Tower of Hanoi
bench-mark-2   3           10.973923000  3.6579743333   <= Font Lock
bench-mark-3   3           260.28409999  86.761366666   <= Large File scrolling
bench-mark-4   3           1.7101820000  0.5700606666   <= Frame Creation
bench-mark-5   3           3.5119459999  1.1706486666   <= Generate Words
bench-mark-6   3           35.120253999  11.706751333   <= Sort Buffer
bench-mark-7   3           94.105401999  31.368467333   <= Large File bytecompilation

XEmacs 19.14, Compiled -O4
Function Name  Call Count  Elapsed Time  Average Time
=============  ==========  ============  ============
bench-mark-1   3           21.941162999  7.3137209999   <= Tower of Hanoi
bench-mark-2   3           16.460605000  5.4868683333   <= Font Lock
bench-mark-3   3           261.27962599  87.093208666   <= Large File scrolling
bench-mark-4   3           0.4134230000  0.1378076666   <= Frame Creation
bench-mark-5   3           9.8724729999  3.2908243333   <= Generate Words
bench-mark-6   3           70.375302000  23.458434000   <= Sort Buffer
bench-mark-7   3           152.69138400  50.897128000   <= Large File bytecompilation

XEmacs 19.15-b3, Compiled -O2 -malign-jumps=2 -malign-loops=2
	-malign-functions=2 --debug=no --error-checking=none
Function Name  Call Count  Elapsed Time  Average Time
=============  ==========  ============  ============
bench-mark-1   3           21.921480000  7.3071600000   <= Tower of Hanoi
bench-mark-2   3           16.655683000  5.5518943333   <= Font Lock
bench-mark-3   3           264.61469400  88.204898000   <= Large File scrolling
bench-mark-4   3           0.4475469999  0.1491823333   <= Frame Creation
bench-mark-5   3           9.9660370000  3.3220123333   <= Generate Words
bench-mark-6   3           65.199291999  21.733097333   <= Sort Buffer
bench-mark-7   3           146.67362899  48.891209666   <= Large File bytecompilation

XEmacs 20.0-b31, Compiled -O2 -malign-jumps=2 -malign-loops=2
	-malign-functions=2, --with-mule=no --debug=no --error-checking=none
Function Name  Call Count  Elapsed Time  Average Time
=============  ==========  ============  ============
bench-mark-1   3           21.342905999  7.1143019999   <= Tower of Hanoi
bench-mark-2   3           16.606926000  5.5356420000   <= Font Lock
bench-mark-3   3           256.97769899  85.659232999   <= Large File scrolling
bench-mark-4   3           0.4356480000  0.1452160000   <= Frame Creation
bench-mark-5   3           9.3810909999  3.1270303333   <= Generate Words
bench-mark-6   3           69.306139000  23.102046333   <= Sort Buffer
bench-mark-7   3           167.68427999  55.894759999   <= Large File bytecompilation


Times normalized against Emacs 19.34.

			    Tower of Hanoi
Emacs 19.34		1.1916853333	1.0
XEmacs 19.14		7.3137209999	6.1
Emacs 19.15-b3		7.3071600000	6.1
XEmacs 20.0-b31		7.1143019999	6.0

			      Font Lock
Emacs 19.34		3.6579743333	1.0
XEmacs 19.14		5.4868683333	1.5
Emacs 19.15-b3		5.5518943333	1.5
XEmacs 20.0-b31		5.5356420000	1.5

			 Large File scrolling
Emacs 19.34		86.761366666	1.00
XEmacs 19.14		87.093208666	1.00
Emacs 19.15-b3		88.204898000	1.02
XEmacs 20.0-b31		85.659232999	0.99	<==== We win???

			    Frame Creation
Emacs 19.34		0.5700606666	1.00
XEmacs 19.14		0.1378076666	0.24
Emacs 19.15-b3		0.1491823333	0.26
XEmacs 20.0-b31		0.1452160000	0.25

			    Generate Words
Emacs 19.34		1.1706486666	1.0
XEmacs 19.14		3.2908243333	2.8
Emacs 19.15-b3		3.3220123333	2.8
XEmacs 20.0-b31		3.1270303333	2.7

			     Sort Buffer
Emacs 19.34		11.706751333	1.0
XEmacs 19.14		23.458434000	2.0
Emacs 19.15-b3		21.733097333	1.8
XEmacs 20.0-b31		23.102046333	2.0

		      Large File bytecompilation
Emacs 19.34		31.368467333	1.0
XEmacs 19.14		50.897128000	1.6
Emacs 19.15-b3		48.891209666	1.5
XEmacs 20.0-b31		55.894759999	1.8

-- 
steve@miranova.com baur
Unsolicited commercial e-mail will be billed at $250/message.
"Bill Clinton is a bore.  He doesn't have a creative bone in his
body."  -- David Brinkley

