Home

XML File Corpus (back to pubs)

E-mail

This page provides hyperlinks to the XML binary formats, tools, and compressors described in the paper:

Chris Augeri^*, Barry Mullins, Dursun Bulutoglu, Rusty Baldwin, and Leemon Baird. “An analysis of XML compression and binary formats”, in Proceedings of the 1st Workshop on Experimental Computer Science (ExpCS), San Diego, CA, 13–14 June 2007. (pdf, slides, proceedings, conference)

DISCLAIMER: All links, sample usages, etc., were as used in the paper—please contact me if you have any questions.

• Pre-Processing Support Tools
• Compressors (XML & General Purpose)
• Test Corpus Files (see also the Calgary and Canterbury corpora)
• XML Links
• W3C standards
• Binary Characterization (XBC)
• Binary Optimized Packaging (XOP)
• Document Object Model (DOM)
• Efficient XML Interchange (EXI)
• Infoset
• WAP Binary XML Content Format  (WBXML) 
• IDEA Alliance
• XML.org
• Wikipedia
• Simple API for XML (SAX), also SAXON (2)
• XML Conference (& other XML conferences)
• XML Coverpages
• XML Journal (sys-con)
• Compression Links
• Compression Efficiency (the control metric we used, i.e., Equation 4)
• Burrows-Wheeler Transform
• Compression Links Info
• Data Compression Conference
• Data Compression Info
• Maximum Compression
• RFC 1951 (zip)
• Russian Compression
• XML Cover Pages
• Related Studies
• Greg Leighton’s bibliography
• M. Cokus and D. Winkowski. XML sizing and compression study for military wireless data. In Proceedings of the XML Conference and Exposition, Baltimore, MD, 2002.
• W. Ng, W. Lam, and J. Cheng. Comparative analysis of XML compression technologies. World Wide Web, 9(1):5–33, Kluwer Academic Publishers, March 2006.
• XML & Compression
• Experimental Computer Science Links
• Workshop on Experimental Computer Science (ExpCS)
• Workshop on Experimental Algorithms (WEA)
• Algorithm Engineering and Experiments (ALENEX, SIAM's site)
• Journal of Experimental Algorithmics (JEA, ACM)
• Experimental Computer Science: The Need for a Cultural Change [Dror Feitelson]
• A Theoretician's Guide to the Experimental Analysis of Algorithms, [David Johnson]

Support Tools

Tool	Output
Tidy	Clean up XML files
Meagher	Calculate 0-order entropy
CoLinux	Linux emulator, also 1, 2, 3
XML Stats	Reports various statistics, e.g., # lines, characters, etc.
The Wayback Machine	The internet archive, used to find a version of XML-ZIP
SAXON	XML Schema extractor
JMP	Statistical analysis
Gateway E-series 6300	The computer series used to run our tests

Compressors &/or Binary Formats

Compressor	Sample Usage(s)
BZIP2	BZIP2 -k -f -v foo.xml
CACM3	arith -e -t word -m 255 -c 20 foo.xml 1 > foo.cac
FIS, Sun, ASN.1	java -cp FastInfoset.jar com.sun.xml.fastinfoset.tools.XML_SAX_FI foo.xml foo.fis
Gzip (2)	GZIP -9 -c -f -v foo.xml 1>foo.gzp
PAQ	pasqda -7 foo.paq foo.xml
PPMd (Russian creator)	wzzip –ep foo.ppd foo.xml
PPMZ2	ppmz2 -e foo.xml foo.ppm
WBXML libwbxml Trantor kXML	xml2wbxml -k -o foo.wbx foo.tdy
WinZip (PPMd)	wzzip -en –ee foo.wzp foo.xml
XBIS	java -Dorg.xml.sax.driver=com.bluecast.xml.Piccolo -cp Piccolo.jar;saxxbis.jar;.; test.RunTest XBIS foo.xml
XGrind	./compress foo.tdy H V A N
XMill (1 2)	xmill -f -v -w foo.xml xmill -f -v -w -p "//(*)" foo.xml xmill –m 470 -9 -f -v -w foo.xml
XMLPPM	xmlppm foo.xml foo.xpm
XML-ZIP: no longer posted	java -classpath xml4j.jar;. XMLZip foo.xml 2
NOT TESTED (links added if available/provided &/or as time permits)
Efficient XML (basis of EXI), BOX, MPEG-7 (BiM), XML-Xpress, XCQ, XPRESS, OpenGIS BXML (CWXML), Oracle, IBM DB2, MS SQL Server, Millau, AXECHOP, XCOMP, XCpaqs, XCQ