September 1968 | Technical Memorandum ERL TM ITS 144
A method of high precision arithmetic
Cite This Publication
Hiroshi Akima, “A method of high precision arithmetic,” Technical Memorandum ERL TM ITS 144, U.S. Department of Commerce, Environmental Science Services Administration, Institute for Telecommunication Sciences and Aeronomy, September 1968.
Hiroshi Akima
Abstract: A method of high precision arithmetic has been devised for the CDC-3800 computer based on nonstandard type. The precision extends up to 324 bits for normal arithmetic operations, and up to approximately 310 bits for exponentiation.
Disclaimer: Certain commercial equipment, components, and software may be identified in this report to specify adequately the technical aspects of the reported results. In no case does such identification imply recommendation or endorsement by the National Telecommunications and Information Administration, nor does it imply that the equipment or software identified is necessarily the best available for the particular application or uses.
For questions or information on this or any other NTIA scientific publication, contact the ITS Publications Office at ITSinfo@ntia.gov or 303-497-3572.