A Rundown on the History of Data Management

Thursday, August 13, 2015 by Jennifer Duits

It is easy in the data storage and data management world and say that it is constantly changing and the development of new technology is taking place everyday. Looking back at the history of data storage and data management I discovered that some of today’s “new” technologies had been around (or conceptually around) for a lot longer than I had thought. What has really changed is how we manage data.

The following graph is a representation of the large data storage events If I created this chart to depict market adoption, it would look much different. I’m not going to get into all of the details for each of these, only enough so you get a feel for the change over the years.

Mechanical Punch Card

Herman Hollerith invented the mechanical punch card in 1890. The company founded by Hollerith would eventually evolve into a small company called IBM. Punch cards were made of thick card stock with the dimensions equal to a bank note (7 3/8 inches wide by 3 ¼ inches high). The first major application of the punch card was for the tallying the 1890 census. Compared to doing the computations by hand, this was a huge advancement in terms of productivity and technological advancement. The 1890 Census only took one year to tabulate while the 1880 Census took eight. In order to use the card you needed a punch, a tabulating machine and a sorting machine; there was no use of an actual computer. The cards and machines evolved throughout the years, but when using punch cards, the equipment cost was high and the process for using the cards was very cumbersome. Writing the software programs and punching would take several months.

Magnetic Tape

Magnetic tape, the cold storage king, was invented in 1928 by Fritz Pfleumer. It was originally used to record audio and then expanded to storing data in 1951 with the invention of the UNISERVO I, the first digital tape recorder. The UNISERVO I was implemented in the UNIVAC I computer. The UNIVAC I had an operator console and up to 10 UNISERVO tape drives. The UNISERVO tape drives were able to provide both read and write functionality at a rate of 12.8 KBps and had a storage capacity up to 184 KB. Tape storage has come a long way since it was first invented. Modern, mainstream, tapes (LTO6) can store up to 2.5TB (6.25TB compressed) although there have been some breakthroughs that have gained up to 185TB on a single tape. If stored properly, tapes have a longevity that is difficult to beat.

Hard Disk Drive (HDD)With IBM ruling the computer market for most of the 1950s through the 1980s, it is no surprise that they were the ones to design and ship the first hard disk drive in 1956. The IBM 350 Disk File was designed to work with the IBM 305 RAMAC mainframe computer. This first hard drive weighed about 1 ton and stood almost 6 feet high. The IBM 350 Disk File was configured with 50 magnetic disks which contained 50,000 sectors and stored 3.75MB of data. The IBM 305 RAMAC mainframe computer combined with the IBM 350 Disk File allowed businesses to record and maintain data in real time. They also provided random access to any record and could simultaneously produce output via print or punched cards. This was a great advancement in technology and made data easier to access than ever before. The challenge with the first round of hard drives up to 1980 was the sheer size of the drive.

Virtualization

The first program, CP, which created virtual machines released to the public in 1968. Before its release in order to time share on a mainframe the resources including memory, disk space and CPU cycles, would have to be manually divided among users. Sharing of resources allowed each user to have its own operating system and share the overall resources on the mainframe. Ultimately, this made it easier to use and more secure. If a user experienced a crash, only their operating system would be affected and not the entire system. This first virtual machine is the basis for today’s hypervisor. VMWare, the current market leader in virtualization, started selling a product called Virtual Workstation in 1999 and launched into the enterprise marketing in 2001 with ESX Server and GSX Server. VMWare has continued to develop complementary products ever since

Solid State Drive (SSD)

The first solid state drive, Bulk Core, was introduced to the public in 1976 by Datram. It was sized very different from its modern predecessors measuring 19 inches wide by 15.75 inches tall and had a rack-mount chassis. Bulk Core could hold up to 8 memory boards with 256KB of RAM chips. The advantage back then was the relief from moving parts and you did not need constant power to retain your data. The technology behind the first SSD was the base for the modern SSDs which we know. SSDs as we know them today started shipping around 2001. Due to the lack of moving parts, manufacturers are able to shrink the size of the drive.

Software Defined Storage (SDS)

The concept of Software Defined Storage was born in the 1990s as a mechanism for common interoperability and manageability between hardware manufacturers within a network. In fear that SDS would remove the differentiators in the hardware, manufacturers held off on bringing it to market at this time. When virtualization took off so did the application demands of the hardware behind it. SDS was brought in to work with virtualization to manage hardware requirements and allocate the workload. With the addition of SDS data management has become more efficient. Not only is the managing of the data more efficient, but the use of hardware as well.

Cloud Storage

Although the idea of Cloud Storage was created somewhere in the 1960s, it did not really come to life until the arrival of Salesforce.com in 1999. Salesforce.com enabled the delivery of enterprise applications via a website, something that had not been done in the past. This delivery of an application over the internet opened the doors for other software companies alike. Amazon followed suit in 2002 with internet-based (cloud-based) services including storage. In 2006, Amazon started renting computers for small business to run applications on and with this the cloud as we know it today was born. Since then a variety of cloud providers have entered the space and recently ISO Standards for the cloud have been implemented.

Summary

The world of data storage has come a long way. From managing paper punch cards on expensive hardware, to not having to manage hardware at all.. As you can see a lot of the “new” technologies of today were actually old concepts or technology reborn. So maybe it is good to look into the past to move forward into the future.

Sources:

http://www.crn.com/slide-shows/storage/240142353/the-history-of-the-hard-drive-and-its-future.htm

http://history-computer.com/ModernComputer/Basis/tape.html

https://www.pcworld.com/article/246617/storage/evolution-of-the-solid-state-drive.html

https://www.pcmag.com/article2/0,2817,2404258,00.asp

http://www.computerweekly.com/opinion/The-Hollerith-hand-punch

https://virtualizationreview.com/articles/2015/07/30/the-software-defined-storage-revolution.aspx

http://www.zetta.net/about/blog/history-data-storage-technology https://www.pcworld.com/article/246617/storage/evolution-of-the-solid-state-drive.html

http://www.storagereview.com/origin_solid_state_drives

https://virtualizationreview.com/articles/2015/07/30/the-software-defined-storage-revolution.aspx

https://www.vmware.com/solutions/software-defined-datacenter/in-depth.html

http://caverntechnologies.com/articles/the-evolution-of-the-data-center