Tuesday, October 25, 2016

Understanding I/O - What about IOPS, Throughput, Latency and I/O Size

This blog article is about one of my most favourite topics with just two letters: I/O. Why? Because really everything around virtualization and storage is about how I/O works and there is not much fun in life without Input/Output. And yes there are many blog articles about I/O but not so much from the I/O size perspective. So hopefully this will help you with some confusion. Let’s start very simple and define this four keywords:

IOPS

IOPS is a number of I/O per second. This can be a number of IOPS delivered by particular Storage System or consumed by a single Virtual Machine or physical computer with local storage, IOPS of a single disk in Windows Performance Monitor etc. Every storage vendor will always throw a maximum IOPS number at you but it does not mean too much because the pure number of IOPS is not as important as the behaviour of other factors like I/O size, Read or Write, bustiness, transfer delay etc.!

I/O Size (Block Size)

I/O size or block size is the size of an Input/Output operation. You can also think of them as the “payload”. If you want to compare it to a highway it is the size of the cars and trucks on this highway. Some of them are really small like a “Smart Car”, while others are huge trailer trucks. The I/O size is measured in kB. The following figure shows you the difference from a relatively small I/O size of 4 kB to a big I/O size of 512 kB. Just think about the fact that a 512 kB block has 128 times the payload of a 4 kB I/O.

Figure 1: I/O Size

Most of today’s storage or virtualization systems will only show you the average I/O size. Let’s take an example. Your application is doing 950 IOPS x 4 kB and 50 IOPS x 512 kB. You agree with me that the 95% of your IOPS are 4 kB and just 5 % are 512 KB correct? But your average I/O size is:
Throughput: 950 IOPS x 4 kB + 50 x 512 kB = 3,800 kB + 25,600 kB = 29,400 kB
Average I/O size: 29,400 / 1,000 = 29.4 kB
Is that fair? Yes from an average I/O size perspective it is absolutely but how do you know now that 95% were 4 kB I/O’s and just 5% 512 kB I/O’s? You usually won’t.

Throughput

Throughput is the size measured in MB/s or GB/s: Throughput = IOPS x I/O Size
Let’s take an example of 1000 IOPS with the I/O size of 4 kB and 512 kB respectively. You would agree that though each workload delivers 1000 IOPS, the behaviour depends extremely on the I/O size.
1,000 IOPS x 4 kB = 4,000 kB
1,000 IOPS x 512 kB = 512,000 kB
A very simple rule is that the higher the I/O size, the higher the Throughput will be.

Latency

Latency is the time an I/O takes from request to completion. Latency is measured in ms (milliseconds) or msec (microseconds). As you can imagine, the above example the latency will be different for a 4 kB I/O vs. a 512 kB I/O. In my opinion most vendors talk way too much about IOPS, Throughput and Latency for a very specific use case. And most of the time just about 4 kB reads which are relatively easy to archive or a mix of 70/30 Read/Write Ratio. The problem is that a workload of a system is changing permanently and every customer environment is different.

Real World Example

In the real world example I use PernixData’s product Architect to visualize. This article is clearly not about PernixData Architect but the fact that it is important to understand what your systems are doing and Architect is very good to archive this. The following figure shows you how the Read/Write workload changes over time.
Figure 2: PernixData Architect Workload Read/Write


The next figure shows you the same workload but the change for the I/O size over time. You clearly see different I/O sizes at different time and this workload is even very similar over time. There are many examples from my experience where the I/O size over time changes completely.
Figure 3: PernixData Architect Workload BlockSize


Coming back to my earlier example of 95% x 4 kB read and 5% x 512 kB read I used a simple Iometer workload pattern. As you see in the following figure we have 76,964 x 4 kB (307,856 kB) IOPS and 4,056 x 512 kB (2,076,672 kB). So calculating the average I/O size would be 2,384,528 kB / 81,020 = 29.43 kB.
Figure 4: PernixData Architect IOPS

The next figure shows the same from the latency perspective and shows that a 512 kB I/O has a much higher latency compared to a 4 kB block. Just as a comparison:

76,964 x 4 kB IOPS = 0.332 ms

4,056 x 512 kB = 2.037 ms

Figure 5: PernixData Architect Latency


Going back to my Iometer screen I see the workload and no  I/O size just the average I/O size I could calculate dividing Throughput / IOPS and the average latency of this workload which is in the below figure 0.7894 ms. This shows that it is very important to understand the I/O size in combination with your I/O (read & write).

Figure 6: Iometer

Conclusion

The conclusion of this article is that it is very important to understand your I/O. This is not easily done with many of today's tools. The problem with synthetic benchmark tools like Iometer is that testing a simple 100% 4 kB workload is not what your systems will do. It will make all storage systems shine. But what happens when the application owner calls and says that the application is slow at certain times a day? If you don’t have the data to know what happened it is mostly guessing. Because it could be that the 5% 512 kB I/O’s are causing the storage a headache and high latencies for other applications. Fixing issues based on assumptions is never easy.


As always if you have any questions, recommendations, concerns please don’t be hesitate to contact me or comment.

61 comments:

  1. Very crisp and clear explanation of
    IOPS
    I/O Size
    Throughput
    Latency

    ReplyDelete
    Replies
    1. The best interior designers in Patna thinks that behind every inspiring interior there is a dedicated team of human and machines. We create a extravagant interior
      full of natural colors and artworks that cut above the rest of our competetors. Our unmatched quality is the real boost of our success that inspires us to design
      best with nature.
      Best interior designers in Patna.

      Delete
  2. Hi, how do I calculate my IOPS when the manual says
    [min],[max],[typical] [100],[200],[150]

    Do I make the test using 4Kb or 512Kb, what would be the best test, I have done already using 512kb, look the result, for three different disks

    Disk E: 4503.60 IOPS
    Disk D: 4395.60 IOPS

    Disk C:\ 334.66 IOPS

    Can you give me a tip ?

    ReplyDelete

  3. I see the greatest contents on your blog and I extremely love reading them.

    Best Institute for Data Science in Hyderabad

    ReplyDelete
  4. Service on wheel provides Microwave repair in Agra, we will send trained, experienced and verified professionals to attend your Microwave repair and service request and get the job done. We repair all brands of Microwave Oven like Samsung, National, Panasonic.does you Need to urgently fix your Microwave oven Service in Agra.

    ReplyDelete
  5. Thank you for sharing very informative information and check this Nakoda Urban services offers the Best House cleaning services in India at very reasonable prices and check it more services
    House cleaning services in Raipur
    House cleaning services in Bhopal
    House cleaning services in Indore
    House cleaning services in Ahmedabad
    House cleaning services in Kolkata
    cleaning services in Delhi

    ReplyDelete
  6. Thanks for the share of the content through this platform for us and amazing for readable. Visit more Dubai Desert safari

    ReplyDelete
  7. Thanks for sharing these kind of information. Hope this will useful to so many people who all are reading this blog. Keep posting like these, thanks once again Ac Repair Service in Bhopal

    ReplyDelete
  8. Thanks for sharing your information...It's very useful for many users...I will be waiting for your next post.
    Visit Best Astrologer in Tumkur.

    ReplyDelete
  9. This is really interesting, you are such a great blogger. Visit media foster for creative and professional website design and Digital Marketing Company in Mohali and Also get Digital Marketing Course in Mohali
    TOP IT Company in Mohali
    best seo Company in Mohali

    ReplyDelete

  10. We Offers All Types Of Affordable Luxury Cars On Rent For Wedding, Marriage, Roka, Doli, Shadi, Family Events, Sagun, Honeymoon Tours etc.
    best luxury car rental in Chandigarh
    luxury car rental in Chandigarh

    ReplyDelete
  11. thanks for sharing this is very informative blog,DND is a leading digital marketing & web designing company in chandigarh. We are providing tailor made digital marketing and web designing services to our clients in chandigarh and other regions of the world.
    best industrial training in chandigarh
    it company in Chandigarh

    ReplyDelete
  12. Great Information! This Is Such A Knowledge able article
    thanks! if you to read more article related to air conditioner maintenance here click and view such a great AC Articles ac maintenance mira dubai

    Great Information! This Is Such A Knowledge able article
    thanks! if you to read more article related to air conditioner maintenance here click and view such a great AC Articles ac maintenance springs dubai

    ReplyDelete
  13. A creative mind of Designer Associates put a creative touch to your home or office. We can help you to make your space look great with your personal choice. We use our expert insights to create designs that will help you to leverage the space to its maximum
    interior designer in patna



    ReplyDelete
  14. Interior decorators in Patna who can transform your living space into a space of your dreams with panache. Interior decorators in Patna that have mastered the art of interior designing
    interior designer in patna

    ReplyDelete
  15. Hello, Thank you for your meaningful words which is easily understand by people,it would really helpful for the proper workflow. Thankyou for sharing this wonderful article , We are also sharing the blogs on the topic of Gaming software which is helpful for playing games on pc if you want to read it then kindly visit here울산수테라피
    서울수테라피
    인천수테라피
    세종수테라피
    세귀포수테라피
    제주수테라피

    ReplyDelete
  16. Really Nice Article! You post inspire me too much.
    lottery sambad from lotterysambad24hr.com

    ReplyDelete
  17. Find Buyers Supplier, Trader from Philippineseximp for philippines import data, philippines export data, philippines customs data. Visit our website for more information.
    Philippines Customs Data

    ReplyDelete
  18. Great Information! This Is Such A Knowledge able article
    thanks!
    architect in patna

    ReplyDelete

  19. First of all, I would like to appreciate your efforts towards this piece of blog. This helps me a lot. Keep it up and keep sharing such posts.
    During covid, students have faced problems while studying. Students weren't able to go to school or their tuition classes. But then an online education plays an important role and helps students to resume their studies online. Even after covid most of the students prefer online tuition for class 8 to 12th. The reason behind most of the students still prefer to take online classes, it saves time and effort. Students are not able to give more time to their studies.
    Introducing Women, Caste, and Reform

    ReplyDelete
  20. If you want to do inverter ac pcb repairing course in Delhi visit our DIGI MANTHAN institute and take a free demo class. To help you enhance your technological proficiency, we provide instruction in mobile hardware, software, and maintenance that is career-focused. We promise to do everything we can to support you in your job search. Visit our website or give us a call at 95-40-438-438 if you'd like further details.

    ReplyDelete

  21. Do you need more information about the ac repair training centres me? Come to our DIGI MANTHAN institute and take a free demo class. We offer career-oriented training in mobile repair, hardware, and software to help you advance your technological knowledge and abilities. If you need further information, you can reach us at 95-40-438-438.

    ReplyDelete
  22. Do you need more information about the ac repairing course? We provide a range of technology classes, including web courses, ac pcb repair, and android courses, for a free sample class.
    ac repairing course near me

    ReplyDelete
  23. Come to our ABCMIT training centre if you're interested in a
    Mobile Repairing Course in Laxmi Nagar Delhi. Participants in a sample lesson are students. Our advice will help you get more technical understanding and proficiency. The training facility at ABCMIT has a lot of knowledge regarding this subject. This programme has a promising future. We are fully committed to helping you find employment. Call 9540438438 if you'd like to learn more about us.

    ReplyDelete
  24. Thanks for sharing this Information! It will always sit within arm's reach of anyone who are seeking for learn about IOPS.
    Ambulance service in Delhi

    ReplyDelete
  25. Thanks for sharing the valuable information!
    .
    If you are looking to boost your online sales and increase website traffic, then look no further than Boffin Coders, the best SEO company in Mohali! Our team of experts will work tirelessly to optimise your website for maximum visibility and engagement, driving up sales and growing your customer base!

    ReplyDelete
  26. Hydraulic oil filters are an essential part of hydraulic systems. They remove impurities and debris from the oil, protecting the system components and maintaining efficiency. Types of filters include full-flow, bypass, and duplex filters. Regular maintenance, including filter replacement, is crucial for a healthy hydraulic system and reducing downtime for repairs. Invest in high-quality hydraulic oil filters to ensure the longevity and efficiency of your hydraulic system.

    ReplyDelete
  27. I want to thank you for all of your work on this blog. This is a big assistance. Keep it up and spread more articles like this.
    want know about volari airlines here you can find some information how much does volaris charge to change flight

    ReplyDelete
  28. Are you looking to cancel your Delta Airlines booking? But, before that, do you want to know about its Delta Airlines Cancellation Policy? If yes, then here are some of the points that will provide you with the required details.

    ReplyDelete
  29. Are you looking to cancel your United Airlines booking? But, before that, do you want to know about its United Airlines Cancellation Policy? If yes, then here are some of the points that will provide you with the required details.

    ReplyDelete
  30. If are you looking for the best Youth Career Counselling in Canberra then you can trust Transform Career Services Company which is dedicated to providing youth Career counseling services for young individuals looking to explore their professional paths.

    ReplyDelete

  31. Evaluate an individual's skills, abilities, and potential to perform specific tasks or roles in the workplace with Aptitude Testing for Jobs offer by Transform Career Services.

    ReplyDelete
  32. home to one of the region's most significant military airbases – Changi Air Base West (WSSS) Singapore Contact Details While it primarily serves military functions, travelers passing through the Lion City can't help but be intrigued by the proximity to this aviation powerhouse. In this blog, we'll delve into the traveler's perspective on Changi Air Base West and provide essential contact details for a seamless journey.

    ReplyDelete
  33. Step into the world of possibilities with free local classified ads in India. Elevate your buying and selling experience effortlessly. Post free classified ads and unlock a marketplace where community meets convenience. It's your chance to seamlessly connect, trade, and discover treasures in your neighborhood. Explore, engage, and empower your local connections today.

    ReplyDelete
  34. Thanks for posting a valuable and informative blog. Further, If you are looking to buy luxury property in delhi ncr visit our website.

    ReplyDelete
  35. Very informative blog, thanks for sharing this useful information. Heart Valve Replacement surgery becomes an option to repair damaged, fragile, or scarred heart valves. More than three million people opt to have a valve replacement surgery annually.

    ReplyDelete
  36. Thanks for sharing this valuable blog, keep posting. A bone marrow transplantation is an operation performed to supplant bone marrow that has been harmed or obliterated by illness, contamination, or chemotherapy.

    ReplyDelete
  37. 5. "Treat your taste buds to a sumptuous feast during our desert safari Dubai deals. Indulge in a variety of traditional Arabic dishes, from succulent grilled meats to mouthwatering sweets. Your stomach will thank you!"

    ReplyDelete
  38. Nice blog thanks for sharing great and amazing content with us.
    Choose Crehan Carpentry & Construction for the best carpentry Services. We are experts in Carpentry Services in Maynooth that are specifically made to suit your preferences. Regardless of whether it’s custom furniture or complete remodelling, our team of professionals will always make sure that everything meets your specifications. For several years now, we have been able to satisfy our client’s needs with quality services delivered on time and within the set budget.

    ReplyDelete
  39. Very informative blog, thanks for providing this valuable post. Here Optical Coherence Tomography (OCT) technique a boon for patients of heart attack. Doesn’t every patient deserve to have stents tailor-made for his/her arteries?

    ReplyDelete
  40. With our excellent leather re-colouring and repair services, you can give your cherished leather lounge, chairs, or vehicle seats a new lease on life! Our experts can fix cracks, scuffs, and stains, disguise imperfections, and restore colour using top-tier solutions. We offer three different levels of service to meet your needs, from basic touch-ups to full resprays for any size scratch or sun damage. The original colour of your leather is enhanced and preserved with our special colour tint treatment. With our skilled leather restoration service , bid your leather problems farewell and welcome restored beauty.

    ReplyDelete